00010000:00010000:0.0:1746129798.123091:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fadc00/0x48868a4e43950b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353814 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.123110:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fadc00/0x48868a4e43950b55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353814 expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.123117:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fadc00, rc 0) 00000100:00100000:0.0:1746129798.123129:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949053663872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 68us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.123133:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13778 00000100:00100000:0.0:1746129798.127005:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053758336:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129798.127027:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fac600/0x48868a4e43950b47 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353806 expref: 18 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.127038:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fac600/0x48868a4e43950b47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353806 expref: 18 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.127047:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fac600, rc 0) 00000100:00100000:0.0:1746129798.127065:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949053663104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4425us (5683us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129798.127071:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13776 00000100:00100000:0.0:1746129798.143584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.143680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129798.147047:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129798.149288:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053664640 00000100:00100000:0.0:1746129798.149296:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053664640 00002000:00100000:0.0:1746129798.149332:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094d8f100 x1830949053664640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.149352:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f100 with x1830949053664640 ext(1048576->2097151) 00002000:00010000:0.0:1746129798.149356:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f100 00000100:00100000:0.0:1746129798.149370:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053664512 00000100:00100000:0.0:1746129798.149372:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053664512 00002000:00100000:0.0:1746129798.149383:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094d8d180 x1830949053664512/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.149389:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949053664512 ext(1048576->2097151) 00002000:00010000:0.0:1746129798.149391:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8d180 00000100:00100000:0.0:1746129798.149398:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053665024 00000100:00100000:0.0:1746129798.149400:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053665024 00002000:00100000:0.0:1746129798.149410:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff880094d8ed80 x1830949053665024/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.149414:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949053665024 ext(4194304->4898815) 00002000:00010000:0.0:1746129798.149417:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8ed80 00000100:00100000:0.0:1746129798.149427:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6021 00000100:00100000:0.0:1746129798.149434:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949053664640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129798.150046:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6023 00000100:00100000:0.0:1746129798.150053:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949053665024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129798.172947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.179894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.183641:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.186660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.190107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.201838:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.205583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.223656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.224920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.227900:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.227962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.230100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.234361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.234397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.234424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.234485:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129798.235005:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129798.238983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.244627:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053667840 00000100:00100000:0.0:1746129798.244633:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053667840 00010000:00010000:0.0:1746129798.244658:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd9e800/0x48868a4e43950b94 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35383e expref: 12 pid: 14313 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746129798.244677:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6771 00000100:00100000:0.0:1746129798.244684:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949053667840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129798.244693:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129798.244698:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd9e800/0x48868a4e43950b94 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35383e expref: 12 pid: 14313 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.244707:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd9e800/0x48868a4e43950b94 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35383e expref: 12 pid: 14313 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.244725:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd9e800/0x48868a4e43950b94 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35383e expref: 12 pid: 14313 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.244891:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88009baa2300) 00010000:00010000:0.0:1746129798.244895:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e43950bb7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129798.244904:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e43950bb7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129798.244908:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e43950bb7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129798.245102:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129798.245141:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053667840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 456us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.245147:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6771 00000100:00100000:0.0:1746129798.245891:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053668096 00000100:00100000:0.0:1746129798.245895:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053668096 00002000:00100000:0.0:1746129798.245918:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009ff3aa00 x1830949053668096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.245926:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff3aa00 with x1830949053668096 ext(2097152->3145727) 00002000:00010000:0.0:1746129798.245929:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff3aa00 00000100:00100000:0.0:1746129798.246050:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6025 00000100:00100000:0.0:1746129798.246056:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949053668096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129798.262477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.264455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.275805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.297357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.325981:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.327141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.331760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.331819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.331972:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13788 00000100:00100000:0.0:1746129798.331981:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949053671168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.331989:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.331997:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f179000/0x48868a4e43950c51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35388b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.332128:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.332130:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.332136:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f179000/0x48868a4e43950c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35388b expref: 32 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.332146:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f179000/0x48868a4e43950c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35388b expref: 32 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.332153:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f179000, rc 0) 00000100:00100000:0.0:1746129798.332174:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949053671168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 195us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.332179:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13788 00000100:00100000:0.0:1746129798.340016:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.343983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.345410:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801348f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053759360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129798.345419:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801348f7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053759488:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129798.345427:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801348f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053759616:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129798.345457:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f900e00/0x48868a4e43950c58 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3854336->4194303] (req 3854336->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353892 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.345472:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f900e00, rc 0) 00000100:00100000:0.0:1746129798.345518:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:30813:x1830949053671296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5247us (5509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.345524:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13789 00000100:00100000:0.0:1746129798.350723:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.350769:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.353297:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.359304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.370645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.370680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.370717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.370756:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053672704 00000100:00100000:0.0:1746129798.370763:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053672704 00002000:00100000:0.0:1746129798.370794:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012b024a80 x1830949053672704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.370803:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949053672704 ext(2097152->3145727) 00002000:00010000:0.0:1746129798.370807:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024a80 00000100:00100000:0.0:1746129798.370837:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053672960 00000100:00100000:0.0:1746129798.370840:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053672960 00002000:00100000:0.0:1746129798.370868:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3854335) req@ffff88009423ea00 x1830949053672960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.370875:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ea00 with x1830949053672960 ext(3145728->3854335) 00002000:00010000:0.0:1746129798.370878:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423ea00 00000100:00100000:0.0:1746129798.370895:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6033 00000100:00100000:0.0:1746129798.370900:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949053672576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129798.371827:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6034 00000100:00100000:0.0:1746129798.371833:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949053672960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129798.389893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.392509:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053673344 00000100:00100000:0.0:1746129798.392513:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053673344 00000100:00100000:0.0:1746129798.392532:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13792 00000100:00100000:0.0:1746129798.392548:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053673344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.392554:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.392561:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135caa200/0x48868a4e43950c6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3538a7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.392572:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.392579:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135caa200/0x48868a4e43950c6d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3538a7 expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.392588:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135caa200/0x48868a4e43950c6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3538a7 expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.393090:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135caa200, rc 0) 00000100:00100000:0.0:1746129798.393684:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053673344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 586us (935us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129798.393692:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13792 00000100:00100000:0.0:1746129798.394330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.394364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.395817:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053673728 00000100:00100000:0.0:1746129798.395821:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053673728 00010000:00010000:0.0:1746129798.395835:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd9fa00/0x48868a4e43950b71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353830 expref: 20 pid: 8437 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746129798.395867:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6778 00000100:00100000:0.0:1746129798.395873:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949053673728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129798.395880:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129798.395889:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd9fa00/0x48868a4e43950b71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353830 expref: 20 pid: 8437 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.395897:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd9fa00/0x48868a4e43950b71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353830 expref: 20 pid: 8437 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.395908:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd9fa00/0x48868a4e43950b71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353830 expref: 20 pid: 8437 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.395917:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.395919:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.395924:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013186f200/0x48868a4e43950c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353899 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.395932:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013186f200/0x48868a4e43950c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353899 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.396445:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013186f200/0x48868a4e43950c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1552384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353899 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129798.396468:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053760768:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129798.397021:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129798.397503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.399508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.400251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.400380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.400419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.401138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.404285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.411135:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.411948:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.419385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.422275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.422992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.423107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.423122:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053676160 00000100:00100000:0.0:1746129798.423124:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053676160 00000100:00100000:0.0:1746129798.423146:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13796 00000100:00100000:0.0:1746129798.423150:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053676160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.423155:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.423161:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135cab000/0x48868a4e43950c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3538c3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.423175:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135cab000/0x48868a4e43950c89 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3538c3 expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.423196:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135cab000/0x48868a4e43950c89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3538c3 expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.423206:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cab000, rc 0) 00000100:00100000:0.0:1746129798.423221:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053676160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 70us (113us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129798.423225:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13796 00000100:00100000:0.0:1746129798.424649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.428610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.433300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.524887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.534928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.539427:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.540519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.546141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.549211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.561467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.568516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.579056:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053679232 00000100:00100000:0.0:1746129798.579061:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053679232 00000100:00100000:0.0:1746129798.579091:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13802 00000100:00100000:0.0:1746129798.579096:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949053679232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.579102:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.579109:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093725400/0x48868a4e43950d00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353902 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.579241:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093725400/0x48868a4e43950d00 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353902 expref: 35 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.579249:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093725400/0x48868a4e43950d00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353902 expref: 35 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.579294:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093725400, rc 0) 00000100:00100000:0.0:1746129798.579314:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949053679232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 218us (409us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129798.579319:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13802 00000100:00100000:0.0:1746129798.605119:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.611568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.613543:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.624309:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.644477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.649625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.653302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.655784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.660901:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053762816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129798.674977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.684252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.684485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.686410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.686436:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053681920 00000100:00100000:0.0:1746129798.686446:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053681920 00002000:00100000:0.0:1746129798.686501:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009faf7100 x1830949053681920/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.686510:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf7100 with x1830949053681920 ext(2097152->3145727) 00002000:00010000:0.0:1746129798.686515:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf7100 00000100:00100000:0.0:1746129798.686541:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053682304 00000100:00100000:0.0:1746129798.686544:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053682304 00002000:00100000:0.0:1746129798.686555:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6eea00 x1830949053682304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:539/0 lens 488/0 e 0 to 0 dl 1746129809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129798.686561:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6eea00 with x1830949053682304 ext(3145728->4194303) 00002000:00010000:0.0:1746129798.686563:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6eea00 00000100:00100000:0.0:1746129798.686584:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6042 00000100:00100000:0.0:1746129798.686591:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053681920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129798.697595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.700760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.701654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.701713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.706969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.712521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.712731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.712762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.712831:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053683712 00000100:00100000:0.0:1746129798.712833:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053683712 00000100:00100000:0.0:1746129798.713139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.713151:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053683840 00000100:00100000:0.0:1746129798.713154:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053683840 00000100:00100000:0.0:1746129798.713173:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13812 00000100:00100000:0.0:1746129798.713178:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053683840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.713194:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.713204:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e43950d54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35394f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.713213:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.713214:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.713218:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e43950d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35394f expref: 26 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.713226:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e43950d54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35394f expref: 26 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.713232:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a540e400, rc 0) 00000100:00100000:0.0:1746129798.713327:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949053683840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 148us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.713332:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13812 00000100:00100000:0.0:1746129798.713383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.720929:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.723660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.733917:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.733940:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.733964:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.733984:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.734007:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.734041:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13814 00000100:00100000:0.0:1746129798.734049:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949053684864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.734064:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.734085:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a540e000/0x48868a4e43950d69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35395d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129798.734125:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053764352:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129798.735726:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129798.762547:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.762778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.763081:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13817 00000100:00100000:0.0:1746129798.763087:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949053685888:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129798.763093:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.763102:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fadc00/0x48868a4e43950d7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35396b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129798.763124:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053764736:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129798.763920:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129798.769460:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.771181:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053764736:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129798.771203:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fadc00/0x48868a4e43950d7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35396b expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.771215:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fadc00/0x48868a4e43950d7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35396b expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.771227:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fadc00, rc 0) 00000100:00100000:0.0:1746129798.771256:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949053685888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8169us (8478us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129798.771267:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13817 00000100:00100000:0.0:1746129798.782744:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.808123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.810322:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.818400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.821903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.828095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.832431:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.832511:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.834783:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.841263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.855071:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.858141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.858826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.860794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.860826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.866178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.866212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.866237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.866249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.866261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.866332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.872702:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.880229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.890307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.890337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.890398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.891111:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13828 00000100:00100000:0.0:1746129798.891118:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949053690624:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129798.891125:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129798.891133:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cabc00/0x48868a4e43950e0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3539d4 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129798.891155:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053766784:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129798.891215:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129798.892776:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053766784:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129798.892794:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cabc00/0x48868a4e43950e0a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3539d4 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.892803:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cabc00/0x48868a4e43950e0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3539d4 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129798.892814:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cabc00, rc 0) 00000100:00100000:0.0:1746129798.892834:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949053690624:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1717us (2435us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129798.892840:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13828 00000100:00100000:0.0:1746129798.903686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.903721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.903742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.904513:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.904732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.907718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.908916:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.922326:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.922883:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.922896:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053692032 00000100:00100000:0.0:1746129798.922899:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053692032 00010000:00010000:0.0:1746129798.922912:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130521000/0x48868a4e43950d07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2105344->18446744073709551615] (req 2105344->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353909 expref: 23 pid: 3624 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746129798.923695:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6811 00000100:00100000:0.0:1746129798.923700:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949053692032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129798.923711:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129798.923717:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130521000/0x48868a4e43950d07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2105344->18446744073709551615] (req 2105344->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353909 expref: 23 pid: 3624 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.923725:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130521000/0x48868a4e43950d07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2105344->18446744073709551615] (req 2105344->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353909 expref: 23 pid: 3624 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.923734:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130521000/0x48868a4e43950d07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2105344->18446744073709551615] (req 2105344->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353909 expref: 23 pid: 3624 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.923745:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129798.923759:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949053692032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 59us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.923763:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6811 00000100:00100000:0.0:1746129798.923817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.923825:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053692928 00000100:00100000:0.0:1746129798.923828:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053692928 00010000:00010000:0.0:1746129798.923836:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e43950d0e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353910 expref: 35 pid: 7975 timeout: 844 lvb_type: 0 00000100:00100000:0.0:1746129798.923875:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6812 00000100:00100000:0.0:1746129798.923879:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949053692928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129798.923885:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129798.923891:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e43950d0e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353910 expref: 36 pid: 7975 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.923898:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e43950d0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353910 expref: 36 pid: 7975 timeout: 844 lvb_type: 0 00010000:00010000:0.0:1746129798.923907:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.923908:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129798.923911:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135383c00/0x48868a4e43950e42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.923917:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135383c00/0x48868a4e43950e42 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129798.923925:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129798.923938:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949053692928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.923943:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6812 00000100:00100000:0.0:1746129798.925457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.933504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.938601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.944938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.959224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.959267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.959279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.959306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129798.960534:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053694336 00000100:00100000:0.0:1746129798.960538:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053694336 00010000:00010000:0.0:1746129798.960550:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a48c00/0x48868a4e43950b39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3537ff expref: 21 pid: 1851 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129798.960563:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053694848 00000100:00100000:0.0:1746129798.960564:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053694848 00010000:00010000:0.0:1746129798.960570:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a49600/0x48868a4e43950a52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353773 expref: 22 pid: 14314 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129798.960717:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6821 00000100:00100000:0.0:1746129798.960723:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949053694336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129798.960730:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129798.960734:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a48c00/0x48868a4e43950b39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3537ff expref: 22 pid: 1851 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129798.960741:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a48c00/0x48868a4e43950b39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3537ff expref: 22 pid: 1851 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129798.960752:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a48c00/0x48868a4e43950b39 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3537ff expref: 22 pid: 1851 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129798.960764:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88009baa2300) 00010000:00010000:0.0:1746129798.960767:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fef9400/0x48868a4e43950e50 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129798.960772:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129798.961337:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949053694336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 614us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129798.961341:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6821 00000100:00100000:0.0:1746129798.962830:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.014379:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053769728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.014432:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.014473:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053770240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.014490:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053769856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.014505:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.014517:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053770368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.014627:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.014638:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053770752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.014659:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053769728 00000100:00100000:0.0:1746129799.014666:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053769728 00000100:00100000:0.0:1746129799.014697:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053769472 00000100:00100000:0.0:1746129799.014698:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053769472 00000100:00100000:0.0:1746129799.014705:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053769984 00000100:00100000:0.0:1746129799.014706:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053769984 00000100:00100000:0.0:1746129799.014711:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053769856 00000100:00100000:0.0:1746129799.014712:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053769856 00000100:00100000:0.0:1746129799.014717:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053770496 00000100:00100000:0.0:1746129799.014719:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053770496 00000100:00100000:0.0:1746129799.014727:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053771008 00000100:00100000:0.0:1746129799.014729:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053771008 00000100:00100000:0.0:1746129799.014734:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053769600 00000100:00100000:0.0:1746129799.014735:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053769600 00000100:00100000:0.0:1746129799.014741:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053770112 00000100:00100000:0.0:1746129799.014743:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053770112 00000100:00100000:0.0:1746129799.014748:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053770624 00000100:00100000:0.0:1746129799.014755:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053770624 00000100:00100000:0.0:1746129799.014763:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053771136 00000100:00100000:0.0:1746129799.014765:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053771136 00000100:00100000:0.0:1746129799.014773:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13835 00000100:00100000:0.0:1746129799.014778:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053769728:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746129799.014794:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129799.014796:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129799.014805:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13837 00000100:00100000:0.0:1746129799.014809:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3298:x1830949053769984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.014977:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801348f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3298:x1830949053769984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (490us total) trans 17179873775 rc 0/0 00000100:00100000:0.0:1746129799.014982:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13837 00000100:00100000:0.0:1746129799.014992:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13840 00000100:00100000:0.0:1746129799.014995:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053771008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015065:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801348f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053771008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (520us total) trans 21474840945 rc 0/0 00000100:00100000:0.0:1746129799.015070:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13840 00000100:00100000:0.0:1746129799.015078:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13843 00000100:00100000:0.0:1746129799.015081:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053770624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015146:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053770624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (521us total) trans 21474840946 rc 0/0 00000100:00100000:0.0:1746129799.015151:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13843 00000100:00100000:0.0:1746129799.015159:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13845 00000100:00100000:0.0:1746129799.015163:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053770240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.015211:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.015229:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053770880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015249:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.015258:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053771392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015271:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129799.015296:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d636a00/2, rc 0, transno 17179873777 00000100:00100000:0.0:1746129799.015301:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053769856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.015385:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3296:x1830949053769728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 608us (954us total) trans 17179873779 rc 0/0 00000100:00100000:0.0:1746129799.015390:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13835 00000100:00100000:0.0:1746129799.015398:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13848 00000100:00100000:0.0:1746129799.015402:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+55:3297:x1830949053771392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015463:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949053771392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (191us total) trans 21474840949 rc 0/0 00000100:00100000:0.0:1746129799.015467:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13848 00000100:00100000:0.0:1746129799.015482:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.015493:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053771264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129799.015521:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d634700/2, rc 0, transno 17179873779 00000100:00100000:0.0:1746129799.015539:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053769728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.015553:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff38380/2, rc 0, transno 17179873778 00000100:00100000:0.0:1746129799.015555:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053770368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.015562:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4d180/2, rc 0, transno 21474840948 00000100:00100000:0.0:1746129799.015567:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053770880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.015573:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4c000/2, rc 0, transno 21474840949 00000100:00100000:0.0:1746129799.015575:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053771392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015610:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13850 00000100:00100000:0.0:1746129799.015614:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053771264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129799.015770:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129799.015773:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129799.015775:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129799.015777:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129799.015779:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129799.015793:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053771264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (286us total) trans 21474840951 rc 0/0 00000100:00100000:0.0:1746129799.015798:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13850 00000100:00100000:0.0:1746129799.015806:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053771520 00000100:00100000:0.0:1746129799.015808:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053771520 00000100:00100000:0.0:1746129799.015818:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13851 00000100:00100000:0.0:1746129799.015822:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053771520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015911:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3298:x1830949053771520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (120us total) trans 21474840952 rc 0/0 00000100:00100000:0.0:1746129799.015916:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13851 00000004:00080000:0.0:1746129799.015931:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff39500/2, rc 0, transno 21474840950 00000100:00100000:0.0:1746129799.015933:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053770752:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.015939:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4c380/2, rc 0, transno 21474840951 00000100:00100000:0.0:1746129799.015941:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053771264:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.015973:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830949053770240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 810us (1345us total) trans 17179873776 rc 0/0 00000100:00100000:0.0:1746129799.015978:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13845 00000004:00080000:0.0:1746129799.016831:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeed80/2, rc 0, transno 17179873776 00000100:00100000:0.0:1746129799.016864:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053770240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.016912:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053695232 00000100:00100000:0.0:1746129799.016916:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053695232 00000100:00100000:0.0:1746129799.016950:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10620 00000100:00100000:0.0:1746129799.016956:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:30839:x1830949053695232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.016973:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.016987:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fadc00/0x48868a4e43950e57 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3539e2 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.017036:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fadc00/0x48868a4e43950e57 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3539e2 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.017048:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fadc00/0x48868a4e43950e57 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3539e2 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.017063:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88009baa2300) 00010000:00010000:0.0:1746129799.017065:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129799.017067:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fadc00, rc 0) 00000100:00100000:0.0:1746129799.017097:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:30839:x1830949053695232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 141us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.017102:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10620 00000100:00100000:0.0:1746129799.022107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.026725:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.026762:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.026786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.026809:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.026821:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.026917:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.092467:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095234:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095286:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095296:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095352:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.095532:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053698816 00000100:00100000:0.0:1746129799.095535:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053698816 00000100:00100000:0.0:1746129799.095547:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053699072 00000100:00100000:0.0:1746129799.095549:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053699072 00000100:00100000:0.0:1746129799.095559:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13858 00000100:00100000:0.0:1746129799.095565:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949053698688:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129799.096004:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129799.096006:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.096008:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.096009:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.096011:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129799.096023:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949053698688:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 460us (792us total) trans 17179873785 rc 0/0 00000100:00100000:0.0:1746129799.096028:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13858 00000100:00100000:0.0:1746129799.096036:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13863 00000100:00100000:0.0:1746129799.096040:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949053699072:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129799.096082:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4896768 -> 4896768 00002000:00010000:0.0:1746129799.096084:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.096086:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.096094:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.096095:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5545 -> 5545 00000100:00100000:0.0:1746129799.096107:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949053699072:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 67us (755us total) trans 21474840955 rc 0/0 00000100:00100000:0.0:1746129799.096111:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13863 00000100:00100000:0.0:1746129799.100222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.103746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:0.0:1746129799.134697:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8ce00/2, rc 0, transno 17179873786 00000100:00100000:0.0:1746129799.134702:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053771776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.135636:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8d880/2, rc 0, transno 17179873787 00000100:00100000:0.0:1746129799.135640:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053772288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.136751:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8f480/2, rc 0, transno 17179873788 00000100:00100000:0.0:1746129799.136755:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053772160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.136762:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8f100/2, rc 0, transno 17179873789 00000100:00100000:0.0:1746129799.136764:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053772672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.136771:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645e300/2, rc 0, transno 21474840958 00000100:00100000:0.0:1746129799.136777:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053773184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.136783:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645ca80/2, rc 0, transno 21474840959 00000100:00100000:0.0:1746129799.136785:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053773696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.136791:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8ca80/2, rc 0, transno 21474840957 00000100:00100000:0.0:1746129799.136793:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053772800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.136797:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645c000/2, rc 0, transno 21474840956 00000100:00100000:0.0:1746129799.136800:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053773312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.136904:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053773824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.136925:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129799.137216:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505180/2, rc 0, transno 21474840964 00000100:00100000:0.0:1746129799.137219:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053773824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.138983:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.170798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.184055:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.188444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.191928:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053700864 00000100:00100000:0.0:1746129799.191935:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053700864 00000100:00100000:0.0:1746129799.191980:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10626 00000100:00100000:0.0:1746129799.191987:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:30847:x1830949053700864:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129799.192004:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.192017:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a203e00/0x48868a4e43950f30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353a36 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.192087:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a203000/0x48868a4e43950f37 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129799.192098:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94bc00/0x48868a4e43950ef8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a21 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.192104:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94a200/0x48868a4e43950f1b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a28 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.192110:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a203000/0x48868a4e43950f37 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129799.192145:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94a200/0x48868a4e43950f1b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a28 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.192155:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94a200/0x48868a4e43950f1b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a28 expref: 7 pid: 16808 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.192165:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053773952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129799.192237:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94bc00/0x48868a4e43950ef8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a21 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.192244:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94bc00/0x48868a4e43950ef8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a21 expref: 284 pid: 14313 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.192250:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053774080:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129799.192263:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa452600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129799.194202:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053700992 00000100:00100000:0.0:1746129799.194207:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053700992 00000100:00100000:0.0:1746129799.194243:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13882 00000100:00100000:0.0:1746129799.194249:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:30852:x1830949053700992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129799.194264:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.194275:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fef9c00/0x48868a4e43950f3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353a3d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.194290:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.194292:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.194298:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fef9c00/0x48868a4e43950f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a3d expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.194319:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fef9c00/0x48868a4e43950f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a3d expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.194328:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fef9c00, rc 0) 00000100:00100000:0.0:1746129799.194369:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:30852:x1830949053700992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.194374:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13882 00000100:00100000:0.0:1746129799.195972:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.195993:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.196245:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.213771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.213901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.225805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.245321:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.255461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.263772:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.269611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.274531:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949053703040:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9456us (10743us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129799.274543:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6065 00002000:00100000:0.0:1746129799.274553:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012ba18000 x1830949053703040/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/440 e 0 to 0 dl 1746129810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.274561:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949053703040 ext(1048576->2097151) 00002000:00010000:0.0:1746129799.274566:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:0.0:1746129799.281496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.282181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.294688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.309043:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.316335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.319896:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.328737:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.344974:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.345014:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.347704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.348335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.348506:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13892 00000100:00100000:0.0:1746129799.348514:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949053705088:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129799.348534:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.348543:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e43950fae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353a98 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.348553:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.348554:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.348561:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e43950fae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a98 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.348573:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e43950fae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a98 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.348580:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00b3e00, rc 0) 00000100:00100000:0.0:1746129799.348611:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949053705088:12345-192.168.204.31@tcp:101:cat.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.348625:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13892 00000100:00100000:0.0:1746129799.375005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.375055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.375109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.376134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.376165:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.376184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.376202:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053706368 00000100:00100000:0.0:1746129799.376207:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053706368 00002000:00100000:0.0:1746129799.376230:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800934d7800 x1830949053706368/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.376238:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949053706368 ext(2097152->3145727) 00002000:00010000:0.0:1746129799.376241:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000100:00100000:0.0:1746129799.376254:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6071 00000100:00100000:0.0:1746129799.376259:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949053705600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.376416:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6073 00000100:00100000:0.0:1746129799.376422:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949053706112:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.380346:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053707136 00000100:00100000:0.0:1746129799.380351:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053707136 00002000:00100000:0.0:1746129799.380366:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dc000 x1830949053707136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.380373:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc000 with x1830949053707136 ext(3145728->4194303) 00002000:00010000:0.0:1746129799.380376:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc000 00000100:00100000:0.0:1746129799.380390:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6076 00000100:00100000:0.0:1746129799.380400:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949053707136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.431339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.442655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.453055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.453138:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.454814:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.454827:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053708288 00000100:00100000:0.0:1746129799.454830:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053708288 00000100:00100000:0.0:1746129799.459476:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.460291:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053708544 00000100:00100000:0.0:1746129799.460294:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053708544 00010000:00010000:0.0:1746129799.460305:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94b600/0x48868a4e43950edc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a1a expref: 8 pid: 16808 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.460317:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6828 00000100:00100000:0.0:1746129799.460321:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949053708544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.460326:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.460329:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94b600/0x48868a4e43950edc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a1a expref: 8 pid: 16808 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.460336:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94b600/0x48868a4e43950edc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a1a expref: 8 pid: 16808 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.460352:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f94b600/0x48868a4e43950edc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a1a expref: 8 pid: 16808 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.460365:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.460367:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a06e00/0x48868a4e43950fbc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129799.460381:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a06e00/0x48868a4e43950fbc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129799.460386:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a06e00/0x48868a4e43950fbc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129799.460393:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f998600/0x48868a4e43950fc3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aa6 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.460406:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.460426:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949053708544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 104us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.460431:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6828 00000100:00100000:0.0:1746129799.465003:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053708672 00000100:00100000:0.0:1746129799.465011:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053708672 00000100:00100000:0.0:1746129799.465055:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10632 00000100:00100000:0.0:1746129799.465062:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:30847:x1830949053708672:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129799.465079:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.465094:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00b3c00/0x48868a4e43950fca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353aad expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.465146:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00b3c00/0x48868a4e43950fca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aad expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.465156:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00b3c00/0x48868a4e43950fca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aad expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.465166:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.465173:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129799.465177:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f998600/0x48868a4e43950fc3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aa6 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.465183:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a00b3c00, rc 0) 00000100:00100000:0.0:1746129799.465222:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:30847:x1830949053708672:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 160us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.465236:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10632 00000001:00080000:0.0:1746129799.477366:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944553 is committed 00000001:00080000:0.0:1746129799.477385:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944550 is committed 00000001:00080000:0.0:1746129799.477392:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944554 is committed 00000004:00080000:0.0:1746129799.477395:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2463 committed 00000004:00080000:0.0:1746129799.477406:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2434 committed 00000004:00080000:0.0:1746129799.477411:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2433 committed 00000004:00080000:0.0:1746129799.477412:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2432 committed 00000004:00080000:0.0:1746129799.477414:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2431 committed 00000004:00080000:0.0:1746129799.477415:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2462 committed 00000004:00080000:0.0:1746129799.477416:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2430 committed 00000004:00080000:0.0:1746129799.477417:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2461 committed 00000004:00080000:0.0:1746129799.477419:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2429 committed 00000004:00080000:0.0:1746129799.477420:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2460 committed 00000004:00080000:0.0:1746129799.477421:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2459 committed 00000004:00080000:0.0:1746129799.477422:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2458 committed 00000004:00080000:0.0:1746129799.477424:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2428 committed 00000004:00080000:0.0:1746129799.477425:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2427 committed 00000004:00080000:0.0:1746129799.477427:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2457 committed 00000004:00080000:0.0:1746129799.477428:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2456 committed 00000004:00080000:0.0:1746129799.477429:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2426 committed 00000001:00080000:0.0:1746129799.477435:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944548 is committed 00000100:00100000:0.0:1746129799.477535:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053774848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.477567:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477587:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053775360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.477603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477615:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053776000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.477626:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477636:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053776512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.477647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477661:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746129799.477666:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053775232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.477677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477684:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053775872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.477694:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477700:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053776384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.477711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477806:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13898 00000100:00100000:0.0:1746129799.477811:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+71:3299:x1830949053776512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.477832:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13900 00000100:00100000:0.0:1746129799.477836:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+71:3299:x1830949053775872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129799.477918:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4896768 -> 4896768 00002000:00010000:0.0:1746129799.477921:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.477923:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.477925:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129799 -> 1746129799 00002000:00010000:0.0:1746129799.477927:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5545 -> 5545 00000100:00100000:0.0:1746129799.477942:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3299:x1830949053775872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (247us total) trans 21474840966 rc 0/0 00000100:00100000:0.0:1746129799.477951:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13900 00000100:00100000:0.0:1746129799.477965:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477976:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053775104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.477990:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.477999:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053775616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.478011:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.478019:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053776256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.478028:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.478036:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129799.478039:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053776128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.478048:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.478110:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3299:x1830949053776512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 300us (462us total) trans 21474840969 rc 0/0 00000100:00100000:0.0:1746129799.478115:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13898 00000100:00100000:0.0:1746129799.478124:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13903 00000100:00100000:0.0:1746129799.478128:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053775104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.478187:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:3297:x1830949053775104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (196us total) trans 17179873798 rc 0/0 00000100:00100000:0.0:1746129799.478191:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13903 00000100:00100000:0.0:1746129799.478199:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13906 00000100:00100000:0.0:1746129799.478203:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3297:x1830949053776128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.478271:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+75:3297:x1830949053776128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (221us total) trans 21474840971 rc 0/0 00000100:00100000:0.0:1746129799.478275:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13906 00000100:00100000:0.0:1746129799.478291:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.478305:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053775488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.478320:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.478333:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053776768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.478346:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129799.478362:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeea00/2, rc 0, transno 17179873797 00000100:00100000:0.0:1746129799.478366:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053774464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.478378:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053776768 00000100:00100000:0.0:1746129799.478380:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053776768 00000100:00100000:0.0:1746129799.478394:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13909 00000100:00100000:0.0:1746129799.478398:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053776768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.478471:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053776768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (123us total) trans 21474840973 rc 0/0 00000100:00100000:0.0:1746129799.478476:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13909 00000004:00080000:0.0:1746129799.478496:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e5f80/2, rc 0, transno 21474840973 00000100:00100000:0.0:1746129799.478500:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053776768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.478507:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e6d80/2, rc 0, transno 17179873800 00000100:00100000:0.0:1746129799.478509:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053774976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.478528:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6680/2, rc 0, transno 21474840972 00000100:00100000:0.0:1746129799.478531:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053775488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.478546:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7100/2, rc 0, transno 17179873801 00000100:00100000:0.0:1746129799.478548:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053775232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.478554:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d7100/2, rc 0, transno 21474840966 00000100:00100000:0.0:1746129799.478556:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053775872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.478564:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790e00/2, rc 0, transno 21474840967 00000100:00100000:0.0:1746129799.478566:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053776384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.478572:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbef480/2, rc 0, transno 17179873796 00000100:00100000:0.0:1746129799.478574:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053774848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.478580:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7b80/2, rc 0, transno 17179873795 00000100:00100000:0.0:1746129799.478582:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053775360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.478587:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8791c00/2, rc 0, transno 21474840965 00000100:00100000:0.0:1746129799.478590:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053776000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.478594:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8793100/2, rc 0, transno 21474840969 00000100:00100000:0.0:1746129799.478597:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053776512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.480808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.480868:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.482836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.491310:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.496092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.496126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.496609:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053709696 00000100:00100000:0.0:1746129799.496612:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053709696 00010000:00010000:0.0:1746129799.496628:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0046e00/0x48868a4e43950e7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a0c expref: 17 pid: 1140 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746129799.496644:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6829 00000100:00100000:0.0:1746129799.496649:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1961:x1830949053709696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.496656:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.496669:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0046e00/0x48868a4e43950e7a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a0c expref: 17 pid: 1140 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746129799.496903:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0046e00/0x48868a4e43950e7a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a0c expref: 17 pid: 1140 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746129799.496919:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0046e00/0x48868a4e43950e7a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a0c expref: 17 pid: 1140 timeout: 845 lvb_type: 1 00010000:00010000:0.0:1746129799.496931:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.496949:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1961:x1830949053709696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 300us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.496954:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6829 00000100:00100000:0.0:1746129799.497972:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.498627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.500698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.508313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.508668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.512009:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.512025:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.512058:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.524438:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.527009:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.529701:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.533225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.543224:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.550383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.571264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.585656:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053713280 00000100:00100000:0.0:1746129799.585659:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053713280 00002000:00100000:0.0:1746129799.585672:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012b8e5880 x1830949053713280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.585678:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5880 with x1830949053713280 ext(1048576->2097151) 00002000:00010000:0.0:1746129799.585681:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5880 00000100:00100000:0.0:1746129799.586123:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6085 00000100:00100000:0.0:1746129799.586128:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949053713280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.593696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.594390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.611161:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949053713280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25032us (25838us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129799.611167:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6085 00002000:00100000:0.0:1746129799.611172:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012b8e5880 x1830949053713280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/440 e 0 to 0 dl 1746129810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.611178:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5880 with x1830949053713280 ext(1048576->2097151) 00002000:00010000:0.0:1746129799.611180:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5880 00000100:00100000:0.0:1746129799.625905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.625940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.625963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.625997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.626026:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053714304 00000100:00100000:0.0:1746129799.626033:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053714304 00002000:00100000:0.0:1746129799.626070:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3235839) req@ffff88012d634000 x1830949053714304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 504/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.626083:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634000 with x1830949053714304 ext(2097152->3235839) 00002000:00010000:0.0:1746129799.626087:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634000 00000100:00100000:0.0:1746129799.626099:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053714560 00000100:00100000:0.0:1746129799.626101:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053714560 00002000:00100000:0.0:1746129799.626109:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3235840->4194303) req@ffff88012d636680 x1830949053714560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.626114:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636680 with x1830949053714560 ext(3235840->4194303) 00002000:00010000:0.0:1746129799.626116:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636680 00000100:00100000:0.0:1746129799.626123:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053714816 00000100:00100000:0.0:1746129799.626125:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053714816 00002000:00100000:0.0:1746129799.626133:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3039232->4087807) req@ffff88012d635c00 x1830949053714816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.626139:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949053714816 ext(3039232->4087807) 00002000:00010000:0.0:1746129799.626142:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00000100:00100000:0.0:1746129799.626147:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053715072 00000100:00100000:0.0:1746129799.626149:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053715072 00002000:00100000:0.0:1746129799.626156:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (4087808->4194303) req@ffff88012d634a80 x1830949053715072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.626162:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634a80 with x1830949053715072 ext(4087808->4194303) 00002000:00010000:0.0:1746129799.626164:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d634a80 00000100:00100000:0.0:1746129799.626171:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6089 00000100:00100000:0.0:1746129799.626176:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949053714304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.648147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.658153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.728904:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.732946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.733003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.734473:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053778432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129799.752691:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.753977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.754009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.754100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.754125:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6096 00000100:00100000:0.0:1746129799.754132:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949053716864:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.757960:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.765578:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949053716608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11438us (11591us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129799.765593:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6095 00002000:00100000:0.0:1746129799.765611:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009f6a7b80 x1830949053716608/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/440 e 0 to 0 dl 1746129810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.765621:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7b80 with x1830949053716608 ext(1048576->2097151) 00002000:00010000:0.0:1746129799.765630:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7b80 00000100:00100000:0.0:1746129799.778401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.780100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.782298:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949053778944:0@lo:400:kworker.0 00000100:00100000:0.0:1746129799.782322:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.782375:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129799.782380:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053779328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129799.782398:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.782601:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053779328:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1746129799.782692:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129799.782729:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949053778944:0@lo:400:kworker.0 00000100:00100000:0.0:1746129799.792803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.794608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.802122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.812488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.823604:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.823643:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.823672:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.823690:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053719296 00000100:00100000:0.0:1746129799.823696:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053719296 00000100:00100000:0.0:1746129799.823724:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053719424 00000100:00100000:0.0:1746129799.823726:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053719424 00000100:00100000:0.0:1746129799.823737:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13919 00000100:00100000:0.0:1746129799.823741:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949053719296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129799.823752:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.823761:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fada00/0x48868a4e439510bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353b16 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129799.823795:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801348f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053779840:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129799.823835:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129799.823983:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.826807:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.826997:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.827025:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.834288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.835666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.835679:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053720576 00000100:00100000:0.0:1746129799.835682:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053720576 00002000:00100000:0.0:1746129799.835702:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1966079) req@ffff8801348f4000 x1830949053720576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.835708:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801348f4000 with x1830949053720576 ext(1048576->1966079) 00002000:00010000:0.0:1746129799.835712:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801348f4000 00000100:00100000:0.0:1746129799.835726:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6099 00000100:00100000:0.0:1746129799.835729:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949053720576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.841447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.841703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.843878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.844137:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053721216 00000100:00100000:0.0:1746129799.844141:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053721216 00000100:00100000:0.0:1746129799.844160:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13923 00000100:00100000:0.0:1746129799.844165:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:30865:x1830949053721216:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129799.844173:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.844182:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fad000/0x48868a4e439510db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353b32 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.844196:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129799.844200:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e439510d4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b2b expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.844205:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129799.844208:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fad000/0x48868a4e439510db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2555904->3137535] (req 2555904->3137535) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b32 expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.844231:0:7976:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e439510d4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b2b expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.844241:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fad000/0x48868a4e439510db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2555904->3137535] (req 2555904->3137535) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b32 expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.844248:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fad000, rc 0) 00000100:00100000:0.0:1746129799.844263:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:30865:x1830949053721216:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 97us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.844268:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13923 00000100:00100000:0.0:1746129799.845799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.845829:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.845904:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13924 00000100:00100000:0.0:1746129799.845909:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:30870:x1830949053721344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129799.845916:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.845923:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353b39 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.845935:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff34600/0x48868a4e439510cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b24 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.845939:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129799.845940:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129799.845942:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.845955:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff34600/0x48868a4e439510cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b24 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.845961:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff34600/0x48868a4e439510cd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b24 expref: 37 pid: 8437 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.845966:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801348f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053781376:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129799.845987:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129799.851842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.852834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.852871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.852908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.852957:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053722496 00000100:00100000:0.0:1746129799.852960:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053722496 00002000:00100000:0.0:1746129799.852976:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8801348f4700 x1830949053722496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.852984:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801348f4700 with x1830949053722496 ext(3145728->4194303) 00002000:00010000:0.0:1746129799.852987:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801348f4700 00000100:00100000:0.0:1746129799.853012:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6100 00000100:00100000:0.0:1746129799.853018:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949053722496:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129799.864782:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.870317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.870358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.870398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.874471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.877792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.877828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.877913:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053724032 00000100:00100000:0.0:1746129799.877919:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053724032 00002000:00100000:0.0:1746129799.877946:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009adac000 x1830949053724032/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.877955:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac000 with x1830949053724032 ext(3145728->4194303) 00002000:00010000:0.0:1746129799.877960:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac000 00000100:00100000:0.0:1746129799.877990:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6103 00000100:00100000:0.0:1746129799.877996:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949053724032:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129799.884020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.884056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.884087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.885329:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949053724032:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7332us (7499us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129799.885335:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6103 00002000:00100000:0.0:1746129799.885340:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009adac000 x1830949053724032/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/440 e 0 to 0 dl 1746129810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.885346:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac000 with x1830949053724032 ext(3145728->4194303) 00002000:00010000:0.0:1746129799.885349:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac000 00000100:00100000:0.0:1746129799.887712:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.887753:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.887777:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.887871:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.890197:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.890212:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053725440 00000100:00100000:0.0:1746129799.890215:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053725440 00000100:00100000:0.0:1746129799.890240:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13928 00000100:00100000:0.0:1746129799.890245:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949053725440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129799.890253:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.890261:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a203c00/0x48868a4e4395111a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353b5c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129799.890293:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053782144:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129799.890336:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129799.891444:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.891485:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.893631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:0.0:1746129799.894138:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129799 -> 1746129800 00002000:00010000:0.0:1746129799.894141:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129799 -> 1746129800 00002000:00010000:0.0:1746129799.894143:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129799 -> 1746129800 00000100:00100000:0.0:1746129799.894156:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053782144:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129799.894178:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a203c00/0x48868a4e4395111a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b5c expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.894188:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a203c00/0x48868a4e4395111a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b5c expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.894213:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a203c00, rc 0) 00000100:00100000:0.0:1746129799.894238:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949053725440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3993us (4042us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129799.894244:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13928 00000100:00100000:0.0:1746129799.894884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.897055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.897831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.897878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.897906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.897920:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053726336 00000100:00100000:0.0:1746129799.897922:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053726336 00002000:00100000:0.0:1746129799.897938:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88009ff38700 x1830949053726336/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.897946:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff38700 with x1830949053726336 ext(4194304->4898815) 00002000:00010000:0.0:1746129799.897950:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff38700 00000100:00100000:0.0:1746129799.897960:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6106 00000100:00100000:0.0:1746129799.897964:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949053726336:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.902749:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.904672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.905662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.907371:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.908326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.911271:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053782656:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129799.911286:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129799.911304:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053727872 00000100:00100000:0.0:1746129799.911307:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053727872 00010000:00010000:0.0:1746129799.911322:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff34c00/0x48868a4e43951152 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b8d expref: 10 pid: 14315 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.911805:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6850 00000100:00100000:0.0:1746129799.911811:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053727872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.911819:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.911824:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff34c00/0x48868a4e43951152 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b8d expref: 10 pid: 14315 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.911833:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff34c00/0x48868a4e43951152 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b8d expref: 10 pid: 14315 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.911862:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff34c00/0x48868a4e43951152 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b8d expref: 10 pid: 14315 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.911876:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.911880:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.911889:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.911895:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.911907:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.911926:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053727872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 115us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.911931:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6850 00010000:00010000:0.0:1746129799.911946:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.911954:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129799.911985:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00000004:00200000:0.0:1746129799.911989:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129799.912001:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.912024:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f000/0x48868a4e43951167 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b9b expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.912035:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6e600/0x48868a4e4395116e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b9b expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.912041:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.912043:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129799.912045:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6e600, rc 0) 00000100:00100000:0.0:1746129799.912547:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:30872:x1830949053727488:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4128us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.912553:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10640 00000100:00100000:0.0:1746129799.914685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.914716:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.914731:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.914795:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.917759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.918346:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053728768 00000100:00100000:0.0:1746129799.918349:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053728768 00000100:00100000:0.0:1746129799.918374:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10641 00000100:00100000:0.0:1746129799.918380:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:30872:x1830949053728768:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.918394:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.918405:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a202200/0x48868a4e4395119f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353bcc expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.918491:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a202000/0x48868a4e439511a6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.918502:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a202000/0x48868a4e439511a6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129799.918522:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a202000/0x48868a4e439511a6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129799.918533:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:0.0:1746129799.918623:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a202200/0x48868a4e4395119f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bcc expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.918633:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a202000/0x48868a4e439511a6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bcc expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.918640:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.918642:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129799.918644:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a202000, rc 0) 00000100:00100000:0.0:1746129799.918678:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:30872:x1830949053728768:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 297us (450us total) trans 8589944567 rc 0/0 00000100:00100000:0.0:1746129799.918683:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10641 00000100:00100000:0.0:1746129799.919385:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924719:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.924765:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.925060:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053729408 00000100:00100000:0.0:1746129799.925062:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053729408 00000100:00100000:0.0:1746129799.925084:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13943 00000100:00100000:0.0:1746129799.925089:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1962:x1830949053729536:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129799.925108:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a202a00/0x48868a4e439511bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925121:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925128:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135d5ca00/0x48868a4e43951136 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b78 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.925134:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130527e00/0x48868a4e43951128 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b63 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.925139:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.925141:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.925143:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a202a00/0x48868a4e439511bb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925164:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130527e00/0x48868a4e43951128 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b63 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.925176:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130527e00/0x48868a4e43951128 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b63 expref: 24 pid: 8436 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746129799.925185:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01bbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053783552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129799.925234:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13946 00000100:00100000:0.0:1746129799.925239:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949053729408:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129799.925252:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925261:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e439510c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b1d expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925266:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129799.925267:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129799.925269:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925281:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e439510c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b1d expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925288:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6ec00/0x48868a4e439510c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1966080->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b1d expref: 32 pid: 8437 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.925295:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01bb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053784192:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129799.925308:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19426c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746129799.925324:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135d5ca00/0x48868a4e43951136 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b78 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.925331:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135d5ca00/0x48868a4e43951136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b78 expref: 19 pid: 7976 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746129799.925337:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053784448:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129799.925356:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925362:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 38 pid: 7976 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.925368:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053784576:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129799.925378:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129799.925570:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.925584:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053730304 00000100:00100000:0.0:1746129799.925587:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053730304 00002000:00100000:0.0:1746129799.925601:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009468f800 x1830949053730304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/0 e 0 to 0 dl 1746129810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.925608:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468f800 with x1830949053730304 ext(3145728->4194303) 00010000:00010000:0.0:1746129799.925613:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e35e800/0x48868a4e43951159 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b94 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.925621:0:8442:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff88012e35e800/0x48868a4e43951159 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b94 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129799.925631:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009468f800 00000100:00100000:0.0:1746129799.925642:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1680 00000100:00100000:0.0:1746129799.925647:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949053730304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129799.930930:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.940795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.940814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.940833:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053730944 00000100:00100000:0.0:1746129799.940837:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053730944 00010000:00010000:0.0:1746129799.940886:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0047a00/0x48868a4e43950f68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a52 expref: 36 pid: 3624 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.940907:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053731200 00000100:00100000:0.0:1746129799.940909:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053731200 00010000:00010000:0.0:1746129799.940919:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135d5ca00/0x48868a4e43951136 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b78 expref: 20 pid: 7976 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746129799.940934:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6852 00000100:00100000:0.0:1746129799.940945:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949053730944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.940956:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.940974:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0047a00/0x48868a4e43950f68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a52 expref: 36 pid: 3624 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.940982:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0047a00/0x48868a4e43950f68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a52 expref: 36 pid: 3624 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941006:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0047a00/0x48868a4e43950f68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a52 expref: 36 pid: 3624 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941030:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.941064:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949053730944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.941070:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6852 00000100:00100000:0.0:1746129799.941154:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.941182:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.941228:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.941257:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6855 00000100:00100000:0.0:1746129799.941263:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1964:x1830949053731584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.941270:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.941279:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 41 pid: 7976 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941287:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 41 pid: 7976 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941313:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fad800/0x48868a4e439510e2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b39 expref: 41 pid: 7976 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941321:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.941323:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.941326:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a202a00/0x48868a4e439511bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.941334:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a202a00/0x48868a4e439511bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.941358:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.941375:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949053731584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.941381:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6855 00000100:00100000:0.0:1746129799.941580:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053731328 00000100:00100000:0.0:1746129799.941584:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053731328 00010000:00010000:0.0:1746129799.941595:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f999600/0x48868a4e43950f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a60 expref: 31 pid: 7975 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.941609:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053731456 00000100:00100000:0.0:1746129799.941611:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053731456 00010000:00010000:0.0:1746129799.941620:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0046c00/0x48868a4e43950e6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3539f0 expref: 18 pid: 1140 timeout: 845 lvb_type: 1 00000100:00100000:0.0:1746129799.941630:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6857 00000100:00100000:0.0:1746129799.941635:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949053731328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.941640:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.941648:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f999600/0x48868a4e43950f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a60 expref: 31 pid: 7975 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941656:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f999600/0x48868a4e43950f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a60 expref: 31 pid: 7975 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941670:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f999600/0x48868a4e43950f76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353a60 expref: 31 pid: 7975 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.941683:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.941699:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949053731328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 64us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.941704:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6857 00000100:00100000:0.0:1746129799.942120:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.942161:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.942471:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949053730176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17506us (17704us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129799.942477:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6107 00002000:00100000:0.0:1746129799.942483:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a01b8a80 x1830949053730176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:540/0 lens 488/440 e 0 to 0 dl 1746129810 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129799.942490:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8a80 with x1830949053730176 ext(2097152->3145727) 00010000:00010000:0.0:1746129799.942495:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e35e800/0x48868a4e43951159 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b94 expref: 34 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942519:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e35e800/0x48868a4e43951159 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b94 expref: 34 pid: 8437 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746129799.942524:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01b8a80 00000100:00100000:0.0:1746129799.942550:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.942562:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053732096 00000100:00100000:0.0:1746129799.942564:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053732096 00010000:00010000:0.0:1746129799.942574:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dabec00/0x48868a4e439510e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b40 expref: 30 pid: 7976 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.942601:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6862 00000100:00100000:0.0:1746129799.942606:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949053732096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.942612:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.942620:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012dabec00/0x48868a4e439510e9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b40 expref: 30 pid: 7976 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942628:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dabec00/0x48868a4e439510e9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b40 expref: 30 pid: 7976 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942638:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dabec00/0x48868a4e439510e9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b40 expref: 30 pid: 7976 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942647:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.942662:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949053732096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.942668:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6862 00000100:00100000:0.0:1746129799.942676:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053732224 00000100:00100000:0.0:1746129799.942678:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053732224 00010000:00010000:0.0:1746129799.942685:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e439510b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b0f expref: 23 pid: 8437 timeout: 845 lvb_type: 0 00000100:00100000:0.0:1746129799.942706:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6863 00000100:00100000:0.0:1746129799.942711:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949053732224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.942719:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.942726:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e439510b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b0f expref: 23 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942733:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e439510b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b0f expref: 23 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942742:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e439510b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353b0f expref: 23 pid: 8437 timeout: 845 lvb_type: 0 00010000:00010000:0.0:1746129799.942750:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.942763:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949053732224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.942768:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6863 00000100:00100000:0.0:1746129799.945921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.947626:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.947687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129799.948053:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948061:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948075:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948081:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948087:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948095:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a203200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129799.948098:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948102:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948112:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.948117:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a203200/0x48868a4e439511d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129799.948155:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949053729408:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 22915us (23424us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.948161:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13946 00000100:00100000:0.0:1746129799.948724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.951036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.951399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.957417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.957454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.957480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.957497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.957558:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053733888 00000100:00100000:0.0:1746129799.957564:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053733888 00010000:00010000:0.0:1746129799.957587:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f998600/0x48868a4e43950fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aa6 expref: 15 pid: 14315 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129799.957606:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6871 00000100:00100000:0.0:1746129799.957613:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949053733888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129799.957624:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129799.957629:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f998600/0x48868a4e43950fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aa6 expref: 15 pid: 14315 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129799.957656:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f998600/0x48868a4e43950fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aa6 expref: 15 pid: 14315 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129799.957679:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f998600/0x48868a4e43950fc3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353aa6 expref: 15 pid: 14315 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129799.957691:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.957694:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b87e00/0x48868a4e439511e5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129799.957701:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129799.957728:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949053733888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 116us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.957734:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6871 00000100:00100000:0.0:1746129799.963315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.968128:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053734144 00000100:00100000:0.0:1746129799.968137:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053734144 00000100:00100000:0.0:1746129799.968180:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10643 00000100:00100000:0.0:1746129799.968189:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:30870:x1830949053734144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129799.968211:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.968228:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35200/0x48868a4e439511f3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353be1 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.968288:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b87e00/0x48868a4e439511e5 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129799.968297:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35200/0x48868a4e439511f3 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353be1 expref: 288 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.968315:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880136b87e00/0x48868a4e439511e5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129799.968326:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35200/0x48868a4e439511f3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353be1 expref: 288 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.968338:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129799.968341:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129799.968344:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35200/0x48868a4e439511f3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353be1 expref: 288 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.968349:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff35200, rc 0) 00000100:00100000:0.0:1746129799.968400:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:30870:x1830949053734144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 212us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.968406:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10643 00000100:00100000:0.0:1746129799.983384:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053785984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.984977:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.985007:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053786624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.985030:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.985051:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053787136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.985072:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.985082:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053787648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.985101:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.985113:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053788160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.985133:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129799.985163:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053788160 00000100:00100000:0.0:1746129799.985166:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053788160 00000100:00100000:0.0:1746129799.985183:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13958 00000100:00100000:0.0:1746129799.985188:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3299:x1830949053785984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.985306:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949053785984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (327us total) trans 17179873810 rc 0/0 00000100:00100000:0.0:1746129799.985318:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13958 00000100:00100000:0.0:1746129799.985525:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13961 00000100:00100000:0.0:1746129799.985531:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3299:x1830949053787648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129799.985702:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3299:x1830949053787648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (605us total) trans 21474840983 rc 0/0 00000100:00100000:0.0:1746129799.985707:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13961 00000004:00080000:0.0:1746129799.985735:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319180/2, rc 0, transno 21474840981 00000100:00100000:0.0:1746129799.985739:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053787136:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.985745:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631bb80/2, rc 0, transno 21474840983 00000100:00100000:0.0:1746129799.985747:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053787648:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.985755:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5491c00/2, rc 0, transno 21474840982 00000100:00100000:0.0:1746129799.985757:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053788160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129799.985764:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be66680/2, rc 0, transno 17179873810 00000100:00100000:0.0:1746129799.985767:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053785984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129799.985774:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64000/2, rc 0, transno 17179873811 00000100:00100000:0.0:1746129799.986416:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053786624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129799.987686:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053734400 00000100:00100000:0.0:1746129799.987690:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053734400 00000100:00100000:0.0:1746129799.987714:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4360 00000100:00100000:0.0:1746129799.987719:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:30870:x1830949053734400:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129799.987793:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:30870:x1830949053734400:12345-192.168.204.31@tcp:49:cat.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.987798:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4360 00000100:00100000:0.0:1746129799.990538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129799.995763:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053734912 00000100:00100000:0.0:1746129799.995766:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053734912 00000100:00100000:0.0:1746129799.995844:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053735296 00000100:00100000:0.0:1746129799.995865:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053735296 00000100:00100000:0.0:1746129799.995882:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13967 00000100:00100000:0.0:1746129799.995888:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949053734656:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.995902:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.995917:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a203000/0x48868a4e4395120f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353bf6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129799.995937:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d387, atime: 0x6813d387, ctime: 0x6813d387, blocks: 0x7df 00010000:00010000:0.0:1746129799.995951:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.995953:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.995961:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a203000/0x48868a4e4395120f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bf6 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.995974:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a203000/0x48868a4e4395120f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bf6 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.995982:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a203000, rc 0) 00000100:00100000:0.0:1746129799.996020:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949053734656:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 132us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.996026:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13967 00000100:00100000:0.0:1746129799.996040:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13968 00000100:00100000:0.0:1746129799.996044:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949053734784:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.996050:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.996059:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a203c00/0x48868a4e43951216 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353bfd expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129799.996071:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d387, atime: 0x6813d387, ctime: 0x6813d387, blocks: 0x81f 00010000:00010000:0.0:1746129799.996078:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996079:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996083:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a203c00/0x48868a4e43951216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bfd expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996092:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a203c00/0x48868a4e43951216 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bfd expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996098:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a203c00, rc 0) 00000100:00100000:0.0:1746129799.996112:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949053734784:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 68us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.996118:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13968 00000100:00100000:0.0:1746129799.996186:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13969 00000100:00100000:0.0:1746129799.996191:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949053734912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.996197:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.996204:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a202200/0x48868a4e4395121d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353c04 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129799.996213:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d388, atime: 0x6813d388, ctime: 0x6813d388, blocks: 0x821 00010000:00010000:0.0:1746129799.996220:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996221:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996225:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a202200/0x48868a4e4395121d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c04 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996233:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a202200/0x48868a4e4395121d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c04 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996239:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a202200, rc 0) 00000100:00100000:0.0:1746129799.996251:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949053734912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 61us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.996256:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13969 00000100:00100000:0.0:1746129799.996266:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13970 00000100:00100000:0.0:1746129799.996269:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949053735040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.996274:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.996280:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353c0b expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129799.996294:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d388, atime: 0x6813d387, ctime: 0x6813d388, blocks: 0x81f 00010000:00010000:0.0:1746129799.996300:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996301:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996304:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996312:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996318:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a203400, rc 0) 00000100:00100000:0.0:1746129799.996331:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949053735040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 62us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.996335:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13970 00000100:00100000:0.0:1746129799.996343:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13971 00000100:00100000:0.0:1746129799.996347:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949053735168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.996351:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.996356:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a203e00/0x48868a4e4395122b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353c12 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.996364:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996365:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996368:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a203e00/0x48868a4e4395122b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c12 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996375:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a203e00/0x48868a4e4395122b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c12 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996386:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a203e00, rc 0) 00000100:00100000:0.0:1746129799.996396:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949053735168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 49us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.996399:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13971 00000100:00100000:0.0:1746129799.996408:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13972 00000100:00100000:0.0:1746129799.996411:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949053735296:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129799.996416:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129799.996421:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a202800/0x48868a4e43951232 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353c19 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129799.996430:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996431:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129799.996435:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a202800/0x48868a4e43951232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c19 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996442:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a202800/0x48868a4e43951232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c19 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129799.996447:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a202800, rc 0) 00000100:00100000:0.0:1746129799.996459:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949053735296:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 47us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129799.996464:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13972 00000100:00100000:0.0:1746129799.996536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.006303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129800.006498:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129800.012746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.012789:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.012820:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.012928:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.013192:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129800.013243:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129800.013246:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129800.014384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.015436:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053737088 00000100:00100000:0.0:1746129800.015440:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053737088 00000100:00100000:0.0:1746129800.015526:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6112 00000100:00100000:0.0:1746129800.015534:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1961:x1830949053736320:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129800.015559:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.015568:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.015570:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.015573:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.015582:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.027343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129800.032389:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.032399:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.032410:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.032416:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a202e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129800.032419:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.032424:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.032437:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.032443:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a202e00/0x48868a4e43951263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.032495:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+21:1961:x1830949053736320:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 16960us (18110us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129800.032502:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6112 00000100:00100000:0.0:1746129800.050030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.051007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129800.051527:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129800.056932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.057557:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053739776 00000100:00100000:0.0:1746129800.057568:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053739776 00000100:00100000:0.0:1746129800.057605:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 13978 00000100:00100000:0.0:1746129800.057613:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+18:1962:x1830949053739520:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129800.057776:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129800.057780:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129799 -> 1746129800 00002000:00010000:0.0:1746129800.057782:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129799 -> 1746129800 00002000:00010000:0.0:1746129800.057784:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129799 -> 1746129800 00002000:00010000:0.0:1746129800.057786:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129800.058424:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1962:x1830949053739520:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 812us (1133us total) trans 17179873814 rc 0/0 00000100:00100000:0.0:1746129800.058431:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 13978 00000100:00100000:0.0:1746129800.063486:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.068145:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.076623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.100769:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.106613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.109781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.138233:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053788544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.138304:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138340:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.138356:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138378:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.138393:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138403:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053790080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.138414:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138426:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129800.138431:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053788672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.138449:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138460:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.138473:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138902:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.138951:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.138961:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053790208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.138976:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129800.139000:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c041c00/2, rc 0, transno 17179873817 00000100:00100000:0.0:1746129800.139004:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129800.139012:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043100/2, rc 0, transno 21474840989 00000100:00100000:0.0:1746129800.139019:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.139026:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043b80/2, rc 0, transno 17179873819 00000100:00100000:0.0:1746129800.139028:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053788672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.139048:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053789696 00000100:00100000:0.0:1746129800.139051:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053789696 00000100:00100000:0.0:1746129800.139642:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13991 00000100:00100000:0.0:1746129800.139648:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3298:x1830949053789824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129800.139735:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4896768 -> 4896768 00002000:00010000:0.0:1746129800.139737:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.139739:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.139741:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.139743:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5545 -> 5545 00000100:00100000:0.0:1746129800.139762:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3298:x1830949053789824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (1173us total) trans 21474840990 rc 0/0 00000100:00100000:0.0:1746129800.139766:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13991 00000100:00100000:0.0:1746129800.139777:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746129800.139782:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3298:x1830949053789440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.139874:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3298:x1830949053789440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (1205us total) trans 17179873823 rc 0/0 00000100:00100000:0.0:1746129800.139879:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13994 00000100:00100000:0.0:1746129800.139890:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13997 00000100:00100000:0.0:1746129800.139894:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3296:x1830949053789696:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.139940:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040a80/2, rc 0, transno 17179873820 00000100:00100000:0.0:1746129800.139943:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789184:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129800.139988:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129800.139990:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.139992:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.139993:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.139995:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129800.140013:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3296:x1830949053789696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (1062us total) trans 21474840994 rc 0/0 00000100:00100000:0.0:1746129800.140018:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13997 00000100:00100000:0.0:1746129800.140030:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129800.140036:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053790592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.140055:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129800.140075:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c041180/2, rc 0, transno 21474840994 00000100:00100000:0.0:1746129800.140079:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053789696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.140084:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c042a00/2, rc 0, transno 21474840995 00000100:00100000:0.0:1746129800.140086:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053790080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.140466:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf5500/2, rc 0, transno 21474840996 00000100:00100000:0.0:1746129800.140471:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053790592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.140483:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf4e00/2, rc 0, transno 21474840997 00000100:00100000:0.0:1746129800.140485:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053790208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.140491:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040700/2, rc 0, transno 17179873818 00000100:00100000:0.0:1746129800.140494:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053788544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.145703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.148720:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053741696 00000100:00100000:0.0:1746129800.148729:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053741696 00000100:00100000:0.0:1746129800.148778:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14000 00000100:00100000:0.0:1746129800.148785:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:30879:x1830949053741696:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129800.148798:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.148814:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353c58 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.148839:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 19 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.148877:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.148885:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.148887:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.148890:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1200128->1658879] (req 1200128->1658879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c58 expref: 40 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.149387:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.149408:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 40 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.149420:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053790720:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.149835:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 19 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.149844:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 19 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.149982:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053790848:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.150154:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.153323:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053741952 00000100:00100000:0.0:1746129800.153326:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053741952 00010000:00010000:0.0:1746129800.153344:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 41 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.153382:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6874 00000100:00100000:0.0:1746129800.153385:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949053741952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.153393:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.153415:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 41 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.153424:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 41 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.153438:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013558d200/0x48868a4e4395125c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c35 expref: 41 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.153449:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.154523:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949053741952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1132us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.154533:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6874 00000100:00080000:0.0:1746129800.154586:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129800.154590:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129800.154883:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053742720 00000100:00100000:0.0:1746129800.154890:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053742720 00010000:00010000:0.0:1746129800.154904:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 20 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.154919:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6875 00000100:00100000:0.0:1746129800.154925:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+20:1961:x1830949053742720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.154932:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.154945:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 20 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.154953:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 20 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.154968:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a203400/0x48868a4e43951224 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c0b expref: 20 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.154984:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.154985:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.154991:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c58 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.154999:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1658879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c58 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.155026:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1658879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c58 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.155162:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053790976:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129800.155616:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.160312:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053790976:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129800.160336:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.160681:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1961:x1830949053742720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5754us (5996us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.160692:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6875 00000100:00100000:0.0:1746129800.162694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.162732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.162770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.163378:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6122 00000100:00100000:0.0:1746129800.163386:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1961:x1830949053743488:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129800.166302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.166658:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6123 00000100:00100000:0.0:1746129800.166668:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949053744000:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129800.166806:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949053744000:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 139us (516us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129800.166813:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6123 00002000:00100000:0.0:1746129800.166819:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1654784->1658879) req@ffff880136319c00 x1830949053744000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:541/0 lens 488/4536 e 0 to 0 dl 1746129811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.166827:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319c00 with x1830949053744000 ext(1654784->1658879) 00002000:00010000:0.0:1746129800.166830:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136319c00 00000100:00100000:0.0:1746129800.183140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.191662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.196023:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.198921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.198961:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.199230:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6878 00000100:00100000:0.0:1746129800.199242:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1962:x1830949053744512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.199258:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.199281:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a203000/0x48868a4e4395120f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bf6 expref: 19 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.199295:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a203000/0x48868a4e4395120f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bf6 expref: 19 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.199316:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a203000/0x48868a4e4395120f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bf6 expref: 19 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.199338:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.199340:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.199345:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fada00/0x48868a4e4395133c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c89 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.199353:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fada00/0x48868a4e4395133c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c89 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.199382:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094fada00/0x48868a4e4395133c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c89 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.199393:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053791488:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129800.199456:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.206947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.207911:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.214967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.215628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.218845:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.221324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.225004:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949053745280:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8603us (9370us total) trans 21474840998 rc 0/0 00000100:00100000:0.0:1746129800.225015:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1683 00002000:00100000:0.0:1746129800.225025:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1200128->1658879) req@ffff8800a01b8380 x1830949053745280/t21474840998(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:541/0 lens 488/448 e 0 to 0 dl 1746129811 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.225035:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8380 with x1830949053745280 ext(1200128->1658879) 00010000:00010000:0.0:1746129800.225046:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c58 expref: 40 pid: 7975 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.225061:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e4395130b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1200128->1658879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c58 expref: 40 pid: 7975 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746129800.225067:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b8380 00000100:00100000:0.0:1746129800.227590:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.232387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.233157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.236002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.260532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.260571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.260596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.260628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.260663:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053747200 00000100:00100000:0.0:1746129800.260666:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053747200 00002000:00100000:0.0:1746129800.260683:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a01bb100 x1830949053747200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.260690:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb100 with x1830949053747200 ext(3145728->4194303) 00002000:00010000:0.0:1746129800.260693:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bb100 00000100:00100000:0.0:1746129800.260710:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053747712 00000100:00100000:0.0:1746129800.260712:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053747712 00002000:00100000:0.0:1746129800.260721:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a01b9f80 x1830949053747712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.260726:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9f80 with x1830949053747712 ext(3145728->4194303) 00002000:00010000:0.0:1746129800.260728:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b9f80 00000100:00100000:0.0:1746129800.261024:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6127 00000100:00100000:0.0:1746129800.261031:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949053746944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129800.292357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.297078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.297113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.297139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.297172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.297198:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053748096 00000100:00100000:0.0:1746129800.297202:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053748096 00000100:00100000:0.0:1746129800.297219:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053748224 00000100:00100000:0.0:1746129800.297221:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053748224 00000100:00100000:0.0:1746129800.297234:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14010 00000100:00100000:0.0:1746129800.297239:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949053748096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129800.297246:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.297255:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f94ac00/0x48868a4e4395137b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353ca5 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.297296:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053792512:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129800.297358:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.302425:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053792512:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129800.302442:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f94ac00/0x48868a4e4395137b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ca5 expref: 41 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.302456:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f94ac00/0x48868a4e4395137b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ca5 expref: 41 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.302482:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f94ac00, rc 0) 00000100:00100000:0.0:1746129800.302515:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949053748096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5262us (5387us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129800.302520:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14010 00000100:00100000:0.0:1746129800.302561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.302577:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053748864 00000100:00100000:0.0:1746129800.302580:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053748864 00000100:00100000:0.0:1746129800.302656:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14013 00000100:00100000:0.0:1746129800.302662:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+18:1962:x1830949053748864:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129800.302670:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.302680:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f94a000/0x48868a4e439513a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353cc1 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.302716:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053792640:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129800.302766:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.306160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.310946:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053749376 00000100:00100000:0.0:1746129800.310951:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053749376 00002000:00100000:0.0:1746129800.310980:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ed:0x0] (888832->1048575) req@ffff88009faf4380 x1830949053749376/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.310987:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf4380 with x1830949053749376 ext(888832->1048575) 00010000:00010000:0.0:1746129800.310992:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094fada00/0x48868a4e4395133c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c89 expref: 25 pid: 7975 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.311003:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094fada00/0x48868a4e4395133c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 888832->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c89 expref: 25 pid: 7975 timeout: 846 lvb_type: 0 00002000:00010000:0.0:1746129800.311009:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009faf4380 00000100:00100000:0.0:1746129800.311022:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1684 00000100:00100000:0.0:1746129800.311034:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949053749376:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129800.316787:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.320731:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.321121:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.321637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.321692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.322476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.325294:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.325810:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.330911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.332494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.334412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.334447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.334475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.334490:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053751552 00000100:00100000:0.0:1746129800.334494:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053751552 00000100:00100000:0.0:1746129800.334541:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053751680 00000100:00100000:0.0:1746129800.334544:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053751680 00000100:00100000:0.0:1746129800.334555:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053751808 00000100:00100000:0.0:1746129800.334557:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053751808 00000100:00100000:0.0:1746129800.334568:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14019 00000100:00100000:0.0:1746129800.334573:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1961:x1830949053751552:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129800.334601:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a061200/0x48868a4e43951407 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.334615:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa36400/0x48868a4e439513ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cd6 expref: 40 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.334623:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f89d800/0x48868a4e439513e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cf9 expref: 26 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.334628:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.334630:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.334633:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a061200/0x48868a4e43951407 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.334656:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f89d800/0x48868a4e439513e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cf9 expref: 26 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.334666:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f89d800/0x48868a4e439513e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cf9 expref: 26 pid: 3623 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.334677:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053793664:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.334738:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa36400/0x48868a4e439513ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cd6 expref: 40 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.334745:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa36400/0x48868a4e439513ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cd6 expref: 40 pid: 3623 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.334819:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053794048:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.334835:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a260c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.334967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.335106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.335250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.339541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.340557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.340571:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053752960 00000100:00100000:0.0:1746129800.340574:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053752960 00010000:00010000:0.0:1746129800.340588:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013558d800/0x48868a4e4395124e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c2e expref: 33 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.340610:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6888 00000100:00100000:0.0:1746129800.340616:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949053752960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.340624:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.340639:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013558d800/0x48868a4e4395124e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c2e expref: 33 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.340649:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013558d800/0x48868a4e4395124e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c2e expref: 33 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.340663:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013558d800/0x48868a4e4395124e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353c2e expref: 33 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.340679:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.340695:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949053752960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.340701:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6888 00000100:00100000:0.0:1746129800.340744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.340774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.340783:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053752576 00000100:00100000:0.0:1746129800.340786:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053752576 00010000:00010000:0.0:1746129800.340796:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395139e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cb3 expref: 41 pid: 1140 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.341149:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6891 00000100:00100000:0.0:1746129800.341156:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949053752576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.341163:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.341173:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395139e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cb3 expref: 41 pid: 1140 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.341182:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395139e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cb3 expref: 41 pid: 1140 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.341194:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395139e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353cb3 expref: 41 pid: 1140 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.341202:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.341218:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949053752576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.341223:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6891 00000100:00100000:0.0:1746129800.343184:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053795200:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.343192:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053795328:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.343198:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053795456:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.343211:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.343347:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053753344 00000100:00100000:0.0:1746129800.343351:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053753344 00010000:00010000:0.0:1746129800.343368:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e439511de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bd3 expref: 40 pid: 20441 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.343414:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6893 00000100:00100000:0.0:1746129800.343418:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949053753344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.343425:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.343439:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e439511de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bd3 expref: 40 pid: 20441 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.343448:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e439511de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bd3 expref: 40 pid: 20441 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.343462:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e439511de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353bd3 expref: 40 pid: 20441 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.343473:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.343496:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949053753344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.343514:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6893 00000100:00100000:0.0:1746129800.343571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.344793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.348099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.348216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129800.348931:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.348937:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.348951:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.348956:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.348961:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.349074:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009183e800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129800.349077:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.349084:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.349093:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.349098:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009183e800/0x48868a4e4395142a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.349197:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+18:1961:x1830949053752192:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 13329us (13945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.349204:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14024 00000100:00100000:0.0:1746129800.353898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129800.354561:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354568:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354585:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354592:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354597:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354603:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa36c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129800.354605:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354612:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa36c00/0x48868a4e4395140e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354624:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.354625:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.354631:0:10930:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354637:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.354660:0:10930:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.354670:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053795584:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129800.354724:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.357835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.373526:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.376125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00010000:0.0:1746129800.385176:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009468df80 reply state ffff88009295cc00 transno 8589944584 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa37200/0x48868a4e43951438 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129800.385188:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746129800.385269:0:1851:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746129800.385281:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:30889:x1830949053754880:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 23438us (23655us total) trans 8589944584 rc 0/0 00000100:00100000:0.0:1746129800.385289:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10657 00000100:00100000:0.0:1746129800.385359:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053795968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385395:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.385418:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053796480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385431:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.385452:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385468:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.385479:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385490:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.385513:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129800.385517:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385530:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.385539:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385551:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.385569:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14028 00000100:00100000:0.0:1746129800.385574:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+102:3297:x1830949053796480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385605:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14029 00000100:00100000:0.0:1746129800.385610:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+102:3296:x1830949053796352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385717:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+104:3297:x1830949053796480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (284us total) trans 21474841002 rc 0/0 00000100:00100000:0.0:1746129800.385722:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14028 00000100:00100000:0.0:1746129800.385732:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14031 00000100:00100000:0.0:1746129800.385735:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+103:3299:x1830949053796224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385769:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+103:3296:x1830949053796352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (326us total) trans 21474841001 rc 0/0 00000100:00100000:0.0:1746129800.385774:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14029 00000100:00100000:0.0:1746129800.385783:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14033 00000100:00100000:0.0:1746129800.385787:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+102:3299:x1830949053796096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.385886:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+103:3299:x1830949053796096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (354us total) trans 21474841005 rc 0/0 00000100:00100000:0.0:1746129800.385890:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14033 00000004:00080000:0.0:1746129800.385926:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468d880/2, rc 0, transno 21474841000 00000100:00100000:0.0:1746129800.385930:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053795968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.385936:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468f480/2, rc 0, transno 21474841002 00000100:00100000:0.0:1746129800.385939:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053796480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.385949:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468c700/2, rc 0, transno 21474841005 00000100:00100000:0.0:1746129800.385952:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.385957:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468e680/2, rc 0, transno 21474841004 00000100:00100000:0.0:1746129800.385959:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.386058:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+104:3299:x1830949053796224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (589us total) trans 21474841007 rc 0/0 00000100:00100000:0.0:1746129800.386063:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14031 00000004:00080000:0.0:1746129800.386078:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468c380/2, rc 0, transno 21474841007 00000100:00100000:0.0:1746129800.386081:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.386138:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468d180/2, rc 0, transno 21474841008 00000100:00100000:0.0:1746129800.386141:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053796608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.386377:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386393:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386402:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129800.386406:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386420:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386429:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386440:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386449:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129800.386453:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386464:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386477:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053797632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386489:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386507:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053798144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386521:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386529:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129800.386532:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053797504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386544:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386550:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053798016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386561:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.386573:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053797632 00000100:00100000:0.0:1746129800.386576:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053797632 00000100:00100000:0.0:1746129800.386587:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053798144 00000100:00100000:0.0:1746129800.386589:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053798144 00000100:00100000:0.0:1746129800.386595:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053797504 00000100:00100000:0.0:1746129800.386596:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053797504 00000100:00100000:0.0:1746129800.386602:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053798016 00000100:00100000:0.0:1746129800.386603:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053798016 00000100:00100000:0.0:1746129800.386610:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14037 00000100:00100000:0.0:1746129800.386614:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:3299:x1830949053797248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.386641:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14039 00000100:00100000:0.0:1746129800.386646:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3299:x1830949053797760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129800.386751:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129800.386753:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.386755:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.386867:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.386869:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129800.386891:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+94:3299:x1830949053797248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 276us (469us total) trans 17179873829 rc 0/0 00000100:00100000:0.0:1746129800.386896:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14037 00000004:00080000:0.0:1746129800.386987:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7b80/2, rc 0, transno 17179873828 00000100:00100000:0.0:1746129800.386991:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129800.386997:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7480/2, rc 0, transno 17179873827 00000100:00100000:0.0:1746129800.386999:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129800.387004:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a5c00/2, rc 0, transno 17179873829 00000100:00100000:0.0:1746129800.387006:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129800.387011:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7100/2, rc 0, transno 17179873826 00000100:00100000:0.0:1746129800.387014:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053797376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129800.387048:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7800/2, rc 0, transno 17179873833 00000100:00100000:0.0:1746129800.387051:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053797504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129800.387057:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6680/2, rc 0, transno 17179873832 00000100:00100000:0.0:1746129800.387059:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053798144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.387803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.387874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.390394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.391594:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.393088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.393168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.403374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.405344:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.406817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.424527:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053757568 00000100:00100000:0.0:1746129800.424533:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053757568 00000100:00100000:0.0:1746129800.424557:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14047 00000100:00100000:0.0:1746129800.424562:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949053757568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129800.424570:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.424581:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353d3f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129800.424596:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d388, atime: 0x6813d388, ctime: 0x6813d388, blocks: 0x1029 00010000:00010000:0.0:1746129800.424605:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.424607:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.424612:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d3f expref: 34 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.424621:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d3f expref: 34 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.424627:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060c00, rc 0) 00000100:00100000:0.0:1746129800.424646:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949053757568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.424651:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14047 00000100:00100000:0.0:1746129800.433719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.433760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.433792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.434096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.434134:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053758080 00000100:00100000:0.0:1746129800.434138:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053758080 00002000:00100000:0.0:1746129800.434155:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094eb4a80 x1830949053758080/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.434162:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949053758080 ext(3145728->4194303) 00002000:00010000:0.0:1746129800.434165:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4a80 00000100:00100000:0.0:1746129800.434389:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6136 00000100:00100000:0.0:1746129800.434396:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1964:x1830949053757824:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129800.465764:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.477941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.477981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.478014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.478049:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053760640 00000100:00100000:0.0:1746129800.478056:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053760640 00000100:00100000:0.0:1746129800.478097:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4370 00000100:00100000:0.0:1746129800.478105:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:30888:x1830949053760640:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129800.478279:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:30888:x1830949053760640:12345-192.168.204.31@tcp:35:cat.0 Request processed in 173us (263us total) trans 8589944589 rc 0/0 00000100:00100000:0.0:1746129800.478285:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4370 00000100:00100000:0.0:1746129800.482947:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.482995:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.485109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.486223:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6144 00000100:00100000:0.0:1746129800.486231:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949053761792:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129800.504076:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.510557:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949053761792:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24324us (24924us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129800.510568:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6144 00002000:00100000:0.0:1746129800.510577:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a55a4e00 x1830949053761792/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/440 e 0 to 0 dl 1746129811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.510586:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a4e00 with x1830949053761792 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.510590:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a4e00 00000100:00100000:0.0:1746129800.531625:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.539977:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053800192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.539998:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540009:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053800704:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540020:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540028:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129800.540031:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053800576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540042:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540049:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053801088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540061:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540077:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053800448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540091:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540100:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053800960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540112:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540122:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129800.540126:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053800320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540139:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540149:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053800832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540160:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129800.540175:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800064 00000100:00100000:0.0:1746129800.540178:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800064 00000100:00100000:0.0:1746129800.540190:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800192 00000100:00100000:0.0:1746129800.540192:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800192 00000100:00100000:0.0:1746129800.540199:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800704 00000100:00100000:0.0:1746129800.540200:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800704 00000100:00100000:0.0:1746129800.540205:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800576 00000100:00100000:0.0:1746129800.540207:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800576 00000100:00100000:0.0:1746129800.540212:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053801088 00000100:00100000:0.0:1746129800.540213:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053801088 00000100:00100000:0.0:1746129800.540218:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800448 00000100:00100000:0.0:1746129800.540219:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800448 00000100:00100000:0.0:1746129800.540224:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800960 00000100:00100000:0.0:1746129800.540226:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800960 00000100:00100000:0.0:1746129800.540231:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800320 00000100:00100000:0.0:1746129800.540232:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800320 00000100:00100000:0.0:1746129800.540237:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053800832 00000100:00100000:0.0:1746129800.540238:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053800832 00000100:00100000:0.0:1746129800.540244:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14062 00000100:00100000:0.0:1746129800.540248:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+113:3298:x1830949053800064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.540343:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14063 00000100:00100000:0.0:1746129800.540347:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+100:3299:x1830949053800192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129800.540439:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129800.540441:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.540443:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.540445:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.540447:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129800.540467:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:3299:x1830949053800192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (468us total) trans 17179873834 rc 0/0 00000100:00100000:0.0:1746129800.540472:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14063 00000100:00100000:0.0:1746129800.540481:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14064 00000100:00100000:0.0:1746129800.540484:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+100:3299:x1830949053800704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540565:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:3299:x1830949053800704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (543us total) trans 17179873835 rc 0/0 00000100:00100000:0.0:1746129800.540570:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14064 00000100:00100000:0.0:1746129800.540579:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14065 00000100:00100000:0.0:1746129800.540582:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+100:3299:x1830949053800576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540765:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:3299:x1830949053800576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (721us total) trans 17179873836 rc 0/0 00000100:00100000:0.0:1746129800.540770:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14065 00000100:00100000:0.0:1746129800.540779:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14066 00000100:00100000:0.0:1746129800.540782:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+100:3299:x1830949053801088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129800.540879:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:3299:x1830949053801088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (816us total) trans 17179873837 rc 0/0 00000100:00100000:0.0:1746129800.540912:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14066 00000100:00100000:0.0:1746129800.540922:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14067 00000100:00100000:0.0:1746129800.540926:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+100:3297:x1830949053800448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129800.540990:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129800.540993:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.540995:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.540996:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129800 -> 1746129800 00002000:00010000:0.0:1746129800.540999:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129800.541021:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:3297:x1830949053800448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (928us total) trans 17179873838 rc 0/0 00000100:00100000:0.0:1746129800.541025:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14067 00000004:00080000:0.0:1746129800.542456:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adadc00/2, rc 0, transno 21474841010 00000100:00100000:0.0:1746129800.542461:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053799168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129800.542475:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3480/2, rc 0, transno 21474841017 00000100:00100000:0.0:1746129800.542478:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053800064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129800.552825:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053762944 00000100:00100000:0.0:1746129800.552833:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053762944 00000100:00100000:0.0:1746129800.552884:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14071 00000100:00100000:0.0:1746129800.552891:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:30899:x1830949053762944:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129800.552905:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.552919:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2600/0x48868a4e43951518 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353d9a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.552942:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 40 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.552950:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 28 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.552955:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.552957:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.552960:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2600/0x48868a4e43951518 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2936832->2965503] (req 2936832->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d9a expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.552986:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 28 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.552997:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 28 pid: 10930 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.553006:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053801216:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.553062:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 40 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.553071:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 40 pid: 7975 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.553078:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053801344:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.553091:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.553638:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053763200 00000100:00100000:0.0:1746129800.553642:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053763200 00002000:00100000:0.0:1746129800.553668:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009a04c700 x1830949053763200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.553677:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c700 with x1830949053763200 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.553680:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c700 00000100:00100000:0.0:1746129800.554479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.554493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.554533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.554552:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053763328 00000100:00100000:0.0:1746129800.554556:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053763328 00010000:00010000:0.0:1746129800.554573:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 41 pid: 7975 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.554589:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053763456 00000100:00100000:0.0:1746129800.554591:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053763456 00010000:00010000:0.0:1746129800.554598:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 29 pid: 10930 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.554612:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6908 00000100:00100000:0.0:1746129800.554616:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1964:x1830949053763328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.554623:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.554638:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 41 pid: 7975 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.554646:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 41 pid: 7975 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.554663:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.554685:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1964:x1830949053763328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 69us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.554691:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6908 00000100:00100000:0.0:1746129800.554726:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6909 00000100:00100000:0.0:1746129800.554738:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949053763456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.554743:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.554749:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 29 pid: 10930 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.554758:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 29 pid: 10930 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.554767:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.554768:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.554773:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2600/0x48868a4e43951518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2936832->2965503) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d9a expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.554780:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2600/0x48868a4e43951518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2936832->2965503) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d9a expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.554977:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2600/0x48868a4e43951518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2936832->2965503) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d9a expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.555100:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094769c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053801472:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129800.555334:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.555353:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053763584 00000100:00100000:0.0:1746129800.555356:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053763584 00000100:00100000:0.0:1746129800.555376:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14072 00000100:00100000:0.0:1746129800.555381:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:30894:x1830949053763584:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129800.555389:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.555400:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013067ee00/0x48868a4e4395151f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353da1 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.555416:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.555427:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a061200/0x48868a4e439514c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d54 expref: 35 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.555432:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.555433:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.555436:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013067ee00/0x48868a4e4395151f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1175552->2056191] (req 1175552->2056191) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353da1 expref: 35 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.555450:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a061200/0x48868a4e439514c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d54 expref: 35 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.555459:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a061200/0x48868a4e439514c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d54 expref: 35 pid: 10930 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.555467:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053801600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.555494:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.555515:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.555522:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053801728:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.555538:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00010000:00010000:0.0:1746129800.555565:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013558c200/0x48868a4e439514d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d69 expref: 29 pid: 10930 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.555579:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053801216:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.555589:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0046000/0x48868a4e43951485 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d38 expref: 40 pid: 7975 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.555596:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053801344:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.555612:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2600/0x48868a4e43951518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2936832->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d9a expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.555619:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c2600, rc 0) 00000100:00100000:0.0:1746129800.555635:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:30899:x1830949053762944:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2745us (3179us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.555640:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14071 00000100:00100000:0.0:1746129800.560204:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094769c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053801472:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129800.560213:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.560247:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949053763456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5515us (5751us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.560256:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6909 00000100:00100000:0.0:1746129800.561569:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053763968 00000100:00100000:0.0:1746129800.561575:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053763968 00002000:00100000:0.0:1746129800.561599:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2936832->2940927) req@ffff88009a04df80 x1830949053763968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.561608:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04df80 with x1830949053763968 ext(2936832->2940927) 00002000:00010000:0.0:1746129800.561611:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04df80 00000100:00100000:0.0:1746129800.561635:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6146 00000100:00100000:0.0:1746129800.561640:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949053763968:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129800.561737:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949053763968:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 97us (321us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129800.561742:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6146 00002000:00100000:0.0:1746129800.561746:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2936832->2940927) req@ffff88009a04df80 x1830949053763968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/4536 e 0 to 0 dl 1746129811 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.561751:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04df80 with x1830949053763968 ext(2936832->2940927) 00002000:00010000:0.0:1746129800.561753:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04df80 00000100:00100000:0.0:1746129800.561773:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053763712 00000100:00100000:0.0:1746129800.561775:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053763712 00010000:00010000:0.0:1746129800.561786:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.561800:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6910 00000100:00100000:0.0:1746129800.561805:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949053763712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.561812:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.561824:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.561833:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.561870:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f89d000/0x48868a4e43951431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d07 expref: 35 pid: 3624 timeout: 846 lvb_type: 0 00010000:00010000:0.0:1746129800.561885:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.561902:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053763712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.561907:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6910 00000100:00100000:0.0:1746129800.566083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.566130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.566341:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6147 00000100:00100000:0.0:1746129800.566349:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1961:x1830949053764224:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129800.569796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.572409:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1961:x1830949053764224:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 6055us (6327us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129800.572419:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6147 00002000:00100000:0.0:1746129800.572427:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094769c00 x1830949053764224/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/440 e 0 to 0 dl 1746129811 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.572436:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949053764224 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.572441:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:0.0:1746129800.577721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.581565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.592984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.593009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.593021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.593033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.593056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.593078:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053765504 00000100:00100000:0.0:1746129800.593086:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053765504 00002000:00100000:0.0:1746129800.593122:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3174400->4194303) req@ffff88009476aa00 x1830949053765504/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.593132:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949053765504 ext(3174400->4194303) 00002000:00010000:0.0:1746129800.593137:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:0.0:1746129800.593397:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053765888 00000100:00100000:0.0:1746129800.593401:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053765888 00002000:00100000:0.0:1746129800.593415:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009476b800 x1830949053765888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.593422:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949053765888 ext(2097152->3145727) 00002000:00010000:0.0:1746129800.593425:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476b800 00000100:00100000:0.0:1746129800.593480:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053766144 00000100:00100000:0.0:1746129800.593482:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053766144 00002000:00100000:0.0:1746129800.593493:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a645fb80 x1830949053766144/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.593514:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949053766144 ext(3145728->4194303) 00002000:00010000:0.0:1746129800.593516:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:0.0:1746129800.593531:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6151 00000100:00100000:0.0:1746129800.593538:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949053765504:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129800.601233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.613450:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.628508:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949053765504:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34297us (34859us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746129800.628521:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6151 00002000:00100000:0.0:1746129800.628532:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3174400->4194303) req@ffff88009476aa00 x1830949053765504/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/440 e 0 to 0 dl 1746129811 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.628542:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949053765504 ext(3174400->4194303) 00002000:00010000:0.0:1746129800.628548:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:0.0:1746129800.628949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.635181:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.635214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.641606:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14076 00000100:00100000:0.0:1746129800.641613:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+20:1961:x1830949053767680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129800.641620:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.641627:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353dc4 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.641638:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.641640:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.641644:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dc4 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.641654:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dc4 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.641661:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130677200, rc 0) 00000100:00100000:0.0:1746129800.641678:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+21:1961:x1830949053767680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.641695:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14076 00000100:00100000:0.0:1746129800.641706:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14078 00000100:00100000:0.0:1746129800.641711:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949053767936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129800.641717:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.641723:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130676800/0x48868a4e4395155e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353dd2 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.641744:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053802368:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129800.641769:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.646550:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053768320 00000100:00100000:0.0:1746129800.646557:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053768320 00002000:00100000:0.0:1746129800.646688:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88009a04ed80 x1830949053768320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.646697:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ed80 with x1830949053768320 ext(4194304->4898815) 00002000:00010000:0.0:1746129800.646701:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04ed80 00000100:00100000:0.0:1746129800.646954:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6156 00000100:00100000:0.0:1746129800.647453:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949053768320:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:0.0:1746129800.651779:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime: 1746129800 -> 1746129801 00002000:00010000:0.0:1746129800.651783:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129800 -> 1746129801 00002000:00010000:0.0:1746129800.651785:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime: 1746129800 -> 1746129801 00000100:00100000:0.0:1746129800.651796:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053802368:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129800.651810:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130676800/0x48868a4e4395155e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dd2 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.651819:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130676800/0x48868a4e4395155e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dd2 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.651827:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130676800, rc 0) 00000100:00100000:0.0:1746129800.651875:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949053767936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 10162us (10581us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129800.651882:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14078 00000100:00100000:0.0:1746129800.657323:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949053768320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10354us (10795us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746129800.657335:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6156 00002000:00100000:0.0:1746129800.657345:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88009a04ed80 x1830949053768320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/440 e 0 to 0 dl 1746129811 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.657354:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ed80 with x1830949053768320 ext(4194304->4898815) 00002000:00010000:0.0:1746129800.657359:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04ed80 00000100:00100000:0.0:1746129800.662005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.672901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.677603:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14083 00000100:00100000:0.0:1746129800.677611:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949053769472:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129800.677619:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.677627:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013689f600/0x48868a4e439515ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353e03 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.677652:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053803136:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129800.677675:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.679021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.679060:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053803136:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129800.679076:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013689f600/0x48868a4e439515ab lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e03 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.679089:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013689f600/0x48868a4e439515ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e03 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.679097:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013689f600, rc 0) 00000100:00100000:0.0:1746129800.679117:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949053769472:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1507us (1637us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129800.679122:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14083 00000100:00100000:0.0:1746129800.686241:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053770368 00000100:00100000:0.0:1746129800.686245:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053770368 00000100:00100000:0.0:1746129800.686300:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053770240 00000100:00100000:0.0:1746129800.686303:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053770240 00000100:00100000:0.0:1746129800.686319:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053770752 00000100:00100000:0.0:1746129800.686320:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053770752 00000100:00100000:0.0:1746129800.686399:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14085 00000100:00100000:0.0:1746129800.686404:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+21:1962:x1830949053770368:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129800.686421:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.686431:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa37e00/0x48868a4e4395143f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d0e expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.686438:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dc4 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686444:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0046c00/0x48868a4e439514b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d5b expref: 32 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686453:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.686455:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.686456:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.686471:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0046c00/0x48868a4e439514b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d5b expref: 32 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686479:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0046c00/0x48868a4e439514b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d5b expref: 32 pid: 10930 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.686487:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053803392:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.686530:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dc4 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686538:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dc4 expref: 21 pid: 4589 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.686544:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053803776:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.686562:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa37e00/0x48868a4e4395143f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d0e expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.686569:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa37e00/0x48868a4e4395143f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d0e expref: 33 pid: 10930 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.686580:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053804032:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.686601:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.686617:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14089 00000100:00100000:0.0:1746129800.686622:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+21:1962:x1830949053770752:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129800.686637:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130677400/0x48868a4e439515e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.686646:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d3f expref: 33 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686652:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f688a00/0x48868a4e43951565 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dd9 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686659:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686663:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.686664:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.686666:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677400/0x48868a4e439515e3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.686678:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686685:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.686692:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053804416:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.686787:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f688a00/0x48868a4e43951565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dd9 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686795:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f688a00/0x48868a4e43951565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dd9 expref: 21 pid: 8436 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.686803:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053804672:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.686836:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d3f expref: 33 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.686871:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d3f expref: 33 pid: 1140 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.686880:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053804928:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.686909:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.692913:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053803392:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.693515:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6918 00000100:00100000:0.0:1746129800.693520:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949053770880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.693526:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.693533:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00b3600/0x48868a4e439514bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d4d expref: 10 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.693544:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00b3600/0x48868a4e439514bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d4d expref: 10 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.693553:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00b3600/0x48868a4e439514bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d4d expref: 10 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.693559:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.694422:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949053770880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 900us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.694429:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6918 00000100:00100000:0.0:1746129800.694469:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053804416:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.694479:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f688a00/0x48868a4e43951565 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dd9 expref: 21 pid: 8436 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.694488:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053804672:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.694511:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a060c00/0x48868a4e4395148c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d3f expref: 34 pid: 1140 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.694523:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053804928:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.694539:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130677400/0x48868a4e439515e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694559:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130677200/0x48868a4e43951557 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353dc4 expref: 20 pid: 4589 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.694570:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053803776:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.694579:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa37e00/0x48868a4e4395143f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d0e expref: 33 pid: 10930 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.694586:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053804032:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129800.694596:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694602:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694608:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694623:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694629:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694635:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694640:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130677800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129800.694643:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694650:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694658:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.694664:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130677800/0x48868a4e439515ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.694699:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:1962:x1830949053770368:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 8294us (8518us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.694712:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14085 00000100:00100000:0.0:1746129800.697548:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053772544 00000100:00100000:0.0:1746129800.697555:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053772544 00010000:00010000:0.0:1746129800.697579:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.697602:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6926 00000100:00100000:0.0:1746129800.697608:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1963:x1830949053772544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.697619:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.697636:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.697652:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.697675:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00b3e00/0x48868a4e439514d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d70 expref: 32 pid: 20441 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.697686:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.697688:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.697691:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130677400/0x48868a4e439515e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.697699:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130677400/0x48868a4e439515e3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.697731:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129800.697761:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949053772544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.697767:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6926 00000100:00100000:0.0:1746129800.702064:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10672 00000100:00100000:0.0:1746129800.702072:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:30906:x1830949053773056:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129800.702080:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.702087:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013689ea00/0x48868a4e439515f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353e18 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.702150:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e439515ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702160:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e439515ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702167:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e439515ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702176:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e400/0x48868a4e43951606 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702181:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e400/0x48868a4e43951606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702185:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e400/0x48868a4e43951606 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702263:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013689f800/0x48868a4e4395160d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702271:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d600/0x48868a4e439515b9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e0a expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.702277:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013689f800/0x48868a4e4395160d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129800.702300:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d600/0x48868a4e439515b9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e0a expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.702308:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d600/0x48868a4e439515b9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e0a expref: 9 pid: 14313 timeout: 846 lvb_type: 0 00000100:00100000:0.0:1746129800.702318:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053805056:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129800.702369:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.705510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.705539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.709933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129800.710176:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710186:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710213:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710220:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710226:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710231:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa37c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129800.710234:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710241:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710251:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.710257:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa37c00/0x48868a4e439515ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.710293:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949053770624:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 23881us (24100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.710300:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14086 00000100:00100000:0.0:1746129800.714128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.715163:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053773952 00000100:00100000:0.0:1746129800.715166:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053773952 00000100:00100000:0.0:1746129800.715183:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053774208 00000100:00100000:0.0:1746129800.715184:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053774208 00000100:00100000:0.0:1746129800.715198:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14093 00000100:00100000:0.0:1746129800.715203:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949053773952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129800.715210:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.715218:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013689f000/0x48868a4e4395165a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353e3b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129800.715232:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d388, atime: 0x6813d388, ctime: 0x6813d388, blocks: 0x821 00010000:00010000:0.0:1746129800.715240:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.715241:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.715246:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013689f000/0x48868a4e4395165a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e3b expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.715255:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013689f000/0x48868a4e4395165a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e3b expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.715262:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013689f000, rc 0) 00000100:00100000:0.0:1746129800.715279:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949053773952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.715284:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14093 00000100:00100000:0.0:1746129800.715295:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14095 00000100:00100000:0.0:1746129800.715299:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949053774208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129800.715305:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.715313:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013689ee00/0x48868a4e43951668 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353e49 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129800.715322:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d388, atime: 0x6813d388, ctime: 0x6813d388, blocks: 0x1029 00010000:00010000:0.0:1746129800.715328:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.715329:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.715333:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013689ee00/0x48868a4e43951668 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e49 expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.715342:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013689ee00/0x48868a4e43951668 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e49 expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129800.715347:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013689ee00, rc 0) 00000100:00100000:0.0:1746129800.715361:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949053774208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.715366:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14095 00000100:00100000:0.0:1746129800.717618:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.719577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.719625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.721718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.746346:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.747341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.747380:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053775744 00000100:00100000:0.0:1746129800.747385:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053775744 00000100:00100000:0.0:1746129800.747706:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14096 00000100:00100000:0.0:1746129800.747712:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:30909:x1830949053775744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129800.747720:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129800.747729:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e4395168b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353e57 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129800.747745:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d389, atime: 0x6813d388, ctime: 0x6813d389, blocks: 0x821 00010000:00010000:0.0:1746129800.747756:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.747757:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.747763:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e4395168b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e57 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.747772:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f907800/0x48868a4e4395168b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e57 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.747780:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907800, rc 0) 00000100:00100000:0.0:1746129800.747817:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:30909:x1830949053775744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129800.747822:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14096 00000100:00100000:0.0:1746129800.759042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.760188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.763635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.763684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.763722:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053776384 00000100:00100000:0.0:1746129800.763728:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053776384 00002000:00100000:0.0:1746129800.763757:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092ad9500 x1830949053776384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.763766:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9500 with x1830949053776384 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.763770:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9500 00000100:00100000:0.0:1746129800.763797:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053776640 00000100:00100000:0.0:1746129800.763800:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053776640 00002000:00100000:0.0:1746129800.763812:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880092ad9180 x1830949053776640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.763818:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9180 with x1830949053776640 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.763821:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9180 00000100:00100000:0.0:1746129800.763833:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6159 00000100:00100000:0.0:1746129800.763839:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949053776384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129800.782453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.784168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.792364:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.796113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.796150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.796219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.801610:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.816339:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.826527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.848291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.856056:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.859714:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.860067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.860096:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053779584 00000100:00100000:0.0:1746129800.860098:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053779584 00010000:00010000:0.0:1746129800.860110:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136364c00/0x48868a4e43951645 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e26 expref: 15 pid: 8437 timeout: 846 lvb_type: 1 00000100:00100000:0.0:1746129800.860123:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6931 00000100:00100000:0.0:1746129800.860128:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949053779584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129800.860134:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129800.860149:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136364c00/0x48868a4e43951645 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e26 expref: 14 pid: 8437 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.860156:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136364c00/0x48868a4e43951645 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e26 expref: 14 pid: 8437 timeout: 846 lvb_type: 1 00010000:00010000:0.0:1746129800.860172:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.860173:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129800.860179:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130676800/0x48868a4e439516a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 167936->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e65 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.860185:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130676800/0x48868a4e439516a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 167936->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e65 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129800.860209:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130676800/0x48868a4e439516a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 167936->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e65 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129800.860219:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053805696:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129800.860455:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129800.863032:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.863532:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053780096 00000100:00100000:0.0:1746129800.863535:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053780096 00000100:00100000:0.0:1746129800.863554:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4379 00000100:00100000:0.0:1746129800.863558:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:30909:x1830949053780096:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129800.863703:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:30909:x1830949053780096:12345-192.168.204.31@tcp:35:cat.0 Request processed in 143us (237us total) trans 8589944603 rc 0/0 00000100:00100000:0.0:1746129800.863709:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4379 00000100:00100000:0.0:1746129800.870157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.873036:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.879667:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.882084:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.898000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.902305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.902462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.902503:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.902763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.902919:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053781632 00000100:00100000:0.0:1746129800.902923:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053781632 00000100:00100000:0.0:1746129800.913603:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.913971:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.914000:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.914289:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053782144 00000100:00100000:0.0:1746129800.914293:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053782144 00002000:00100000:0.0:1746129800.914323:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1085440->2097151) req@ffff88009ba85c00 x1830949053782144/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.914331:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85c00 with x1830949053782144 ext(1085440->2097151) 00002000:00010000:0.0:1746129800.914335:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85c00 00000100:00100000:0.0:1746129800.914794:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053782400 00000100:00100000:0.0:1746129800.914798:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053782400 00002000:00100000:0.0:1746129800.914813:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009ba85f80 x1830949053782400/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.914820:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949053782400 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.914824:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:0.0:1746129800.914835:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053782656 00000100:00100000:0.0:1746129800.914837:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053782656 00002000:00100000:0.0:1746129800.914867:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ba3a680 x1830949053782656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:541/0 lens 488/0 e 0 to 0 dl 1746129811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.914874:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3a680 with x1830949053782656 ext(1048576->2097151) 00002000:00010000:0.0:1746129800.914877:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3a680 00000100:00100000:0.0:1746129800.914889:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6171 00000100:00100000:0.0:1746129800.914896:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949053782144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129800.943177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.963057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.966828:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.972705:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949053783168:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5626us (5869us total) trans 17179873843 rc 0/0 00000100:00100000:0.0:1746129800.972716:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1688 00002000:00100000:0.0:1746129800.972725:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2568192->2863103) req@ffff88009ba84000 x1830949053783168/t17179873843(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:541/0 lens 488/448 e 0 to 0 dl 1746129811 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129800.972733:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba84000 with x1830949053783168 ext(2568192->2863103) 00010000:00010000:0.0:1746129800.972742:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a0f200/0x48868a4e43951699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2568192->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e5e expref: 23 pid: 10930 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129800.972753:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a0f200/0x48868a4e43951699 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2568192->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e5e expref: 23 pid: 10930 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746129800.972760:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ba84000 00000100:00100000:0.0:1746129800.976062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.989702:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.991787:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.991888:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129800.992961:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6177 00000100:00100000:0.0:1746129800.992970:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949053783808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129801.014616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129801.014901:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129801.018321:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.020833:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.042339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.042382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.042403:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053785344 00000100:00100000:0.0:1746129801.042410:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053785344 00000100:00100000:0.0:1746129801.042455:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4381 00000100:00100000:0.0:1746129801.042461:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:30918:x1830949053785344:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129801.042630:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:30918:x1830949053785344:12345-192.168.204.31@tcp:35:cat.0 Request processed in 168us (247us total) trans 8589944607 rc 0/0 00000100:00100000:0.0:1746129801.042636:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4381 00000100:00100000:0.0:1746129801.058390:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.063386:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.063498:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.063525:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053785600 00000100:00100000:0.0:1746129801.063532:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053785600 00010000:00010000:0.0:1746129801.063561:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130676000/0x48868a4e43951653 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e34 expref: 23 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.063591:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053785728 00000100:00100000:0.0:1746129801.063594:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053785728 00010000:00010000:0.0:1746129801.063607:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e439516d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e81 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.063652:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6936 00000100:00100000:0.0:1746129801.063662:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949053785600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.063675:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.063698:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130676000/0x48868a4e43951653 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e34 expref: 23 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.063708:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130676000/0x48868a4e43951653 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e34 expref: 23 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.063729:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130676000/0x48868a4e43951653 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e34 expref: 23 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.063746:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.063784:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949053785600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.063790:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6936 00000100:00100000:0.0:1746129801.063806:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6937 00000100:00100000:0.0:1746129801.063812:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949053785728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.063820:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.063830:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e439516d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e81 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.063839:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e439516d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e81 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.064800:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e439516d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e81 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.064809:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.064811:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.064816:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130676e00/0x48868a4e43951733 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353eb2 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.064823:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130676e00/0x48868a4e43951733 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2007040->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353eb2 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.073713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.076607:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.083552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.084336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.090213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.091069:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.095262:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14109 00000100:00100000:0.0:1746129801.095269:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949053787392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.095276:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.095284:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437f000/0x48868a4e4395176b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353ece expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.095311:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053807616:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129801.095344:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.095502:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053787648 00000100:00100000:0.0:1746129801.095505:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053787648 00000100:00100000:0.0:1746129801.095523:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14110 00000100:00100000:0.0:1746129801.095528:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949053787648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.095534:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.095540:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437ee00/0x48868a4e43951772 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353ed5 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.095550:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.095552:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.095558:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ee00/0x48868a4e43951772 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ed5 expref: 25 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.095569:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437ee00/0x48868a4e43951772 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ed5 expref: 25 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.095576:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437ee00, rc 0) 00000100:00100000:0.0:1746129801.095596:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949053787648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.095601:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14110 00002000:00010000:0.0:1746129801.096407:0:1140:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129800 -> 1746129801 00002000:00010000:0.0:1746129801.096410:0:1140:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129800 -> 1746129801 00002000:00010000:0.0:1746129801.096412:0:1140:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129800 -> 1746129801 00000100:00100000:0.0:1746129801.096424:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053807488:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129801.096602:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130676a00/0x48868a4e43951764 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ec7 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.096612:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130676a00/0x48868a4e43951764 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ec7 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.096632:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130676a00, rc 0) 00000100:00100000:0.0:1746129801.096659:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1963:x1830949053787264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2071us (2416us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129801.096663:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14108 00000100:00100000:0.0:1746129801.098444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.108798:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.108922:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.124955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.135819:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053808000:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129801.135866:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.135936:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949053788288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10635us (10989us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.135946:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6940 00000100:00100000:0.0:1746129801.136483:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.138818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.138877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.150162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.167148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.171332:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053789696 00000100:00100000:0.0:1746129801.171338:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053789696 00002000:00100000:0.0:1746129801.171370:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1503232->1507327) req@ffff8800a8fd2a00 x1830949053789696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:542/0 lens 488/0 e 0 to 0 dl 1746129812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.171378:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949053789696 ext(1503232->1507327) 00002000:00010000:0.0:1746129801.171382:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:0.0:1746129801.171401:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6183 00000100:00100000:0.0:1746129801.171407:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949053789696:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129801.171595:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949053789696:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 186us (479us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129801.171601:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6183 00002000:00100000:0.0:1746129801.171606:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1503232->1507327) req@ffff8800a8fd2a00 x1830949053789696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:542/0 lens 488/4536 e 0 to 0 dl 1746129812 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.171616:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949053789696 ext(1503232->1507327) 00002000:00010000:0.0:1746129801.171619:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:0.0:1746129801.181043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.185696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.185736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.185893:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053808512:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.185921:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e439517b8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353eff expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.185936:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4c400, rc 0) 00000100:00100000:0.0:1746129801.185979:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:30926:x1830949053789952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4080us (4943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.185986:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14115 00000100:00100000:0.0:1746129801.189505:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053790464 00000100:00100000:0.0:1746129801.189514:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053790464 00002000:00100000:0.0:1746129801.189545:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1085439) req@ffff88012ba39180 x1830949053790464/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:542/0 lens 488/0 e 0 to 0 dl 1746129812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.189554:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39180 with x1830949053790464 ext(1048576->1085439) 00010000:00010000:0.0:1746129801.189563:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130677a00/0x48868a4e439516ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1085439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e73 expref: 10 pid: 10930 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.189576:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130677a00/0x48868a4e439516ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1085439) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e73 expref: 10 pid: 10930 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746129801.189583:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39180 00000100:00100000:0.0:1746129801.189603:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1692 00000100:00100000:0.0:1746129801.189610:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949053790464:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129801.202651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.202761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.209769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.211322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.215248:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.229384:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.233672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.241503:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.245217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.249466:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.250690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.258599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.270122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.275763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.294230:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.301321:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.301358:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.309159:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.331995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.338184:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053794432 00000100:00100000:0.0:1746129801.338192:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053794432 00002000:00100000:0.0:1746129801.338227:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a8fd0700 x1830949053794432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:542/0 lens 488/0 e 0 to 0 dl 1746129812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.338235:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0700 with x1830949053794432 ext(2097152->3145727) 00002000:00010000:0.0:1746129801.338239:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0700 00000100:00100000:0.0:1746129801.338251:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053794560 00000100:00100000:0.0:1746129801.338254:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053794560 00002000:00100000:0.0:1746129801.338263:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8fd1880 x1830949053794560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:542/0 lens 488/0 e 0 to 0 dl 1746129812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.338268:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1880 with x1830949053794560 ext(3145728->4194303) 00002000:00010000:0.0:1746129801.338270:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd1880 00000100:00100000:0.0:1746129801.338279:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6191 00000100:00100000:0.0:1746129801.338285:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949053794432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129801.349780:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053794816 00000100:00100000:0.0:1746129801.349787:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053794816 00000100:00100000:0.0:1746129801.349840:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 687 00000100:00100000:0.0:1746129801.349861:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1964:x1830949053794816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.349878:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.349897:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395181a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f30 expref: 293 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.349919:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129801.349923:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.349957:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949053794816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.349963:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 687 00000100:00100000:0.0:1746129801.354301:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129801.354817:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129801.365743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.372538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.372594:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.375881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.375894:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053795840 00000100:00100000:0.0:1746129801.375896:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053795840 00000100:00100000:0.0:1746129801.375912:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14126 00000100:00100000:0.0:1746129801.375916:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949053795840:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129801.375922:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.375929:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43951867 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353f61 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.375938:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.375939:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.375944:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43951867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f61 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.375952:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43951867 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f61 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.375964:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87be00, rc 0) 00000100:00100000:0.0:1746129801.375978:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949053795840:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 61us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.375983:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14126 00000100:00100000:0.0:1746129801.376017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.386044:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.391580:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.392442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.392461:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053796480 00000100:00100000:0.0:1746129801.392466:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053796480 00010000:00010000:0.0:1746129801.392503:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009437ee00/0x48868a4e43951772 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ed5 expref: 28 pid: 3624 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.392529:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053796608 00000100:00100000:0.0:1746129801.392531:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053796608 00010000:00010000:0.0:1746129801.392541:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348e5c00/0x48868a4e439517d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f1b expref: 14 pid: 1877 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.392555:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6947 00000100:00100000:0.0:1746129801.392561:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949053796480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.392571:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.392591:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009437ee00/0x48868a4e43951772 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ed5 expref: 28 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.392603:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009437ee00/0x48868a4e43951772 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ed5 expref: 28 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.392623:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.392650:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949053796480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.392655:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6947 00000100:00100000:0.0:1746129801.392717:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6948 00000100:00100000:0.0:1746129801.392723:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949053796608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.392729:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.392738:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801348e5c00/0x48868a4e439517d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f1b expref: 14 pid: 1877 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.392745:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801348e5c00/0x48868a4e439517d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f1b expref: 14 pid: 1877 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.392755:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.392767:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949053796608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.392772:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6948 00000100:00100000:0.0:1746129801.392823:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.392836:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053796736 00000100:00100000:0.0:1746129801.392839:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053796736 00010000:00010000:0.0:1746129801.392864:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439516f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e9d expref: 14 pid: 3624 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.392880:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6949 00000100:00100000:0.0:1746129801.392885:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949053796736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.392892:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.392899:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439516f4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e9d expref: 14 pid: 3624 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.392906:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439516f4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e9d expref: 14 pid: 3624 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.392917:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439516f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353e9d expref: 14 pid: 3624 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.392929:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.392931:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.392936:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136899e00/0x48868a4e43951844 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->3985407) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f3e expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.392943:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136899e00/0x48868a4e43951844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->3985407) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f3e expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.392964:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136899e00/0x48868a4e43951844 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3751936->3985407) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f3e expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.392973:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053810048:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129801.393922:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.396194:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053810048:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129801.396211:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.396865:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949053796736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3977us (4039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.396874:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6949 00000100:00100000:0.0:1746129801.401353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.402033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.402089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.402924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.402971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.405511:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.408470:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.409124:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053798656 00000100:00100000:0.0:1746129801.409128:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053798656 00000100:00100000:0.0:1746129801.409146:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053798784 00000100:00100000:0.0:1746129801.409148:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053798784 00000100:00100000:0.0:1746129801.409173:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14129 00000100:00100000:0.0:1746129801.409179:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949053798656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.409190:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.409205:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e600/0x48868a4e439518b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf353f8b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.409220:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.409222:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.409809:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e600/0x48868a4e439518b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f8b expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.409823:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e600/0x48868a4e439518b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f8b expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.409831:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6e600, rc 0) 00000100:00100000:0.0:1746129801.409872:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949053798656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 670us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.409877:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14129 00000100:00100000:0.0:1746129801.412256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.418523:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053799552 00000100:00100000:0.0:1746129801.418532:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053799552 00000100:00100000:0.0:1746129801.418575:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4387 00000100:00100000:0.0:1746129801.418582:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:30936:x1830949053799552:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129801.418801:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:30936:x1830949053799552:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 218us (1260us total) trans 8589944620 rc 0/0 00000100:00100000:0.0:1746129801.418807:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4387 00000100:00100000:0.0:1746129801.419403:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.426915:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.431460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.431504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.431541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.440297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.447950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.454275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.472701:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.478161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.484198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.491657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.491731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.493431:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6200 00000100:00100000:0.0:1746129801.493440:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949053801728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129801.512802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.521147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.526529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.526560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.528023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.542179:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.544079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.545040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.549755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.550137:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6957 00000100:00100000:0.0:1746129801.550144:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1961:x1830949053803520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.550154:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.550160:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135c5b400/0x48868a4e439518f3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fa7 expref: 298 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.550168:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135c5b400/0x48868a4e439518f3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fa7 expref: 298 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.550183:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c5b400/0x48868a4e439518f3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fa7 expref: 298 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.550260:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129801.550265:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e43951924 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.550273:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e43951924 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.550281:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e43951924 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.550519:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.550740:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1961:x1830949053803520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 596us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.550750:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6957 00000100:00100000:0.0:1746129801.558955:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.569567:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.601492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.604248:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.614392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.621299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.642003:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.642688:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.684290:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.684337:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.695393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.696267:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.709304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.709353:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.711390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.716060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.720057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.726632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.728648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.732576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.740942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.741029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.741427:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4391 00000100:00100000:0.0:1746129801.741436:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:30953:x1830949053807360:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129801.741610:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:30953:x1830949053807360:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 175us (676us total) trans 8589944627 rc 0/0 00000100:00100000:0.0:1746129801.741617:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4391 00000100:00100000:0.0:1746129801.748768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.750391:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.750426:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.750454:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.750487:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.750695:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 690 00000100:00100000:0.0:1746129801.750700:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949053808128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.750707:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.750719:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c5b400/0x48868a4e43951986 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ff4 expref: 27 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.750731:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129801.750734:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.750747:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949053808128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.750751:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 690 00000100:00100000:0.0:1746129801.777251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.787741:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.787783:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.787824:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.787878:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053809408 00000100:00100000:0.0:1746129801.787885:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053809408 00000100:00100000:0.0:1746129801.787935:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14144 00000100:00100000:0.0:1746129801.787942:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:30950:x1830949053809408:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129801.787957:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.787969:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e439519a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354010 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.787993:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e4395195c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fdf expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.788000:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129801.788002:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129801.788005:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e439519a9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->3330047] (req 3145728->3330047) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354010 expref: 28 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.788030:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e4395195c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fdf expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.788040:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e4395195c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fdf expref: 13 pid: 1877 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.788050:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053813632:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129801.788111:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.794071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.804350:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949053809536:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9893us (10279us total) trans 17179873849 rc 0/0 00000100:00100000:0.0:1746129801.804362:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1699 00002000:00100000:0.0:1746129801.804370:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3031040->3145727) req@ffff8800934d5c00 x1830949053809536/t17179873849(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:542/0 lens 488/448 e 0 to 0 dl 1746129812 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.804378:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5c00 with x1830949053809536 ext(3031040->3145727) 00010000:00010000:0.0:1746129801.804386:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e4395195c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fdf expref: 16 pid: 1877 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.804398:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e4395195c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fdf expref: 16 pid: 1877 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746129801.804405:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d5c00 00000100:00100000:0.0:1746129801.807223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.812485:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.815836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.815927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.816149:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14146 00000100:00100000:0.0:1746129801.816154:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949053810176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.816161:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.816169:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1200/0x48868a4e439519b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35401e expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.816191:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053814016:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129801.816209:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.820641:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.826233:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.826821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.833108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.836413:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.840518:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.840551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.840574:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.840800:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14149 00000100:00100000:0.0:1746129801.840806:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949053811328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129801.840813:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.840821:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f981200/0x48868a4e439519e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354041 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.840865:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053814400:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129801.840899:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.840978:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.845176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129801.848642:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800ace22e00/0x48868a4e439519da lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35402c expref: 14 pid: 1851 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.848655:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053814784:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.848664:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f800/0x48868a4e43951a04 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.848671:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f800/0x48868a4e43951a04 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.848675:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f800/0x48868a4e43951a04 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129801.848691:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129801.848798:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96fc00/0x48868a4e439519fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35404f expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.848809:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f800/0x48868a4e43951a04 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35404f expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.848815:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129801.848817:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129801.848818:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f800, rc 0) 00000100:00100000:0.0:1746129801.849301:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:30960:x1830949053811840:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3508us (3661us total) trans 8589944630 rc 0/0 00000100:00100000:0.0:1746129801.849307:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10692 00000100:00100000:0.0:1746129801.851555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.852332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.857053:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.863277:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14153 00000100:00100000:0.0:1746129801.863286:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949053812736:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129801.863295:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.863305:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0x48868a4e43951a27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354064 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.863350:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053815040:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129801.863397:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.864688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.867594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.867901:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.870230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.870263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.870286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.870306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.870316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.870331:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053813376 00000100:00100000:0.0:1746129801.870336:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053813376 00000100:00100000:0.0:1746129801.870357:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053813632 00000100:00100000:0.0:1746129801.870359:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053813632 00000100:00100000:0.0:1746129801.870368:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053813888 00000100:00100000:0.0:1746129801.870369:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053813888 00000100:00100000:0.0:1746129801.870377:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053813504 00000100:00100000:0.0:1746129801.870379:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053813504 00000100:00100000:0.0:1746129801.870387:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053813760 00000100:00100000:0.0:1746129801.870389:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053813760 00000100:00100000:0.0:1746129801.870400:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14155 00000100:00100000:0.0:1746129801.870405:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053813376:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129801.870432:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135c5be00/0x48868a4e43951a4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870447:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093bee200/0x48868a4e43951779 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353edc expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870454:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.870461:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095328200/0x48868a4e439517b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef8 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.870483:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.870485:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.870487:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135c5be00/0x48868a4e43951a4a lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870512:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095328200/0x48868a4e439517b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef8 expref: 18 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.870521:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095328200/0x48868a4e439517b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef8 expref: 18 pid: 1877 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.870531:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053815296:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.870803:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.870811:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 10 pid: 3624 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.870818:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053815808:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.870839:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093bee200/0x48868a4e43951779 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353edc expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870862:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093bee200/0x48868a4e43951779 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353edc expref: 15 pid: 1140 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.870874:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053815936:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129801.870898:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.870911:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14158 00000100:00100000:0.0:1746129801.870916:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949053813504:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129801.870930:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870938:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e439517b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353eff expref: 29 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870944:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2e00/0x48868a4e43951859 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f4c expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.870950:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe28c00/0x48868a4e439517bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f06 expref: 15 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870955:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.870956:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.870958:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870970:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe28c00/0x48868a4e439517bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f06 expref: 15 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.870976:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe28c00/0x48868a4e439517bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f06 expref: 15 pid: 3624 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.870983:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053816320:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.871000:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2e00/0x48868a4e43951859 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f4c expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.871006:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2e00/0x48868a4e43951859 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f4c expref: 8 pid: 7976 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.871013:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053816448:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.871025:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e439517b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353eff expref: 29 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.871031:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4c400/0x48868a4e439517b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353eff expref: 29 pid: 3624 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.871037:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053816704:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129801.871046:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129801.871076:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.871144:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14160 00000100:00100000:0.0:1746129801.871150:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949053814016:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129801.871163:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094da2400/0x48868a4e43951a6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.871170:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129801.871174:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7d200/0x48868a4e43951a2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35406b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.871179:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129801.871180:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094da2400/0x48868a4e43951a6d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.871197:0:8435:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7d200/0x48868a4e43951a2e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35406b expref: 15 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.871208:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094da2400/0x48868a4e43951a6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.881653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.881687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.881711:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.881747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.881770:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053814272 00000100:00100000:0.0:1746129801.881777:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053814272 00010000:00010000:0.0:1746129801.881805:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3de200/0x48868a4e439519e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354033 expref: 10 pid: 3623 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.881825:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053814784 00000100:00100000:0.0:1746129801.881827:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053814784 00010000:00010000:0.0:1746129801.881836:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x48868a4e43951a20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35405d expref: 11 pid: 4589 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.881867:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053814656 00000100:00100000:0.0:1746129801.881869:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053814656 00010000:00010000:0.0:1746129801.881878:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3de600/0x48868a4e43951916 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353fc3 expref: 30 pid: 1877 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.881885:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053815424 00000100:00100000:0.0:1746129801.881887:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053815424 00010000:00010000:0.0:1746129801.881894:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e439519be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354025 expref: 19 pid: 3623 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.881903:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6971 00000100:00100000:0.0:1746129801.881909:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949053814272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.881918:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.881934:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a3de200/0x48868a4e439519e1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354033 expref: 10 pid: 3623 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.881944:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a3de200/0x48868a4e439519e1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354033 expref: 10 pid: 3623 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.881960:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a3de200/0x48868a4e439519e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354033 expref: 10 pid: 3623 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.881977:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.882005:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949053814272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.882010:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6971 00000100:00100000:0.0:1746129801.882041:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6972 00000100:00100000:0.0:1746129801.882045:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949053814784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.882051:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.882061:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x48868a4e43951a20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35405d expref: 11 pid: 4589 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.882068:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x48868a4e43951a20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35405d expref: 11 pid: 4589 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.882077:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a7dc00/0x48868a4e43951a20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35405d expref: 11 pid: 4589 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.882084:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.882095:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949053814784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.882100:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6972 00000100:00100000:0.0:1746129801.882108:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6974 00000100:00100000:0.0:1746129801.882112:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949053815424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.882117:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.882122:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e439519be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354025 expref: 19 pid: 3623 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.882130:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e439519be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354025 expref: 19 pid: 3623 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.882139:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e439519be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354025 expref: 19 pid: 3623 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.882146:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.882148:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.882153:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e43951a58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.882160:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79c00/0x48868a4e43951a58 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.882178:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.882188:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949053815424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.882193:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6974 00000100:00100000:0.0:1746129801.883802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.885316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.885350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.885367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.885393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.885404:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053814528 00000100:00100000:0.0:1746129801.885407:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053814528 00010000:00010000:0.0:1746129801.886371:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.886386:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6979 00000100:00100000:0.0:1746129801.886391:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949053814528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.886397:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.886403:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.886410:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.886888:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e4395184b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353f45 expref: 8 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.886896:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.886958:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949053814528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 565us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.886967:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6979 00000100:00100000:0.0:1746129801.887052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.887102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.887113:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053815168 00000100:00100000:0.0:1746129801.887115:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053815168 00010000:00010000:0.0:1746129801.887124:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3df400/0x48868a4e4395199b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354002 expref: 17 pid: 3624 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746129801.887135:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6981 00000100:00100000:0.0:1746129801.887139:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949053815168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.887144:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.887150:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a3df400/0x48868a4e4395199b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354002 expref: 17 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.887157:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a3df400/0x48868a4e4395199b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354002 expref: 17 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.887167:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a3df400/0x48868a4e4395199b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354002 expref: 17 pid: 3624 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746129801.887178:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.887190:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949053815168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (89us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.887194:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6981 00000100:00100000:0.0:1746129801.887280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.887501:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129801.888144:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888150:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888162:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888168:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888174:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888179:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f981400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129801.888182:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888187:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888196:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.888201:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f981400/0x48868a4e43951a5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.888245:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949053813504:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 17327us (17937us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.888250:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14158 00000100:00100000:0.0:1746129801.892276:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.906666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.914378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.923527:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.923556:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10695 00000100:00100000:0.0:1746129801.923669:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:30963:x1830949053817216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.923687:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.923702:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76c00/0x48868a4e43951a7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354080 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.923887:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76000/0x48868a4e43951a89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129801.923896:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76000/0x48868a4e43951a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129801.923904:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76000/0x48868a4e43951a89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129801.923917:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5200/0x48868a4e43951a90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129801.923921:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5200/0x48868a4e43951a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129801.923925:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5200/0x48868a4e43951a90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129801.927815:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053817856:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129801.927844:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e43951a82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129801.927877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.927894:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053817344 00000100:00100000:0.0:1746129801.927898:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053817344 00010000:00010000:0.0:1746129801.927919:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5800/0x48868a4e439517a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef1 expref: 26 pid: 1851 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.927950:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6987 00000100:00100000:0.0:1746129801.928296:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949053817344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.928309:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.928316:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5800/0x48868a4e439517a3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef1 expref: 26 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.928324:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5800/0x48868a4e439517a3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef1 expref: 26 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.928340:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801348e5800/0x48868a4e439517a3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353ef1 expref: 26 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.928354:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129801.928358:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e43951a82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.928365:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.928397:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053817344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 441us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.928402:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6987 00000100:00100000:0.0:1746129801.928428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.928439:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053817600 00000100:00100000:0.0:1746129801.928441:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053817600 00010000:00010000:0.0:1746129801.928450:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136364600/0x48868a4e43951511 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d93 expref: 300 pid: 1851 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746129801.928481:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6988 00000100:00100000:0.0:1746129801.928487:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1962:x1830949053817600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129801.928492:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129801.928495:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136364600/0x48868a4e43951511 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d93 expref: 300 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.928503:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136364600/0x48868a4e43951511 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d93 expref: 300 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.929742:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136364600/0x48868a4e43951511 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf353d93 expref: 299 pid: 1851 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746129801.929750:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129801.929753:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e43951a82 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.929758:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129801.929773:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949053817600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1286us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.929778:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6988 00010000:00010000:0.0:1746129801.930893:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e43951a82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129801.930899:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e43951a82 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000040:00080000:0.0:1746129801.931400:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3296, 88 off276760 00000004:00080000:0.0:1746129801.931407:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 747989558276ns, next at 731767308185ns, rc = 0 00000100:00100000:0.0:1746129801.935508:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053817984 00000100:00100000:0.0:1746129801.935516:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053817984 00000100:00100000:0.0:1746129801.935548:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14162 00000100:00100000:0.0:1746129801.935555:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:30957:x1830949053817984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.935568:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.935585:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095351000/0x48868a4e43951a97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354087 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129801.935603:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d38a, atime: 0x6813d38a, ctime: 0x6813d38a, blocks: 0x1029 00010000:00010000:0.0:1746129801.935621:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.935623:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.935629:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095351000/0x48868a4e43951a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354087 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.935642:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095351000/0x48868a4e43951a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354087 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.935651:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095351000, rc 0) 00000100:00100000:0.0:1746129801.935684:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:30957:x1830949053817984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 130us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.935690:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14162 00000001:00080000:0.0:1746129801.962913:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944632 is committed 00000004:00080000:0.0:1746129801.962977:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2503 committed 00000004:00080000:0.0:1746129801.962984:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2479 committed 00000004:00080000:0.0:1746129801.962989:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2478 committed 00000004:00080000:0.0:1746129801.962990:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2477 committed 00000004:00080000:0.0:1746129801.962993:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2476 committed 00000004:00080000:0.0:1746129801.962994:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2502 committed 00000004:00080000:0.0:1746129801.962996:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2475 committed 00000004:00080000:0.0:1746129801.962997:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2501 committed 00000004:00080000:0.0:1746129801.963002:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2474 committed 00000004:00080000:0.0:1746129801.963004:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2500 committed 00000004:00080000:0.0:1746129801.963005:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2499 committed 00000004:00080000:0.0:1746129801.963007:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2498 committed 00000004:00080000:0.0:1746129801.963008:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2473 committed 00000004:00080000:0.0:1746129801.963009:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2472 committed 00000004:00080000:0.0:1746129801.963010:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2497 committed 00000004:00080000:0.0:1746129801.963011:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2496 committed 00000004:00080000:0.0:1746129801.963013:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2471 committed 00000001:00080000:0.0:1746129801.963020:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944627 is committed 00000001:00080000:0.0:1746129801.963024:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944620 is committed 00000001:00080000:0.0:1746129801.963049:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944624 is committed 00000001:00080000:0.0:1746129801.963069:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944629 is committed 00000001:00080000:0.0:1746129801.963073:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944628 is committed 00000100:00100000:0.0:1746129801.963147:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053818368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963184:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963212:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053819008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963226:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963235:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053819392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.963246:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963259:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053819904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.963269:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963282:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053818112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963295:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963303:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053818624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963322:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963331:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053819136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.963342:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963350:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053819648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.963361:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963371:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129801.963375:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053818240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963389:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963398:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053818752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963409:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963416:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053819264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963426:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963431:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053819776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.963441:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.963456:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14163 00000100:00100000:0.0:1746129801.963461:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949053818368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129801.963597:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129801.963600:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129802 -> 1746129802 00002000:00010000:0.0:1746129801.963602:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129802 -> 1746129802 00002000:00010000:0.0:1746129801.963604:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129802 -> 1746129802 00002000:00010000:0.0:1746129801.963606:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129801.963620:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949053818368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (436us total) trans 17179873851 rc 0/0 00000100:00100000:0.0:1746129801.963624:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14163 00000100:00100000:0.0:1746129801.963631:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14167 00000100:00100000:0.0:1746129801.963635:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1830949053818112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.963701:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949053818112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (405us total) trans 17179873852 rc 0/0 00000100:00100000:0.0:1746129801.963705:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14167 00000100:00100000:0.0:1746129801.963713:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14169 00000100:00100000:0.0:1746129801.963717:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3296:x1830949053819136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129801.963775:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4896768 -> 4896768 00002000:00010000:0.0:1746129801.963778:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129802 -> 1746129802 00002000:00010000:0.0:1746129801.963779:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129801 -> 1746129801 00002000:00010000:0.0:1746129801.963781:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129802 -> 1746129802 00002000:00010000:0.0:1746129801.963783:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5541 -> 5541 00000100:00100000:0.0:1746129801.963795:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+19:3296:x1830949053819136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (452us total) trans 21474841027 rc 0/0 00000100:00100000:0.0:1746129801.963801:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14169 00000100:00100000:0.0:1746129801.963809:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14171 00000100:00100000:0.0:1746129801.963813:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3296:x1830949053818240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129801.965343:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053818240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1529us (1953us total) trans 17179873858 rc 0/0 00000100:00100000:0.0:1746129801.965348:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14171 00000100:00100000:0.0:1746129801.966319:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053820160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.966344:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129801.966366:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053820160 00000100:00100000:0.0:1746129801.966371:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053820160 00000100:00100000:0.0:1746129801.966390:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14179 00000100:00100000:0.0:1746129801.966395:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053820160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129801.966495:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3299:x1830949053820160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (149us total) trans 21474841033 rc 0/0 00000100:00100000:0.0:1746129801.966500:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14179 00000100:00100000:0.0:1746129801.967190:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.967216:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.967243:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.968100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.975549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.976250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.978766:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053819264 00000100:00100000:0.0:1746129801.978770:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053819264 00000100:00100000:0.0:1746129801.978787:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053819392 00000100:00100000:0.0:1746129801.978789:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053819392 00000100:00100000:0.0:1746129801.978799:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053819520 00000100:00100000:0.0:1746129801.978800:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053819520 00000100:00100000:0.0:1746129801.978810:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053819648 00000100:00100000:0.0:1746129801.978812:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053819648 00000100:00100000:0.0:1746129801.978821:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053819776 00000100:00100000:0.0:1746129801.978823:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053819776 00000100:00100000:0.0:1746129801.978834:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14180 00000100:00100000:0.0:1746129801.978839:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949053819264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.978866:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.978877:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b66a00/0x48868a4e43951af9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3540b8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129801.978894:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d389, atime: 0x6813d389, ctime: 0x6813d389, blocks: 0x821 00010000:00010000:0.0:1746129801.978906:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.978907:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.978914:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66a00/0x48868a4e43951af9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540b8 expref: 30 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.978927:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b66a00/0x48868a4e43951af9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540b8 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.978935:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66a00, rc 0) 00000100:00100000:0.0:1746129801.978955:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949053819264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 116us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.978960:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14180 00000100:00100000:0.0:1746129801.978971:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14182 00000100:00100000:0.0:1746129801.978976:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949053819520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129801.979760:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.979768:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43951b1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3540c6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129801.979780:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d38a, atime: 0x6813d38a, ctime: 0x6813d38a, blocks: 0x821 00010000:00010000:0.0:1746129801.979788:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.979790:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.979794:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43951b1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540c6 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.979804:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43951b1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540c6 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.979811:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66200, rc 0) 00000100:00100000:0.0:1746129801.979829:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949053819520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 852us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.979834:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14182 00000100:00100000:0.0:1746129801.980343:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.980598:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.980623:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.980880:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.981338:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14190 00000100:00100000:0.0:1746129801.981344:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949053820288:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129801.981351:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129801.981357:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43951b3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3540f0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.981368:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.981369:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.981373:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43951b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540f0 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.981382:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43951b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540f0 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129801.981389:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67c00, rc 0) 00000100:00100000:0.0:1746129801.981669:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949053820288:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 324us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129801.981674:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14190 00000100:00100000:0.0:1746129801.997792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.997834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.997888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.998134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.998399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129801.998432:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053820800 00000100:00100000:0.0:1746129801.998440:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053820800 00002000:00100000:0.0:1746129801.998491:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880130506d80 x1830949053820800/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:542/0 lens 488/0 e 0 to 0 dl 1746129812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129801.998501:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949053820800 ext(3145728->4194303) 00002000:00010000:0.0:1746129801.998505:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506d80 00000100:00100000:0.0:1746129801.998520:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6213 00000100:00100000:0.0:1746129801.998526:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949053821312:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129801.998558:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135b67000/0x48868a4e43951b4d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.998569:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.998571:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.998574:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67000/0x48868a4e43951b4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.998585:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67000/0x48868a4e43951b4d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129801.998696:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6217 00000100:00100000:0.0:1746129801.998701:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949053821696:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129801.998712:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.998718:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.998719:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129801.998721:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129801.998727:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129802.009586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.009610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.009621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.009645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.018983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.019018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.019038:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.019052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.019064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129802.019320:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019331:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019338:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019343:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b67600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129802.019347:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019353:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019367:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019372:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43951b5b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129802.019408:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949053821696:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 20706us (21009us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129802.019418:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6217 00000100:00100000:0.0:1746129802.019432:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6222 00000100:00100000:0.0:1746129802.019437:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949053823232:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129802.019457:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4c5a400/0x48868a4e43951b69 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.019466:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.019467:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.022808:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4c5a400/0x48868a4e43951b69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.023749:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4c5a400/0x48868a4e43951b69 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129802.044760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.044805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.044825:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053824512 00000100:00100000:0.0:1746129802.044832:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053824512 00010000:00010000:0.0:1746129802.044889:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76000/0x48868a4e43951aeb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540aa expref: 8 pid: 14314 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746129802.044908:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053824768 00000100:00100000:0.0:1746129802.044910:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053824768 00010000:00010000:0.0:1746129802.044918:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981600/0x48868a4e43951a9e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35408e expref: 8 pid: 14315 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746129802.044930:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6993 00000100:00100000:0.0:1746129802.044936:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949053824512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129802.044946:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129802.044950:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76000/0x48868a4e43951aeb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540aa expref: 8 pid: 14314 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.044959:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8c76000/0x48868a4e43951aeb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540aa expref: 8 pid: 14314 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.044977:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129802.044982:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.044988:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.044993:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129802.045027:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949053824512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.045032:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6993 00000100:00100000:0.0:1746129802.045045:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6994 00000100:00100000:0.0:1746129802.045049:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949053824768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129802.045055:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129802.045058:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981600/0x48868a4e43951a9e lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35408e expref: 8 pid: 14315 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.046192:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981600/0x48868a4e43951a9e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35408e expref: 8 pid: 14315 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.046203:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981600/0x48868a4e43951a9e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35408e expref: 8 pid: 14315 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.046215:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129802.046218:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.046224:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.046228:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.046240:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129802.046259:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949053824768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1209us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.046263:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6994 00000100:00100000:0.0:1746129802.062093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.062121:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053824896 00000100:00100000:0.0:1746129802.062129:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053824896 00000100:00100000:0.0:1746129802.062164:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10704 00000100:00100000:0.0:1746129802.062171:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:30957:x1830949053824896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129802.062187:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129802.062204:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130e3f000/0x48868a4e43951bb6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354113 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.062250:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.062258:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130e3f000/0x48868a4e43951bb6 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354113 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.062274:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129802.062283:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130e3f000/0x48868a4e43951bb6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354113 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.062293:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129802.062295:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129802.062298:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880130e3f000/0x48868a4e43951bb6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354113 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.062304:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e3f000, rc 0) 00000100:00100000:0.0:1746129802.062346:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:30957:x1830949053824896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 174us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.062352:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10704 00000100:00100000:0.0:1746129802.094721:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053825280 00000100:00100000:0.0:1746129802.094727:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053825280 00000100:00100000:0.0:1746129802.109877:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053825792 00000100:00100000:0.0:1746129802.109882:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053825792 00000100:00100000:0.0:1746129802.109918:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10708 00000100:00100000:0.0:1746129802.109924:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:30960:x1830949053825792:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129802.109939:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129802.109949:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951bd2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354128 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.109985:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354128 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.109999:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354128 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.110010:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129802.110013:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129802.110014:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7c00, rc 0) 00000100:00100000:0.0:1746129802.110051:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:30960:x1830949053825792:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 128us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.110056:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10708 00000100:00100000:0.0:1746129802.113119:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.113169:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.118721:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.118757:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.118783:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119519:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119535:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119546:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119555:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119565:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119580:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.119591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.120720:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.120735:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.120775:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.125366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.125413:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053823232:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129802.125425:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0abe00/0x48868a4e43951bd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354136 expref: 20 pid: 4589 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.125440:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053823360:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129802.125449:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800945cfa00/0x48868a4e43951b15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540b1 expref: 17 pid: 8435 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.125455:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053823488:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129802.125486:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929da000/0x48868a4e43951be0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [413696->700415] (req 413696->700415) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35412f expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.125496:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929da000, rc 0) 00000100:00100000:0.0:1746129802.125524:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:30967:x1830949053826944:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5527us (5967us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.125530:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14216 00000100:00100000:0.0:1746129802.126898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.129693:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.129733:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.130286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.135778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.140909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.143430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.143463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.143508:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.161940:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.166050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.167590:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.178240:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.184569:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.192598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.193220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.193993:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6234 00000100:00100000:0.0:1746129802.193999:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949053832448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129802.227456:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.243078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.250743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.253260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.261370:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.270380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.274779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.274816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.274845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.274904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.274918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.274941:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.275938:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14227 00000100:00100000:0.0:1746129802.275945:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949053834880:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129802.275962:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.275971:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095351000/0x48868a4e43951a97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354087 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.275982:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129802.275988:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b69ac00/0x48868a4e43951b0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540d4 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129802.275993:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.275994:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.275997:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.276012:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b69ac00/0x48868a4e43951b0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540d4 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129802.276019:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b69ac00/0x48868a4e43951b0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540d4 expref: 29 pid: 8435 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.276026:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053825920:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129802.276050:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129802.276057:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 13 pid: 7976 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.276063:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053826048:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129802.276081:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095351000/0x48868a4e43951a97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354087 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.276087:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095351000/0x48868a4e43951a97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354087 expref: 15 pid: 8435 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746129802.276092:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053826176:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129802.276102:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129802.282547:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053825920:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129802.282581:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053826048:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129802.282597:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053826176:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129802.282617:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129802.282648:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.282693:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.283757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.283772:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053835264 00000100:00100000:0.0:1746129802.283775:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053835264 00010000:00010000:0.0:1746129802.283787:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0aa800/0x48868a4e43951be7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354144 expref: 16 pid: 4589 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.284103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.284551:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053835904 00000100:00100000:0.0:1746129802.284555:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053835904 00010000:00010000:0.0:1746129802.284566:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801348e5200/0x48868a4e43951b00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540bf expref: 31 pid: 8435 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.284577:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053836416 00000100:00100000:0.0:1746129802.284579:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053836416 00010000:00010000:0.0:1746129802.284587:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 14 pid: 7976 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.284595:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053836800 00000100:00100000:0.0:1746129802.284596:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053836800 00010000:00010000:0.0:1746129802.284603:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801348e4a00/0x48868a4e43951b07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540cd expref: 20 pid: 8435 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746129802.284613:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7004 00000100:00100000:0.0:1746129802.284618:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949053836032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129802.284625:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129802.284636:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43951b3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540f0 expref: 14 pid: 10930 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.284643:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43951b3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540f0 expref: 14 pid: 10930 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.284655:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43951b3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540f0 expref: 14 pid: 10930 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.285210:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129802.285230:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053836032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 610us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.285236:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7004 00000100:00100000:0.0:1746129802.285248:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7011 00000100:00100000:0.0:1746129802.285253:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949053836416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129802.285260:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129802.285267:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 12 pid: 7976 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.285275:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 12 pid: 7976 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.285286:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094da2a00/0x48868a4e43951b46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540fe expref: 12 pid: 7976 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.285293:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129802.285306:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053836416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.285310:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7011 00000100:00100000:0.0:1746129802.285319:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7012 00000100:00100000:0.0:1746129802.285323:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949053836672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129802.285329:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129802.288970:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43951b1c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540c6 expref: 18 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.288983:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43951b1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540c6 expref: 18 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.288998:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43951b1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3540c6 expref: 18 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746129802.289008:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.289010:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.289013:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43951c6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289019:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a149600/0x48868a4e43951c6c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289038:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289045:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289062:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289068:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289074:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289079:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f981e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129802.289082:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289092:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289100:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.289105:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f981e00/0x48868a4e43951c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129802.289159:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949053834880:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 13214us (14216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.289165:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14227 00010000:00010000:0.0:1746129802.289196:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129802.289216:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949053836672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3892us (4891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.289222:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7012 00000100:00100000:0.0:1746129802.297265:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.300454:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.303344:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.303366:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.303405:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.303596:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7019 00000100:00100000:0.0:1746129802.303602:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1961:x1830949053837696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129802.303608:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129802.303611:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35410c expref: 286 pid: 15044 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.303660:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35410c expref: 286 pid: 15044 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.303673:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f981800/0x48868a4e43951ba8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35410c expref: 286 pid: 15044 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746129802.303737:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129802.303739:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129802.303751:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1961:x1830949053837696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 150us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.303754:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7019 00000100:00100000:0.0:1746129802.326935:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053826688 00000100:00100000:0.0:1746129802.326941:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053826688 00000100:00100000:0.0:1746129802.326966:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14228 00000100:00100000:0.0:1746129802.326971:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053826688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129802.327269:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053826688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 298us (610us total) trans 17179873870 rc 0/0 00000100:00100000:0.0:1746129802.327274:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14228 00000100:00100000:0.0:1746129802.327284:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14230 00000100:00100000:0.0:1746129802.327287:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3297:x1830949053827072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129802.327355:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053827072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (637us total) trans 17179873872 rc 0/0 00000100:00100000:0.0:1746129802.328252:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14230 00000100:00100000:0.0:1746129802.328536:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053828096 00000100:00100000:0.0:1746129802.328540:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053828096 00000100:00100000:0.0:1746129802.328568:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14240 00000100:00100000:0.0:1746129802.328573:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949053828096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129802.328742:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053828096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (244us total) trans 21474841053 rc 0/0 00000100:00100000:0.0:1746129802.328749:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14240 00000100:00100000:0.0:1746129802.328903:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053827712 00000100:00100000:0.0:1746129802.328907:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053827712 00000100:00100000:0.0:1746129802.329139:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14243 00000100:00100000:0.0:1746129802.329151:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053828224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129802.329232:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053828224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (482us total) trans 21474841055 rc 0/0 00000100:00100000:0.0:1746129802.329237:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14243 00000004:00080000:0.0:1746129802.329287:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a5f80/2, rc 0, transno 21474841053 00000100:00100000:0.0:1746129802.329290:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053828096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129802.329408:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746129802.329415:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053828736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129802.329499:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129802.329564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:0.0:1746129802.329614:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7100/2, rc 0, transno 21474841056 00000100:00100000:0.0:1746129802.329618:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053828736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129802.336004:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053837952 00000100:00100000:0.0:1746129802.336012:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053837952 00000100:00100000:0.0:1746129802.336044:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10714 00000100:00100000:0.0:1746129802.336051:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:30974:x1830949053837952:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129802.336066:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129802.336082:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43951c88 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35417c expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.336144:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f980e00/0x48868a4e43951c8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129802.336155:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f980e00/0x48868a4e43951c8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129802.336164:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f980e00/0x48868a4e43951c8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129802.336182:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:0.0:1746129802.336186:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129802.336196:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f980e00/0x48868a4e43951c8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129802.336214:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43951c88 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35417c expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.336226:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f980e00/0x48868a4e43951c8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35417c expref: 9 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129802.336232:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129802.336235:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129802.336238:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f980e00, rc 0) 00000100:00100000:0.0:1746129802.336287:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:30974:x1830949053837952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 236us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.336292:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10714 00000100:00100000:0.0:1746129802.339757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.339962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129802.343955:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053838464 00000100:00100000:0.0:1746129802.343960:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053838464 00000100:00100000:0.0:1746129802.343991:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14247 00000100:00100000:0.0:1746129802.343997:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053838592:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129802.344010:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129802.344023:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b74c000/0x48868a4e43951ca4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35419f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129802.344040:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4896768, mtime: 0x6813d38a, atime: 0x6813d38a, ctime: 0x6813d38a, blocks: 0x15a5 00010000:00010000:0.0:1746129802.344052:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.344053:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129802.344061:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b74c000/0x48868a4e43951ca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35419f expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129802.344073:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b74c000/0x48868a4e43951ca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35419f expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129802.344080:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b74c000, rc 0) 00000100:00100000:0.0:1746129802.344117:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949053838592:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 120us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129802.344126:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14247 00000100:00100000:0.0:1746129803.364775:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.364812:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.364841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.364904:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.364933:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053839232 00000100:00100000:0.0:1746129803.364936:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053839232 00000100:00100000:0.0:1746129803.364964:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053839744 00000100:00100000:0.0:1746129803.364966:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053839744 00000100:00100000:0.0:1746129803.365044:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6238 00000100:00100000:0.0:1746129803.365049:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949053839232:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129803.365065:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800b52eb200/0x48868a4e43951cc7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.365074:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.365075:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.365078:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b52eb200/0x48868a4e43951cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.365086:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b52eb200/0x48868a4e43951cc7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129803.373590:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.373619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.374687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.376883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.377574:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053840128 00000100:00100000:0.0:1746129803.377579:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053840128 00000100:00100000:0.0:1746129803.377650:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053840640 00000100:00100000:0.0:1746129803.377652:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053840640 00000100:00100000:0.0:1746129803.449237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.452645:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.454962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.479142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.488382:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129803.492467:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129803.498930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.498960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.498982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.498993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.499002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.499031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.499059:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842176 00000100:00100000:0.0:1746129803.499066:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842176 00000100:00100000:0.0:1746129803.499092:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842432 00000100:00100000:0.0:1746129803.499094:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842432 00000100:00100000:0.0:1746129803.499102:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842688 00000100:00100000:0.0:1746129803.499103:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842688 00000100:00100000:0.0:1746129803.499110:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842048 00000100:00100000:0.0:1746129803.499111:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842048 00000100:00100000:0.0:1746129803.499118:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842304 00000100:00100000:0.0:1746129803.499119:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842304 00000100:00100000:0.0:1746129803.499125:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842560 00000100:00100000:0.0:1746129803.499127:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842560 00000100:00100000:0.0:1746129803.499136:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14251 00000100:00100000:0.0:1746129803.499141:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949053842176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.499155:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.499170:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3fe00/0x48868a4e43951d3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541c2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.499189:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499191:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499198:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3fe00/0x48868a4e43951d3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541c2 expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499211:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3fe00/0x48868a4e43951d3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541c2 expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499223:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3fe00, rc 0) 00000100:00100000:0.0:1746129803.499254:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949053842176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.499259:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14251 00000100:00100000:0.0:1746129803.499269:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14252 00000100:00100000:0.0:1746129803.499273:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949053842432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.499278:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.499285:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f800/0x48868a4e43951d45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541d0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.499292:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499293:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499296:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f800/0x48868a4e43951d45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d0 expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499304:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f800/0x48868a4e43951d45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d0 expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499309:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f800, rc 0) 00000100:00100000:0.0:1746129803.499318:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949053842432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.499322:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14252 00000100:00100000:0.0:1746129803.499328:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14253 00000100:00100000:0.0:1746129803.499331:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949053842688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.499337:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.499341:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3e400/0x48868a4e43951d4c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541de expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.499347:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499348:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499351:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3e400/0x48868a4e43951d4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541de expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499359:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3e400/0x48868a4e43951d4c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541de expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499364:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3e400, rc 0) 00000100:00100000:0.0:1746129803.499371:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949053842688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 40us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.499375:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14253 00000100:00100000:0.0:1746129803.499380:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14254 00000100:00100000:0.0:1746129803.499383:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949053842048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.499387:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.499390:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541bb expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.499397:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499398:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499401:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541bb expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499407:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541bb expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499413:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3e200, rc 0) 00000100:00100000:0.0:1746129803.499422:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949053842048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 38us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.499425:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14254 00000100:00100000:0.0:1746129803.499431:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14255 00000100:00100000:0.0:1746129803.499435:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949053842304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.499439:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.499454:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3e800/0x48868a4e43951d5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541c9 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.499462:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499463:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499466:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3e800/0x48868a4e43951d5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541c9 expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499473:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3e800/0x48868a4e43951d5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541c9 expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499478:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3e800, rc 0) 00000100:00100000:0.0:1746129803.499490:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949053842304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 54us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.499493:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14255 00000100:00100000:0.0:1746129803.499500:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14256 00000100:00100000:0.0:1746129803.499504:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949053842560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.499510:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.499514:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f400/0x48868a4e43951d61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541d7 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.499520:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499521:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.499524:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f400/0x48868a4e43951d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d7 expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499530:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f400/0x48868a4e43951d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d7 expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.499535:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f400, rc 0) 00000100:00100000:0.0:1746129803.499544:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949053842560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 40us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.499547:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14256 00000100:00100000:0.0:1746129803.510437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.518336:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.519582:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.519611:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.519976:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520042:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520083:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053844352 00000100:00100000:0.0:1746129803.520086:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053844352 00000100:00100000:0.0:1746129803.520107:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14257 00000100:00100000:0.0:1746129803.520112:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949053844352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.520121:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.520131:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541f3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.520145:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520147:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520153:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541f3 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520164:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541f3 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520177:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3e000, rc 0) 00000100:00100000:0.0:1746129803.520197:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949053844352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 84us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.520202:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14257 00000100:00100000:0.0:1746129803.520232:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520250:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053844480 00000100:00100000:0.0:1746129803.520253:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053844480 00000100:00100000:0.0:1746129803.520275:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14258 00000100:00100000:0.0:1746129803.520279:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949053844480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.520285:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.520293:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e43951d92 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3541fa expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.520303:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520304:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520308:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e43951d92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541fa expref: 28 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520317:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ee00/0x48868a4e43951d92 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541fa expref: 28 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520323:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ee00, rc 0) 00000100:00100000:0.0:1746129803.520338:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949053844480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 59us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.520343:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14258 00000100:00100000:0.0:1746129803.520385:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520395:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053844608 00000100:00100000:0.0:1746129803.520398:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053844608 00000100:00100000:0.0:1746129803.520410:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14259 00000100:00100000:0.0:1746129803.520413:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949053844608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.520419:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.520425:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f000/0x48868a4e43951d99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354201 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.520433:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520434:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520438:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f000/0x48868a4e43951d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354201 expref: 29 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520458:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f000/0x48868a4e43951d99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354201 expref: 29 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520464:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f000, rc 0) 00000100:00100000:0.0:1746129803.520479:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949053844608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.520483:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14259 00000100:00100000:0.0:1746129803.520510:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520519:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053844736 00000100:00100000:0.0:1746129803.520522:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053844736 00000100:00100000:0.0:1746129803.520534:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14260 00000100:00100000:0.0:1746129803.520538:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949053844736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.520543:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.520549:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f600/0x48868a4e43951da0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354208 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.520557:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520558:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520562:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f600/0x48868a4e43951da0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354208 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520569:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f600/0x48868a4e43951da0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354208 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520575:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f600, rc 0) 00000100:00100000:0.0:1746129803.520588:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949053844736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.520593:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14260 00000100:00100000:0.0:1746129803.520624:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520635:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053844864 00000100:00100000:0.0:1746129803.520638:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053844864 00000100:00100000:0.0:1746129803.520649:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14261 00000100:00100000:0.0:1746129803.520652:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949053844864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.520668:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.520674:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fc00/0x48868a4e43951da7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35420f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.520686:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520687:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520691:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fc00/0x48868a4e43951da7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35420f expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520699:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fc00/0x48868a4e43951da7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35420f expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520705:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3fc00, rc 0) 00000100:00100000:0.0:1746129803.520718:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053844864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.520723:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14261 00000100:00100000:0.0:1746129803.520769:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.520780:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053844992 00000100:00100000:0.0:1746129803.520783:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053844992 00000100:00100000:0.0:1746129803.520794:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14262 00000100:00100000:0.0:1746129803.520798:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949053844992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.520803:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.520809:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f200/0x48868a4e43951dae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354216 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.520818:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520819:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.520822:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f200/0x48868a4e43951dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354216 expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520831:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3f200/0x48868a4e43951dae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354216 expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.520837:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3f200, rc 0) 00000100:00100000:0.0:1746129803.520865:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949053844992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 66us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.520869:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14262 00000100:00100000:0.0:1746129803.528478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.541406:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949053843584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21365us (21826us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129803.541416:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6245 00002000:00100000:0.0:1746129803.541427:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012ba39f80 x1830949053843584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:544/0 lens 488/440 e 0 to 0 dl 1746129814 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.541435:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39f80 with x1830949053843584 ext(1048576->2097151) 00002000:00010000:0.0:1746129803.543250:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39f80 00000100:00100000:0.0:1746129803.546608:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.546641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.546668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.546685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.547245:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053845760 00000100:00100000:0.0:1746129803.547251:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053845760 00002000:00100000:0.0:1746129803.547285:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009faf6300 x1830949053845760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.547293:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf6300 with x1830949053845760 ext(1048576->2097151) 00002000:00010000:0.0:1746129803.547298:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf6300 00000100:00100000:0.0:1746129803.547311:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053846144 00000100:00100000:0.0:1746129803.547314:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053846144 00002000:00100000:0.0:1746129803.547325:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009faf5880 x1830949053846144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.547331:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf5880 with x1830949053846144 ext(0->1048575) 00002000:00010000:0.0:1746129803.547333:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf5880 00000100:00100000:0.0:1746129803.547352:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6249 00000100:00100000:0.0:1746129803.547360:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949053845760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129803.593336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.598873:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10719 00000100:00100000:0.0:1746129803.598888:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:30986:x1830949053846528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129803.598911:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.598929:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43951dbc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35421d expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.598981:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43951dbc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35421d expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.598993:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43951dbc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35421d expref: 10 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.599008:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129803.599011:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129803.599014:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef800, rc 0) 00000100:00100000:0.0:1746129803.599084:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:30986:x1830949053846528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 202us (5758us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129803.599090:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10719 00000100:00100000:0.0:1746129803.655171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.655232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.655277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.655336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.655380:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053847040 00000100:00100000:0.0:1746129803.655390:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053847040 00002000:00100000:0.0:1746129803.655432:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faf4e00 x1830949053847040/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.655453:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf4e00 with x1830949053847040 ext(2097152->3145727) 00002000:00010000:0.0:1746129803.655458:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf4e00 00000100:00100000:0.0:1746129803.655472:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053847168 00000100:00100000:0.0:1746129803.655474:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053847168 00002000:00100000:0.0:1746129803.655484:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faf6680 x1830949053847168/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.655490:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf6680 with x1830949053847168 ext(3145728->4194303) 00002000:00010000:0.0:1746129803.655492:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf6680 00000100:00100000:0.0:1746129803.655499:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053846912 00000100:00100000:0.0:1746129803.655500:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053846912 00002000:00100000:0.0:1746129803.655509:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009faf5180 x1830949053846912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.655515:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf5180 with x1830949053846912 ext(2097152->3145727) 00002000:00010000:0.0:1746129803.655518:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf5180 00000100:00100000:0.0:1746129803.655529:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053847424 00000100:00100000:0.0:1746129803.655532:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053847424 00002000:00100000:0.0:1746129803.655546:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faf7100 x1830949053847424/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.655553:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf7100 with x1830949053847424 ext(3145728->4194303) 00002000:00010000:0.0:1746129803.655556:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf7100 00000100:00100000:0.0:1746129803.655573:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6253 00000100:00100000:0.0:1746129803.655581:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949053847040:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129803.656969:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6254 00000100:00100000:0.0:1746129803.656976:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949053847168:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129803.685880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.686059:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.686081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.686104:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053848320 00000100:00100000:0.0:1746129803.686112:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053848320 00002000:00100000:0.0:1746129803.686146:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009a04ce00 x1830949053848320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.686156:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ce00 with x1830949053848320 ext(2097152->3145727) 00002000:00010000:0.0:1746129803.686161:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ce00 00000100:00100000:0.0:1746129803.686179:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053848576 00000100:00100000:0.0:1746129803.686182:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053848576 00002000:00100000:0.0:1746129803.686199:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009a04fb80 x1830949053848576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.686207:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949053848576 ext(3145728->4194303) 00002000:00010000:0.0:1746129803.686210:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04fb80 00000100:00100000:0.0:1746129803.686225:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6258 00000100:00100000:0.0:1746129803.686234:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949053848320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129803.687297:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6259 00000100:00100000:0.0:1746129803.687303:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949053848576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129803.751699:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.762499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.762600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.766499:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053849472 00000100:00100000:0.0:1746129803.766506:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053849472 00002000:00100000:0.0:1746129803.766540:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88008fad3b80 x1830949053849472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:544/0 lens 488/0 e 0 to 0 dl 1746129814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129803.766548:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3b80 with x1830949053849472 ext(4194304->4898815) 00002000:00010000:0.0:1746129803.766553:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3b80 00000100:00100000:0.0:1746129803.766569:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6262 00000100:00100000:0.0:1746129803.766575:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949053849472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129803.771210:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053829248:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129803.771219:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053829376:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129803.773571:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053829504:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129803.773601:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43951dd1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129803.774247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129803.774777:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43951dd1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129803.774784:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43951dd1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000040:00080000:0.0:1746129803.775431:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3324, 88 off279232 00000004:00080000:0.0:1746129803.775450:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749833602071ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.775489:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3351, 88 off281520 00000004:00080000:0.0:1746129803.775493:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749833644976ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.775505:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3352, 88 off281608 00000004:00080000:0.0:1746129803.775508:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749833659643ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.775514:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3325, 88 off279320 00000004:00080000:0.0:1746129803.780610:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838760561ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780665:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3326, 88 off279408 00000004:00080000:0.0:1746129803.780668:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838820206ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780685:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3353, 88 off281696 00000004:00080000:0.0:1746129803.780688:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749838839954ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.780699:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3354, 88 off281784 00000004:00080000:0.0:1746129803.780701:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749838853363ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.780709:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3355, 88 off281872 00000004:00080000:0.0:1746129803.780711:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749838863193ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.780718:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3327, 88 off279496 00000004:00080000:0.0:1746129803.780720:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838872338ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780727:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3356, 88 off281960 00000004:00080000:0.0:1746129803.780729:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749838881058ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.780735:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3328, 88 off279584 00000004:00080000:0.0:1746129803.780738:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838889801ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780745:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3357, 88 off282048 00000004:00080000:0.0:1746129803.780747:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749838898716ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129803.780753:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3329, 88 off279672 00000004:00080000:0.0:1746129803.780755:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838907276ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780763:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3330, 88 off279760 00000004:00080000:0.0:1746129803.780766:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838918346ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780773:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3331, 88 off279848 00000004:00080000:0.0:1746129803.780776:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838927774ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780782:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3332, 88 off279936 00000004:00080000:0.0:1746129803.780784:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749838936111ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129803.780791:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3358, 88 off282136 00000004:00080000:0.0:1746129803.780793:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 749838945031ns, next at 716792379979ns, rc = 0 00000004:00080000:0.0:1746129803.806554:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1aa00/2, rc 0, transno 17179873884 00000100:00100000:0.0:1746129803.806560:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053830144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.806568:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b480/2, rc 0, transno 17179873883 00000100:00100000:0.0:1746129803.806570:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053830016:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.806576:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19c00/2, rc 0, transno 17179873882 00000100:00100000:0.0:1746129803.806578:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053830528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.806585:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094768000/2, rc 0, transno 21474841062 00000100:00100000:0.0:1746129803.806592:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053831040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129803.806598:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242300/2, rc 0, transno 21474841061 00000100:00100000:0.0:1746129803.806601:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053831552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129803.807143:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053831808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129803.807479:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129803.807503:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1ad80/2, rc 0, transno 17179873880 00000100:00100000:0.0:1746129803.807506:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053829888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.807513:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1a680/2, rc 0, transno 17179873881 00000100:00100000:0.0:1746129803.807515:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053830400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.807521:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094768700/2, rc 0, transno 21474841060 00000100:00100000:0.0:1746129803.807523:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053830912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129803.807528:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8f800/2, rc 0, transno 21474841059 00000100:00100000:0.0:1746129803.807530:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053831424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129803.807536:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18380/2, rc 0, transno 17179873878 00000100:00100000:0.0:1746129803.807538:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053829760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.807544:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18e00/2, rc 0, transno 17179873879 00000100:00100000:0.0:1746129803.807546:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053830272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.807551:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf6d80/2, rc 0, transno 21474841058 00000100:00100000:0.0:1746129803.807553:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053830784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129803.807558:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8ed80/2, rc 0, transno 21474841057 00000100:00100000:0.0:1746129803.807559:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053831296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129803.807588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.807646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:0.0:1746129803.808457:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd46a00/2, rc 0, transno 17179873885 00000100:00100000:0.0:1746129803.808461:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053830656:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129803.808467:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8ce00/2, rc 0, transno 21474841063 00000100:00100000:0.0:1746129803.808470:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053831168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129803.808475:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095243480/2, rc 0, transno 21474841064 00000100:00100000:0.0:1746129803.808477:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053831680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129803.808487:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d180/2, rc 0, transno 21474841065 00000100:00100000:0.0:1746129803.808490:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053831808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129803.809955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.827457:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.827696:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.827778:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.827918:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14281 00000100:00100000:0.0:1746129803.827924:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:30981:x1830949053851008:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129803.827931:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129803.827938:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0046200/0x48868a4e43951ded lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354247 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.827949:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b74c000/0x48868a4e43951ca4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35419f expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.827955:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fc00/0x48868a4e43951da7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35420f expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.827960:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f400/0x48868a4e43951d61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d7 expref: 22 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.827964:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.827964:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129803.827966:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0046200/0x48868a4e43951ded lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3444736->4194303] (req 3444736->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354247 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129803.827977:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f400/0x48868a4e43951d61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d7 expref: 22 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.827988:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f400/0x48868a4e43951d61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541d7 expref: 22 pid: 10930 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746129803.827994:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053832064:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129803.828650:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fc00/0x48868a4e43951da7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35420f expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.828658:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3fc00/0x48868a4e43951da7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35420f expref: 19 pid: 7975 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746129803.828665:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053832448:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129803.828687:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b74c000/0x48868a4e43951ca4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35419f expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129803.828693:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b74c000/0x48868a4e43951ca4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35419f expref: 10 pid: 3624 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746129803.828701:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053832576:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129803.828716:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129803.830817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.830831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.830839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.830870:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.830889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.833409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.835384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.837230:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.844114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.847927:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.848894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.860296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.860830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.863259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.866359:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.869224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.961705:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.972317:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129803.992211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.019429:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.019703:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.019716:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.019733:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053855488 00000100:00100000:0.0:1746129804.019740:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053855488 00002000:00100000:0.0:1746129804.019787:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a5490380 x1830949053855488/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.019796:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949053855488 ext(1048576->2097151) 00002000:00010000:0.0:1746129804.019801:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5490380 00000100:00100000:0.0:1746129804.019815:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053855616 00000100:00100000:0.0:1746129804.019817:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053855616 00002000:00100000:0.0:1746129804.019829:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a5490a80 x1830949053855616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.019841:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490a80 with x1830949053855616 ext(1048576->2097151) 00002000:00010000:0.0:1746129804.019844:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490a80 00000100:00100000:0.0:1746129804.019873:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6269 00000100:00100000:0.0:1746129804.019880:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949053855488:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129804.054059:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053856256 00000100:00100000:0.0:1746129804.054067:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053856256 00000100:00100000:0.0:1746129804.054645:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 694 00000100:00100000:0.0:1746129804.054652:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1963:x1830949053856256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.054661:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.054679:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012edb4200/0x48868a4e43951e41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35426a expref: 288 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.054695:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.054699:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.054720:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1963:x1830949053856256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 69us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.054724:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 694 00000100:00100000:0.0:1746129804.059233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.059593:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.059663:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053833600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129804.059685:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43951e72 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3297280->3420159] (req 3297280->3420159) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354278 expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.059696:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27f000, rc 0) 00000100:00100000:0.0:1746129804.059723:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:30997:x1830949053856384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5240us (5390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.059729:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14285 00000100:00100000:0.0:1746129804.059752:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053856768 00000100:00100000:0.0:1746129804.059755:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053856768 00000100:00100000:0.0:1746129804.059776:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14286 00000100:00100000:0.0:1746129804.059780:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949053856768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.059786:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.059794:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4e00/0x48868a4e43951e9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354286 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.059824:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053833728:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129804.059877:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00080000:0.0:1746129804.059889:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129804.061351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129804.061845:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129804.063829:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053857280 00000100:00100000:0.0:1746129804.063833:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053857280 00000100:00100000:0.0:1746129804.070909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.071028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.086981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.087011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.087026:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.087037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.087049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.087075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.087104:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053858176 00000100:00100000:0.0:1746129804.087107:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053858176 00002000:00100000:0.0:1746129804.087247:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a5491180 x1830949053858176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.087254:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949053858176 ext(0->1048575) 00002000:00010000:0.0:1746129804.087258:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491180 00000100:00100000:0.0:1746129804.087271:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053859200 00000100:00100000:0.0:1746129804.087274:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053859200 00002000:00100000:0.0:1746129804.087288:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800936dca80 x1830949053859200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.087294:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830949053859200 ext(2097152->3145727) 00002000:00010000:0.0:1746129804.087296:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:0.0:1746129804.087308:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6274 00000100:00100000:0.0:1746129804.087314:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949053858432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129804.088312:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6275 00000100:00100000:0.0:1746129804.088318:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949053858944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129804.089366:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6278 00000100:00100000:0.0:1746129804.089372:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949053859200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129804.097557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.097722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.097769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.110348:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.110387:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.110766:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949053858944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22447us (23725us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129804.110774:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6275 00002000:00100000:0.0:1746129804.110783:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800936de680 x1830949053858944/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:545/0 lens 488/440 e 0 to 0 dl 1746129815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.110793:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de680 with x1830949053858944 ext(1048576->2097151) 00002000:00010000:0.0:1746129804.110796:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936de680 00000100:00100000:0.0:1746129804.115580:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.116691:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949053859200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27317us (29613us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129804.116700:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6278 00002000:00100000:0.0:1746129804.116707:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800936dca80 x1830949053859200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/440 e 0 to 0 dl 1746129815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.116714:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830949053859200 ext(2097152->3145727) 00002000:00010000:0.0:1746129804.116717:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:0.0:1746129804.122903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.128220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.128243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.128281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.132992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.135022:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.135050:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.137341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.140353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.140735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.144969:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.151251:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.151293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.152041:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14292 00000100:00100000:0.0:1746129804.152049:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949053862912:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.152056:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.152062:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3542a9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.152073:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.152076:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.152083:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542a9 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.152096:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542a9 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.152103:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094da2e00, rc 0) 00000100:00100000:0.0:1746129804.152133:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801348f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949053862912:12345-192.168.204.31@tcp:101:cat.0 Request processed in 85us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.152138:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14292 00000100:00100000:0.0:1746129804.163828:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.163911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.177408:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.182649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.182695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.183576:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14295 00000100:00100000:0.0:1746129804.183583:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949053863936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.183591:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.183600:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a3dea00/0x48868a4e43951edb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3542c5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.183629:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053835776:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129804.183651:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129804.189754:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.192427:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.210541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.217245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.231950:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.236784:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.245100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.258404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.258451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.258490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.280028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.280080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.288696:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.296017:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.299701:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053866752 00000100:00100000:0.0:1746129804.299708:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053866752 00010000:00010000:0.0:1746129804.299733:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e43951d84 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541ec expref: 15 pid: 1851 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.299753:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7044 00000100:00100000:0.0:1746129804.299759:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949053866752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.299769:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.299774:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e43951d84 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541ec expref: 15 pid: 1851 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.299785:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e43951d84 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541ec expref: 15 pid: 1851 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.299802:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013689e200/0x48868a4e43951d84 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541ec expref: 15 pid: 1851 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.299824:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.299829:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0200/0x48868a4e43951f05 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.299837:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0200/0x48868a4e43951f05 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.299842:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0200/0x48868a4e43951f05 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.299892:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.299921:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949053866752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 162us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.299927:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7044 00000100:00100000:0.0:1746129804.301436:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.309262:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.310582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.310598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.310609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.310620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.310640:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129804.311099:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129804.312973:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.317330:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.326386:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.326481:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.332198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.337689:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.356964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.366946:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.373058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.384000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.388397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.388682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.388750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.388894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.395378:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.395464:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053870976 00000100:00100000:0.0:1746129804.395467:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053870976 00010000:00010000:0.0:1746129804.395484:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43951f91 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35432e expref: 10 pid: 16808 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.395502:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7048 00000100:00100000:0.0:1746129804.395507:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053870976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.395514:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.395518:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43951f91 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35432e expref: 10 pid: 16808 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.395526:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43951f91 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35432e expref: 10 pid: 16808 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.395542:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.395546:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395553:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395558:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395563:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.395567:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.395570:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.395582:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.395599:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053870976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.395604:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7048 00010000:00010000:0.0:1746129804.395654:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43951f91 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35432e expref: 9 pid: 16808 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.395667:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949053837440:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129804.395678:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395684:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395689:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129804.395700:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129804.395789:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395795:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395800:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395805:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb6800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129804.395808:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395813:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395820:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.395822:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129804.395824:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395828:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6800/0x48868a4e43951fbb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395840:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395844:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395865:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395868:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb7c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129804.395870:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395874:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395880:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129804.395882:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129804.395884:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395887:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7c00/0x48868a4e43951fad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395894:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395897:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395901:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395903:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbb7000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129804.395905:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395909:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395917:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8700) 00010000:00010000:0.0:1746129804.395919:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129804.395921:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395925:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43951fb4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129804.395952:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7800/0x48868a4e43951fa6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35433c expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.395958:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7800/0x48868a4e43951fa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35433c expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.395965:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7800, rc 0) 00000100:00100000:0.0:1746129804.395983:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31014:x1830949053870464:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6736us (11990us total) trans 8589944669 rc 301/301 00000100:00100000:0.0:1746129804.395989:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10733 00010000:00010000:0.0:1746129804.396006:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396011:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129804.396018:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129804.396049:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396054:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396062:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396066:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cab800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129804.396068:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396072:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396078:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.396080:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129804.396081:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396085:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab800/0x48868a4e43951fd7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396093:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396097:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396102:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396105:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cab600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129804.396107:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396111:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396119:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129804.396121:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129804.396123:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396127:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab600/0x48868a4e43951fc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396132:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396136:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396140:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396144:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135cab000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129804.396146:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396150:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396154:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8700) 00010000:00010000:0.0:1746129804.396156:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129804.396157:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396161:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135cab000/0x48868a4e43951fd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129804.396180:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135caa000/0x48868a4e43951fc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354343 expref: 292 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.396187:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135caa000/0x48868a4e43951fc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354343 expref: 292 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.396192:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135caa000, rc 0) 00000100:00100000:0.0:1746129804.396205:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31013:x1830949053870848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6594us (7633us total) trans 8589944670 rc 301/301 00000100:00100000:0.0:1746129804.396209:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10734 00000100:00100000:0.0:1746129804.397534:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053837568:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129804.397543:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053837696:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129804.401583:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.401661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.401684:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871104 00000100:00100000:0.0:1746129804.401691:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871104 00010000:00010000:0.0:1746129804.401721:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541bb expref: 23 pid: 10930 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.401757:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871232 00000100:00100000:0.0:1746129804.401760:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871232 00010000:00010000:0.0:1746129804.401769:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b66000/0x48868a4e43951c96 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354183 expref: 14 pid: 1140 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.401783:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7049 00000100:00100000:0.0:1746129804.401789:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949053871104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.401802:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.401820:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541bb expref: 23 pid: 10930 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.401831:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541bb expref: 23 pid: 10930 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.402335:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e200/0x48868a4e43951d53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541bb expref: 23 pid: 10930 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.402356:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.402384:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949053871104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 595us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.402389:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7049 00000100:00100000:0.0:1746129804.404252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.404276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.404291:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871360 00000100:00100000:0.0:1746129804.404296:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871360 00010000:00010000:0.0:1746129804.404315:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e43951f52 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35430b expref: 21 pid: 1140 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.404333:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871488 00000100:00100000:0.0:1746129804.404335:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871488 00010000:00010000:0.0:1746129804.404342:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541f3 expref: 22 pid: 4589 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.404353:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7051 00000100:00100000:0.0:1746129804.404357:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949053871360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.404365:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.404379:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e43951f52 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35430b expref: 22 pid: 1140 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404386:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e43951f52 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35430b expref: 22 pid: 1140 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404399:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6600/0x48868a4e43951f52 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35430b expref: 22 pid: 1140 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404408:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.404445:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949053871360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.404449:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7051 00000100:00100000:0.0:1746129804.404460:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7052 00000100:00100000:0.0:1746129804.404464:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949053871488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.404470:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.404477:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541f3 expref: 20 pid: 4589 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404485:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541f3 expref: 20 pid: 4589 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404494:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e000/0x48868a4e43951d8b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3541f3 expref: 20 pid: 4589 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404501:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.404503:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.404506:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404513:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404527:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.404539:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949053871488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.404544:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7052 00000100:00100000:0.0:1746129804.404565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.404575:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871744 00000100:00100000:0.0:1746129804.404577:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871744 00010000:00010000:0.0:1746129804.404585:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b530a200/0x48868a4e43951f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542e8 expref: 13 pid: 8436 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.404596:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7053 00000100:00100000:0.0:1746129804.404599:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949053871744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.404605:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.404613:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b530a200/0x48868a4e43951f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542e8 expref: 13 pid: 8436 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404620:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b530a200/0x48868a4e43951f2f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542e8 expref: 13 pid: 8436 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404629:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b530a200/0x48868a4e43951f2f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542e8 expref: 13 pid: 8436 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404638:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.404651:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949053871744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.404655:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7053 00000100:00100000:0.0:1746129804.404693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.404703:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871616 00000100:00100000:0.0:1746129804.404705:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871616 00010000:00010000:0.0:1746129804.404714:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542a9 expref: 34 pid: 8436 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.404726:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7054 00000100:00100000:0.0:1746129804.404730:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053871616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.404736:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.404742:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542a9 expref: 34 pid: 8436 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404748:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542a9 expref: 34 pid: 8436 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404756:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094da2e00/0x48868a4e43951ec6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542a9 expref: 34 pid: 8436 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.404763:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.404773:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949053871616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.404777:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7054 00010000:00010000:0.0:1746129804.404811:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404821:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404833:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404839:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404845:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404867:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013689e400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129804.404870:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404876:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404883:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.404888:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013689e400/0x48868a4e43951fde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.404920:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949053869568:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 14681us (16530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.404926:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14307 00000100:00100000:0.0:1746129804.410042:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.410065:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.410082:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053871872 00000100:00100000:0.0:1746129804.410087:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053871872 00010000:00010000:0.0:1746129804.410110:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f600/0x48868a4e43951da0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354208 expref: 19 pid: 4589 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.410129:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7055 00000100:00100000:0.0:1746129804.410134:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053871872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.410144:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.410159:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f600/0x48868a4e43951da0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354208 expref: 19 pid: 4589 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410168:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3f600/0x48868a4e43951da0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354208 expref: 19 pid: 4589 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410187:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.410223:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053871872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.410228:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7055 00000100:00100000:0.0:1746129804.410534:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.410544:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.410553:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.410562:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053872256 00000100:00100000:0.0:1746129804.410564:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053872256 00010000:00010000:0.0:1746129804.410575:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43951f44 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542fd expref: 12 pid: 1140 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.410584:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053872512 00000100:00100000:0.0:1746129804.410586:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053872512 00010000:00010000:0.0:1746129804.410592:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43951f59 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354312 expref: 33 pid: 7975 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.410600:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053872128 00000100:00100000:0.0:1746129804.410602:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053872128 00010000:00010000:0.0:1746129804.410608:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b154800/0x48868a4e43951cb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354198 expref: 12 pid: 8437 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.410617:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7057 00000100:00100000:0.0:1746129804.410620:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949053872256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.410626:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.410637:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43951f44 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542fd expref: 12 pid: 1140 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410643:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43951f44 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542fd expref: 12 pid: 1140 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410653:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.410666:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949053872256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.410670:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7057 00000100:00100000:0.0:1746129804.410693:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7058 00000100:00100000:0.0:1746129804.410697:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949053872512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.410703:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.410707:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43951f59 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354312 expref: 33 pid: 7975 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410714:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43951f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354312 expref: 33 pid: 7975 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410721:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.410730:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949053872512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 33us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.410733:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7058 00000100:00100000:0.0:1746129804.410739:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7059 00000100:00100000:0.0:1746129804.410743:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949053872128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.410747:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.410751:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b154800/0x48868a4e43951cb2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354198 expref: 12 pid: 8437 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410758:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b154800/0x48868a4e43951cb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354198 expref: 12 pid: 8437 timeout: 850 lvb_type: 1 00010000:00010000:0.0:1746129804.410765:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.410767:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.410770:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e43951ffa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.410777:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e43951ffa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.410794:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.410802:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949053872128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 59us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.410806:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7059 00000100:00100000:0.0:1746129804.410840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.410871:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053872384 00000100:00100000:0.0:1746129804.410874:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053872384 00010000:00010000:0.0:1746129804.410882:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012edb5600/0x48868a4e43951ee2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542cc expref: 21 pid: 8436 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.410893:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7060 00000100:00100000:0.0:1746129804.410896:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949053872384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.410901:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.410908:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012edb5600/0x48868a4e43951ee2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542cc expref: 21 pid: 8436 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.410915:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012edb5600/0x48868a4e43951ee2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542cc expref: 21 pid: 8436 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.410926:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012edb5600/0x48868a4e43951ee2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542cc expref: 21 pid: 8436 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.410933:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.410945:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949053872384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.410952:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7060 00010000:00010000:0.0:1746129804.411010:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43951f44 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3542fd expref: 11 pid: 1140 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.411018:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053839232:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129804.411026:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305e2a00/0x48868a4e43951f59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354312 expref: 32 pid: 7975 timeout: 850 lvb_type: 1 00000100:00100000:0.0:1746129804.411032:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801348f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053839360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129804.414263:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.414282:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.414294:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053872768 00000100:00100000:0.0:1746129804.414297:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053872768 00010000:00010000:0.0:1746129804.414318:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43951eb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35429b expref: 23 pid: 10930 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.414341:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7061 00000100:00100000:0.0:1746129804.414347:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949053872768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.414356:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.414371:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43951eb1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35429b expref: 23 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.414380:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43951eb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35429b expref: 23 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.414401:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43951eb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1241087) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35429b expref: 23 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.414411:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.414413:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.414418:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801373f8a00/0x48868a4e43951f9f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354335 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.414433:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801373f8a00/0x48868a4e43951f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354335 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.414457:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801373f8a00/0x48868a4e43951f9f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354335 expref: 31 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.414465:0:7107:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801373f8a00/0x48868a4e43951f9f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354335 expref: 31 pid: 3624 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.414475:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053839616:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129804.414526:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129804.418793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.426085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.426199:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.440957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.441181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.446791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.450578:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.453114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.473545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.481226:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053875200 00000100:00100000:0.0:1746129804.481233:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053875200 00000100:00100000:0.0:1746129804.481268:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053875456 00000100:00100000:0.0:1746129804.481270:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053875456 00000100:00100000:0.0:1746129804.481288:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053875072 00000100:00100000:0.0:1746129804.481289:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053875072 00000100:00100000:0.0:1746129804.481297:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053875328 00000100:00100000:0.0:1746129804.481299:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053875328 00000100:00100000:0.0:1746129804.481307:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053875584 00000100:00100000:0.0:1746129804.481308:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053875584 00000100:00100000:0.0:1746129804.481319:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14315 00000100:00100000:0.0:1746129804.481325:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949053875200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.481340:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.481356:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e43952024 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35435f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129804.481377:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d38c, atime: 0x6813d38a, ctime: 0x6813d38c, blocks: 0x821 00010000:00010000:0.0:1746129804.481391:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481393:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481400:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e43952024 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35435f expref: 34 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481419:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e43952024 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35435f expref: 34 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481440:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00000100:00100000:0.0:1746129804.481476:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949053875200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 150us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.481481:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14315 00000100:00100000:0.0:1746129804.481494:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14316 00000100:00100000:0.0:1746129804.481498:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949053875456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.481505:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.481513:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e4395202b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35436d expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.481545:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053839744:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129804.481602:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129804.481619:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14317 00000100:00100000:0.0:1746129804.481623:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949053875072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.481628:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.481636:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6800/0x48868a4e43952032 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354358 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129804.481647:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d38a, atime: 0x6813d38a, ctime: 0x6813d38a, blocks: 0x7e1 00010000:00010000:0.0:1746129804.481654:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481655:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481659:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6800/0x48868a4e43952032 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354358 expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481669:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6800/0x48868a4e43952032 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354358 expref: 22 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481675:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6800, rc 0) 00000100:00100000:0.0:1746129804.481689:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949053875072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 66us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.481694:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14317 00000100:00100000:0.0:1746129804.481703:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14318 00000100:00100000:0.0:1746129804.481707:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949053875328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.481711:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.481717:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7e00/0x48868a4e43952039 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354366 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129804.481727:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d38c, atime: 0x6813d38c, ctime: 0x6813d38c, blocks: 0x821 00010000:00010000:0.0:1746129804.481734:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481735:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481738:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7e00/0x48868a4e43952039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354366 expref: 34 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481746:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7e00/0x48868a4e43952039 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354366 expref: 34 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481753:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7e00, rc 0) 00000100:00100000:0.0:1746129804.481767:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949053875328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.481771:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14318 00000100:00100000:0.0:1746129804.481779:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14319 00000100:00100000:0.0:1746129804.481783:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949053875584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.481788:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.481795:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e43952040 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354374 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129804.481803:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d38c, atime: 0x6813d38c, ctime: 0x6813d38c, blocks: 0x1029 00010000:00010000:0.0:1746129804.481810:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481811:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.481814:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e43952040 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354374 expref: 34 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481821:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7600/0x48868a4e43952040 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354374 expref: 34 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.481826:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7600, rc 0) 00000100:00100000:0.0:1746129804.481838:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949053875584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 55us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.481841:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14319 00000100:00100000:0.0:1746129804.494105:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.499650:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.502702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.515912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.536915:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.553351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.566020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.588511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.601896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.609436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.611347:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053877504 00000100:00100000:0.0:1746129804.611353:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053877504 00000100:00100000:0.0:1746129804.611587:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053877760 00000100:00100000:0.0:1746129804.611590:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053877760 00000100:00100000:0.0:1746129804.611607:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14323 00000100:00100000:0.0:1746129804.611613:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949053877504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.611622:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.611634:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013558c600/0x48868a4e4395207f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354397 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.611648:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.611649:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.611655:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013558c600/0x48868a4e4395207f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354397 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.611665:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013558c600/0x48868a4e4395207f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354397 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.611672:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013558c600, rc 0) 00000100:00100000:0.0:1746129804.611903:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949053877504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 289us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.611908:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14323 00000100:00100000:0.0:1746129804.611920:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14325 00000100:00100000:0.0:1746129804.611935:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949053877632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129804.611941:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.611947:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35439e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.611955:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.611956:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.611960:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35439e expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.611968:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35439e expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.611974:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013094a400, rc 0) 00000100:00100000:0.0:1746129804.611986:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949053877632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 51us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.611990:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14325 00000100:00100000:0.0:1746129804.619055:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.622680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.628016:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.635371:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.635395:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.635409:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.637681:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053878912 00000100:00100000:0.0:1746129804.637685:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053878912 00000100:00100000:0.0:1746129804.637703:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14330 00000100:00100000:0.0:1746129804.637707:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949053878912:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129804.637716:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.637725:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1200/0x48868a4e439520cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3543cf expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.637735:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.637736:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.637740:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1200/0x48868a4e439520cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543cf expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.637750:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1200/0x48868a4e439520cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543cf expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.637756:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1200, rc 0) 00000100:00100000:0.0:1746129804.637774:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949053878912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.637779:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14330 00000100:00100000:0.0:1746129804.637814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.637831:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053879040 00000100:00100000:0.0:1746129804.637834:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053879040 00000100:00100000:0.0:1746129804.637863:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14331 00000100:00100000:0.0:1746129804.637868:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949053879040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129804.637873:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.637878:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439520d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3543d6 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.637890:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.637891:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.637895:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439520d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543d6 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.637903:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439520d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543d6 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.637909:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b154800, rc 0) 00000100:00100000:0.0:1746129804.637920:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949053879040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 52us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.637924:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14331 00000100:00100000:0.0:1746129804.637954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.637961:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053879168 00000100:00100000:0.0:1746129804.637963:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053879168 00000100:00100000:0.0:1746129804.637973:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14332 00000100:00100000:0.0:1746129804.637976:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949053879168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129804.637981:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.637986:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801373f9c00/0x48868a4e439520da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3543dd expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.637993:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.637994:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.637997:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373f9c00/0x48868a4e439520da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543dd expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.638004:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801373f9c00/0x48868a4e439520da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543dd expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.638010:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373f9c00, rc 0) 00000100:00100000:0.0:1746129804.638019:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949053879168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 43us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.638024:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14332 00000100:00100000:0.0:1746129804.638047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.638054:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053879296 00000100:00100000:0.0:1746129804.638056:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053879296 00000100:00100000:0.0:1746129804.638063:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14333 00000100:00100000:0.0:1746129804.638066:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949053879296:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129804.638071:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129804.638075:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801373f8200/0x48868a4e439520e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3543e4 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.638097:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053840896:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129804.638896:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129804.642506:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053880832 00000100:00100000:0.0:1746129804.642509:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053880832 00002000:00100000:0.0:1746129804.642526:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3940352->3944447) req@ffff8801348f6d80 x1830949053880832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.642533:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801348f6d80 with x1830949053880832 ext(3940352->3944447) 00002000:00010000:0.0:1746129804.642535:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801348f6d80 00000100:00100000:0.0:1746129804.642547:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6296 00000100:00100000:0.0:1746129804.642552:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053879808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129804.643448:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6298 00000100:00100000:0.0:1746129804.643454:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801348f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949053880448:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:0.0:1746129804.644398:0:1140:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129804 -> 1746129805 00000100:00100000:0.0:1746129804.644406:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053840896:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129804.644438:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801373f8200/0x48868a4e439520e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543e4 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.644449:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801373f8200/0x48868a4e439520e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543e4 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129804.644463:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373f8200, rc 0) 00000100:00100000:0.0:1746129804.644477:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949053879296:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6409us (6429us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129804.644482:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14333 00000100:00100000:0.0:1746129804.647664:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.651833:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.656665:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801348f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949053879936:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14385us (14605us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129804.656675:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6295 00002000:00100000:0.0:1746129804.656684:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8801348f4a80 x1830949053879936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:545/0 lens 488/440 e 0 to 0 dl 1746129815 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.656693:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801348f4a80 with x1830949053879936 ext(0->1048575) 00002000:00010000:0.0:1746129804.656697:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801348f4a80 00000100:00100000:0.0:1746129804.664461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.664528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.664559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.664572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.664589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.664606:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053881856 00000100:00100000:0.0:1746129804.664612:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053881856 00002000:00100000:0.0:1746129804.664637:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba38e00 x1830949053881856/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.664644:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38e00 with x1830949053881856 ext(3145728->4194303) 00002000:00010000:0.0:1746129804.664647:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38e00 00000100:00100000:0.0:1746129804.664658:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053882112 00000100:00100000:0.0:1746129804.664660:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053882112 00002000:00100000:0.0:1746129804.664671:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012ba39c00 x1830949053882112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 504/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.664676:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39c00 with x1830949053882112 ext(3145728->4194303) 00002000:00010000:0.0:1746129804.664679:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39c00 00000100:00100000:0.0:1746129804.664685:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053881728 00000100:00100000:0.0:1746129804.664686:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053881728 00002000:00100000:0.0:1746129804.664693:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba3aa00 x1830949053881728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:545/0 lens 488/0 e 0 to 0 dl 1746129815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.664698:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949053881728 ext(2097152->3145727) 00002000:00010000:0.0:1746129804.664700:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3aa00 00000100:00100000:0.0:1746129804.664709:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6300 00000100:00100000:0.0:1746129804.664714:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949053881856:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129804.665681:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6301 00000100:00100000:0.0:1746129804.665688:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949053882112:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129804.687084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.687136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.689305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.694571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.699327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.699366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.699398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.702375:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.702432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.704221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.704312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.709343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.709404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.709476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.709494:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053883904 00000100:00100000:0.0:1746129804.709497:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053883904 00010000:00010000:0.0:1746129804.709515:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801310ed400/0x48868a4e4395209b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543b3 expref: 35 pid: 10930 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.709533:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7076 00000100:00100000:0.0:1746129804.709539:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949053883904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.709557:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.709575:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801310ed400/0x48868a4e4395209b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543b3 expref: 35 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.709585:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801310ed400/0x48868a4e4395209b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543b3 expref: 35 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.709602:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801310ed400/0x48868a4e4395209b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543b3 expref: 35 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.709618:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.709620:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.709625:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012edb5600/0x48868a4e4395212e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35441c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.709633:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012edb5600/0x48868a4e4395212e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35441c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.709659:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012edb5600/0x48868a4e4395212e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35441c expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.709669:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053842432:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129804.709729:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129804.717377:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053842432:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129804.717394:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.717416:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949053883904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7877us (7939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.717431:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7076 00000100:00100000:0.0:1746129804.724168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.725779:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.727449:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053885056 00000100:00100000:0.0:1746129804.727455:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053885056 00010000:00010000:0.0:1746129804.727477:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439520be lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543c1 expref: 25 pid: 10930 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746129804.727511:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7077 00000100:00100000:0.0:1746129804.727518:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949053885056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.727554:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.727571:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439520be lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543c1 expref: 25 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.727643:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801310eda00/0x48868a4e439520be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3940352->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3543c1 expref: 25 pid: 10930 timeout: 850 lvb_type: 0 00010000:00010000:0.0:1746129804.727663:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.727664:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129804.727670:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e4395213c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35442a expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.727677:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e4395213c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35442a expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.727700:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a10b800/0x48868a4e4395213c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35442a expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129804.727709:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053842688:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129804.727768:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129804.729184:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.731806:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.733762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.741915:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053842816 00000100:00100000:0.0:1746129804.741922:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053842816 00000100:00100000:0.0:1746129804.741960:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1746129804.741967:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3298:x1830949053842816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746129804.741984:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 440860672 pending 22151168 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746129804.742024:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3298:x1830949053842816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.742030:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1746129804.751101:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.753038:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.757442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.778655:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.789030:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801348f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949053843200:0@lo:400:kworker.0 00000100:00100000:0.0:1746129804.789169:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129804.789219:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830949053843712:0@lo:400:kworker.0 00000100:00100000:0.0:1746129804.789240:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129804.789294:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053843456 00000100:00100000:0.0:1746129804.789300:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053843456 00000100:00100000:0.0:1746129804.789334:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053843712 00000100:00100000:0.0:1746129804.789337:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053843712 00000100:00100000:0.0:1746129804.789345:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053843328 00000100:00100000:0.0:1746129804.789347:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053843328 00000100:00100000:0.0:1746129804.789358:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746129804.789363:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949053843456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129804.789395:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949053843456:12345-0@lo:400:kworker.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.789400:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1746129804.789411:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1746129804.789414:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830949053843712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129804.789448:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830949053843712:12345-0@lo:400:kworker.0 Request processed in 32us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.789453:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1746129804.789467:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129804.789495:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830949053843712:0@lo:400:kworker.0 00000100:00100000:0.0:1746129804.789502:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801348f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949053843200:0@lo:400:kworker.0 00000100:00100000:0.0:1746129804.789530:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053843840 00000100:00100000:0.0:1746129804.789532:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053843840 00000100:00100000:0.0:1746129804.789547:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1746129804.789551:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053843840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746129804.789563:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 467992576 pending 27262976 free 3853516800 avail 3851419648 00000100:00100000:0.0:1746129804.789586:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053843840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.789590:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1746129804.793743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.793814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.793876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.832326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.845264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.845561:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053887616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13053us (13239us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746129804.845571:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6309 00002000:00100000:0.0:1746129804.845581:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88009fbef100 x1830949053887616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:545/0 lens 488/440 e 0 to 0 dl 1746129815 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129804.845589:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef100 with x1830949053887616 ext(4194304->4898815) 00002000:00010000:0.0:1746129804.845594:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbef100 00000100:00100000:0.0:1746129804.854115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.854227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.863387:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.871552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.875591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.883128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.900431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.904217:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.914132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.918927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.929246:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.962232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.962600:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.966396:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053891200 00000100:00100000:0.0:1746129804.966399:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053891200 00010000:00010000:0.0:1746129804.966412:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130520400/0x48868a4e4395217b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35444d expref: 21 pid: 16808 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746129804.966695:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053891072 00000100:00100000:0.0:1746129804.966698:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053891072 00010000:00010000:0.0:1746129804.966709:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012edb4000/0x48868a4e43952119 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354407 expref: 13 pid: 16808 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746129804.966723:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7081 00000100:00100000:0.0:1746129804.966728:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949053890944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.966734:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.966738:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801310e9e00/0x48868a4e439521a5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35445b expref: 297 pid: 14315 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129804.966955:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801310e9e00/0x48868a4e439521a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35445b expref: 297 pid: 14315 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129804.967218:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310e9e00/0x48868a4e439521a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35445b expref: 297 pid: 14315 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129804.967232:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.967234:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5000/0x48868a4e439521c1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129804.967239:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5000/0x48868a4e439521c1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129804.967243:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.967260:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949053890944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 531us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.967264:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7081 00000100:00100000:0.0:1746129804.982328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.986728:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.989935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.991841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129804.998880:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053892096 00000100:00100000:0.0:1746129804.998885:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053892096 00000100:00100000:0.0:1746129804.998923:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:0.0:1746129804.998929:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949053892096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129804.998938:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129804.998953:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b538ba00/0x48868a4e439521eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354477 expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129804.998977:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129804.998981:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129804.999000:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949053892096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129804.999006:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 696 00000100:00100000:0.0:1746129804.999922:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6317 00000100:00100000:0.0:1746129805.002565:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.032923:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.034145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.045327:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.068008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.074581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129805.075796:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129805.088033:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.104941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.106364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.110978:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.120361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.121663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.124599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.134102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.202947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.214657:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.232936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.232983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.274738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.279282:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.285213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.286996:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.287031:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.289351:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.291521:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.296670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.301371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.329632:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.344019:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.344099:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.346797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.363991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.364036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.388296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.400686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.420740:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949053900928:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19794us (20051us total) trans 21474841070 rc 0/0 00000100:00100000:0.0:1746129805.420752:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1722 00002000:00100000:0.0:1746129805.420762:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2375680->3084287) req@ffff88009f6ed880 x1830949053900928/t21474841070(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/448 e 0 to 0 dl 1746129816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.420771:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ed880 with x1830949053900928 ext(2375680->3084287) 00010000:00010000:0.0:1746129805.420779:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43952223 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35448c expref: 24 pid: 8436 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129805.420792:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f907600/0x48868a4e43952223 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2375680->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35448c expref: 24 pid: 8436 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746129805.420799:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f6ed880 00000100:00100000:0.0:1746129805.431971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.448135:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053901312 00000100:00100000:0.0:1746129805.448144:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053901312 00000100:00100000:0.0:1746129805.482868:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.485191:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053847040:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129805.485217:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0200/0x48868a4e439522bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [475136->1048575] (req 475136->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d2 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.485229:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0200, rc 0) 00000100:00100000:0.0:1746129805.485252:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31046:x1830949053901696:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4273us (4443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.485258:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14356 00000100:00100000:0.0:1746129805.487743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.488440:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1723 00000100:00100000:0.0:1746129805.488449:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053902080:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129805.494643:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.496091:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053902208 00000100:00100000:0.0:1746129805.496098:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053902208 00000100:00100000:0.0:1746129805.496146:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00100000:0.0:1746129805.496153:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949053902208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129805.496164:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129805.496182:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095350000/0x48868a4e439522d9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d9 expref: 27 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.496200:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129805.496204:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129805.496350:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949053902208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 196us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.496356:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 701 00000100:00100000:0.0:1746129805.523772:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053902848 00000100:00100000:0.0:1746129805.523776:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053902848 00002000:00100000:0.0:1746129805.523797:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88009206dc00 x1830949053902848/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:546/0 lens 488/0 e 0 to 0 dl 1746129816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.523806:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206dc00 with x1830949053902848 ext(4194304->4898815) 00002000:00010000:0.0:1746129805.523810:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206dc00 00000100:00100000:0.0:1746129805.523826:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6333 00000100:00100000:0.0:1746129805.523832:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949053902848:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129805.535906:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053903360 00000100:00100000:0.0:1746129805.535911:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053903360 00000100:00100000:0.0:1746129805.535934:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053903488 00000100:00100000:0.0:1746129805.535936:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053903488 00010000:00010000:0.0:1746129805.535946:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e43952270 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 339968->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35449a expref: 29 pid: 8436 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746129805.535962:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7093 00000100:00100000:0.0:1746129805.535967:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949053903488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129805.535975:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746129805.535988:0:7108:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2017 -> 2025 00010000:00010000:0.0:1746129805.535994:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e43952270 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 339968->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35449a expref: 29 pid: 8436 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129805.536004:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e43952270 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 339968->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35449a expref: 29 pid: 8436 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129805.536026:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129805.536027:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129805.536033:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0200/0x48868a4e439522bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 475136->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d2 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.536041:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0200/0x48868a4e439522bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 475136->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d2 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.536063:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0200/0x48868a4e439522bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 475136->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d2 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129805.536070:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ef480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053847424:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129805.536099:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129805.536114:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 702 00000100:00100000:0.0:1746129805.536119:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:1962:x1830949053903360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129805.536126:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129805.536137:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df400/0x48868a4e43952303 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544e7 expref: 303 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.536153:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129805.536156:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129805.536172:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1962:x1830949053903360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.536178:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 702 00000100:00100000:0.0:1746129805.536218:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053903104 00000100:00100000:0.0:1746129805.536222:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053903104 00000100:00100000:0.0:1746129805.536235:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053903232 00000100:00100000:0.0:1746129805.536237:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053903232 00000100:00100000:0.0:1746129805.536248:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14359 00000100:00100000:0.0:1746129805.536252:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949053903104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129805.536261:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129805.536269:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2800/0x48868a4e43952318 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3544f5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129805.536290:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053847552:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129805.536308:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129805.536324:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14360 00000100:00100000:0.0:1746129805.536329:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949053903232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129805.536335:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129805.536341:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e4395231f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3544fc expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.536350:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129805.536351:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129805.536355:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e4395231f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544fc expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129805.536364:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e4395231f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544fc expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129805.536373:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3800, rc 0) 00000100:00100000:0.0:1746129805.536388:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949053903232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 59us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.536393:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14360 00000100:00100000:0.0:1746129805.560163:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.572275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.637583:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.650353:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949053905536:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12247us (12771us total) trans 17179873895 rc 0/0 00000100:00100000:0.0:1746129805.650364:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1726 00002000:00100000:0.0:1746129805.650373:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1257471) req@ffff88009f6ef480 x1830949053905536/t17179873895(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/448 e 0 to 0 dl 1746129816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.650382:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ef480 with x1830949053905536 ext(1048576->1257471) 00010000:00010000:0.0:1746129805.650391:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130817c00/0x48868a4e43952334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354511 expref: 39 pid: 20441 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129805.650414:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130817c00/0x48868a4e43952334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1257471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354511 expref: 39 pid: 20441 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746129805.650421:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6ef480 00000100:00100000:0.0:1746129805.669723:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.669758:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053905920 00000100:00100000:0.0:1746129805.669765:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053905920 00002000:00100000:0.0:1746129805.669799:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009be66300 x1830949053905920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/0 e 0 to 0 dl 1746129816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.669808:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66300 with x1830949053905920 ext(1048576->2097151) 00002000:00010000:0.0:1746129805.669812:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66300 00000100:00100000:0.0:1746129805.669831:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6336 00000100:00100000:0.0:1746129805.669838:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949053905920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129805.672705:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053848320:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129805.672720:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129805.672746:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949053905664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11019us (11577us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.672754:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7095 00000100:00100000:0.0:1746129805.688175:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949053905920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18330us (18450us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129805.688187:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6336 00002000:00100000:0.0:1746129805.688198:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009be66300 x1830949053905920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/440 e 0 to 0 dl 1746129816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.688207:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66300 with x1830949053905920 ext(1048576->2097151) 00002000:00010000:0.0:1746129805.688211:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66300 00000100:00100000:0.0:1746129805.711004:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.730605:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.734753:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949053906176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24706us (24821us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129805.734763:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6337 00002000:00100000:0.0:1746129805.734772:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a8793b80 x1830949053906176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/440 e 0 to 0 dl 1746129816 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.734780:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793b80 with x1830949053906176 ext(2097152->3145727) 00002000:00010000:0.0:1746129805.734785:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8793b80 00000100:00100000:0.0:1746129805.748371:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053907200 00000100:00100000:0.0:1746129805.748379:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053907200 00002000:00100000:0.0:1746129805.748430:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1425408->1429503) req@ffff88012ba3bb80 x1830949053907200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:546/0 lens 488/0 e 0 to 0 dl 1746129816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.748439:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3bb80 with x1830949053907200 ext(1425408->1429503) 00002000:00010000:0.0:1746129805.748443:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3bb80 00000100:00100000:0.0:1746129805.748460:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6339 00000100:00100000:0.0:1746129805.748467:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949053907200:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129805.748613:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949053907200:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 146us (478us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129805.748619:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6339 00002000:00100000:0.0:1746129805.748630:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1425408->1429503) req@ffff88012ba3bb80 x1830949053907200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:546/0 lens 488/4536 e 0 to 0 dl 1746129816 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.748636:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3bb80 with x1830949053907200 ext(1425408->1429503) 00002000:00010000:0.0:1746129805.748639:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3bb80 00000100:00100000:0.0:1746129805.750695:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.760653:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.766866:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.766889:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053907584 00000100:00100000:0.0:1746129805.766896:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053907584 00000100:00100000:0.0:1746129805.766926:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14368 00000100:00100000:0.0:1746129805.766932:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:31057:x1830949053907584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129805.766945:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129805.766960:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e43952357 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354534 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.766980:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129805.766982:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129805.766989:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e43952357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2326528->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354534 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.767002:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283e00/0x48868a4e43952357 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2326528->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354534 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.767012:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283e00, rc 0) 00000100:00100000:0.0:1746129805.767047:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31057:x1830949053907584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.767052:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14368 00000100:00100000:0.0:1746129805.772823:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053908096 00000100:00100000:0.0:1746129805.772831:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053908096 00000100:00100000:0.0:1746129805.772879:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10751 00000100:00100000:0.0:1746129805.772886:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:31061:x1830949053908096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129805.772903:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129805.772916:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282400/0x48868a4e4395235e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35453b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.772995:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773005:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773014:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773023:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773033:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773037:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773123:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282e00/0x48868a4e43952373 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773130:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282e00/0x48868a4e43952373 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773136:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282e00/0x48868a4e43952373 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129805.773144:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129805.773205:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773210:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773215:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773220:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5283800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129805.773223:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773228:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773236:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129805.773239:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129805.773242:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773247:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283800/0x48868a4e43952365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773259:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773263:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773268:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773272:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5283600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129805.773274:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773278:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773283:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2a00) 00010000:00010000:0.0:1746129805.773284:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129805.773286:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773290:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283600/0x48868a4e4395236c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129805.773390:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282400/0x48868a4e4395235e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35453b expref: 305 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.773416:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282e00/0x48868a4e43952373 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35453b expref: 304 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.773422:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129805.773424:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129805.773426:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282e00, rc 0) 00000100:00100000:0.0:1746129805.773463:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:31061:x1830949053908096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 577us (694us total) trans 8589944698 rc 0/0 00000100:00100000:0.0:1746129805.773480:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10751 00000100:00100000:0.0:1746129805.779185:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053908736 00000100:00100000:0.0:1746129805.779191:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053908736 00000100:00100000:0.0:1746129805.779220:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4428 00000100:00100000:0.0:1746129805.779225:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:31061:x1830949053908736:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129805.779365:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+305:31061:x1830949053908736:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 138us (1938us total) trans 8589944699 rc 0/0 00000100:00100000:0.0:1746129805.779371:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4428 00000001:00080000:0.0:1746129805.781205:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873872 is committed 00000001:00080000:0.0:1746129805.781223:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873849 is committed 00000001:00080000:0.0:1746129805.781231:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873880 is committed 00000001:00080000:0.0:1746129805.781252:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873844 is committed 00000001:00080000:0.0:1746129805.781264:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873894 is committed 00000001:00080000:0.0:1746129805.781270:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873892 is committed 00000001:00080000:0.0:1746129805.781286:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873885 is committed 00000001:00080000:0.0:1746129805.781300:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873867 is committed 00000001:00080000:0.0:1746129805.781339:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873869 is committed 00000100:00100000:0.0:1746129805.790804:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949053908480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13204us (13318us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746129805.790811:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6340 00002000:00100000:0.0:1746129805.790816:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff8800a8792300 x1830949053908480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/440 e 0 to 0 dl 1746129816 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.790823:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792300 with x1830949053908480 ext(4194304->4898815) 00002000:00010000:0.0:1746129805.790826:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8792300 00000100:00100000:0.0:1746129805.804943:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.827997:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.828051:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.828083:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.833827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.834807:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910272 00000100:00100000:0.0:1746129805.834810:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910272 00000100:00100000:0.0:1746129805.834828:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910400 00000100:00100000:0.0:1746129805.834830:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910400 00000100:00100000:0.0:1746129805.834844:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14373 00000100:00100000:0.0:1746129805.834863:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949053910272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129805.834874:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129805.834885:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283000/0x48868a4e439523c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354565 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129805.834921:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053849728:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129805.834963:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129805.840264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.845114:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.849198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.861061:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949053911040:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11455us (11854us total) trans 21474841072 rc 0/0 00000100:00100000:0.0:1746129805.861073:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1727 00002000:00100000:0.0:1746129805.861082:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (475136->1048575) req@ffff88012c089880 x1830949053911040/t21474841072(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:546/0 lens 488/448 e 0 to 0 dl 1746129816 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.861091:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089880 with x1830949053911040 ext(475136->1048575) 00010000:00010000:0.0:1746129805.861100:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0200/0x48868a4e439522bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 475136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d2 expref: 14 pid: 8436 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746129805.861112:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0200/0x48868a4e439522bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 475136->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3544d2 expref: 14 pid: 8436 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746129805.861119:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c089880 00000100:00100000:0.0:1746129805.866357:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.879302:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.879894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.888286:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.920435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.937447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.946365:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.946417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.972352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129805.987918:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053913344 00000100:00100000:0.0:1746129805.987925:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053913344 00000100:00100000:0.0:1746129805.987971:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 705 00000100:00100000:0.0:1746129805.987976:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+307:1961:x1830949053913344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129805.987986:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129805.988004:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091e01000/0x48868a4e439523f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354588 expref: 307 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129805.988047:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129805.988051:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129805.988121:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+306:1961:x1830949053913344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 132us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129805.988127:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 705 00000100:00100000:0.0:1746129805.993508:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053913856 00000100:00100000:0.0:1746129805.993513:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053913856 00002000:00100000:0.0:1746129805.993537:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88009207df80 x1830949053913856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:546/0 lens 488/0 e 0 to 0 dl 1746129816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129805.993546:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949053913856 ext(4194304->4898815) 00002000:00010000:0.0:1746129805.993550:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207df80 00000100:00100000:0.0:1746129805.993572:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6347 00000100:00100000:0.0:1746129805.993577:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949053913856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129806.000354:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053850368:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129806.000381:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093bee400/0x48868a4e4395240d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354596 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.000393:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093bee400/0x48868a4e4395240d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354596 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.000427:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee400, rc 0) 00000100:00100000:0.0:1746129806.000483:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949053913472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9058us (12687us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129806.000494:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14379 00000100:00100000:0.0:1746129806.015753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.026546:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.030201:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053914496 00000100:00100000:0.0:1746129806.030207:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053914496 00000100:00100000:0.0:1746129806.030230:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14381 00000100:00100000:0.0:1746129806.030234:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:31061:x1830949053914496:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129806.030243:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.030255:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3545a4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.030278:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0e9e00/0x48868a4e43952342 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35451f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.030284:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129806.030286:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129806.030288:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545a4 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.030310:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e0e9e00/0x48868a4e43952342 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35451f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.030318:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e0e9e00/0x48868a4e43952342 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1425408->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35451f expref: 12 pid: 8437 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746129806.030327:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053850496:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129806.030375:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129806.033711:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053850496:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129806.033737:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545a4 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.033751:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a061c00, rc 0) 00000100:00100000:0.0:1746129806.033798:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31061:x1830949053914496:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3561us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.033805:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14381 00000100:00100000:0.0:1746129806.035665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.054271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.056376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.056443:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053915008 00000100:00100000:0.0:1746129806.056447:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053915008 00000100:00100000:0.0:1746129806.056479:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14382 00000100:00100000:0.0:1746129806.056485:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31069:x1830949053915008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129806.056495:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.056576:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a061e00/0x48868a4e43952445 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3545b2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.056597:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129806.056602:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545a4 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.056608:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129806.056611:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a061e00/0x48868a4e43952445 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545b2 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.056644:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1904640->2097151] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545a4 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.056656:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a061e00/0x48868a4e43952445 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545b2 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.056664:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a061e00, rc 0) 00000100:00100000:0.0:1746129806.056701:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31069:x1830949053915008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 215us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.056707:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14382 00000100:00100000:0.0:1746129806.058600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.060170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.062194:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053915392 00000100:00100000:0.0:1746129806.062198:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053915392 00000100:00100000:0.0:1746129806.062218:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14383 00000100:00100000:0.0:1746129806.062223:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31071:x1830949053915392:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129806.062235:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.062244:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a061600/0x48868a4e4395244c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3545b9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.063508:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a061a00/0x48868a4e439523d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35457a expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.063517:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093beea00/0x48868a4e43952406 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35458f expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.063527:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.063529:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.063532:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a061600/0x48868a4e4395244c lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [339968->430079] (req 339968->430079) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545b9 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.063557:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093beea00/0x48868a4e43952406 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35458f expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.063567:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093beea00/0x48868a4e43952406 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35458f expref: 16 pid: 8437 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746129806.063578:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053850880:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129806.063668:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a061a00/0x48868a4e439523d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35457a expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.063676:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a061a00/0x48868a4e439523d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35457a expref: 16 pid: 8437 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746129806.063684:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff38380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053851008:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129806.063701:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129806.065091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.072824:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053850880:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129806.073966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.073982:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053916160 00000100:00100000:0.0:1746129806.073985:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053916160 00002000:00100000:0.0:1746129806.074005:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1904640->2097151) req@ffff88009ff39c00 x1830949053916160/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.074014:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff39c00 with x1830949053916160 ext(1904640->2097151) 00010000:00010000:0.0:1746129806.074019:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545a4 expref: 19 pid: 8437 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746129806.074027:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a061c00/0x48868a4e4395241b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1904640->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545a4 expref: 19 pid: 8437 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746129806.074032:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff39c00 00000100:00100000:0.0:1746129806.074043:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1731 00000100:00100000:0.0:1746129806.074048:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949053916160:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129806.083053:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.083065:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.083085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.084500:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.084558:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053916928 00000100:00100000:0.0:1746129806.084562:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053916928 00002000:00100000:0.0:1746129806.084583:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (339968->344063) req@ffff88009ff38a80 x1830949053916928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.084592:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff38a80 with x1830949053916928 ext(339968->344063) 00002000:00010000:0.0:1746129806.084595:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff38a80 00000100:00100000:0.0:1746129806.084612:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6349 00000100:00100000:0.0:1746129806.084618:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949053916928:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129806.084728:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949053916928:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 110us (228us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129806.084734:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6349 00002000:00100000:0.0:1746129806.084739:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (339968->344063) req@ffff88009ff38a80 x1830949053916928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:547/0 lens 488/4536 e 0 to 0 dl 1746129817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.084745:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff38a80 with x1830949053916928 ext(339968->344063) 00002000:00010000:0.0:1746129806.084747:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff38a80 00000100:00100000:0.0:1746129806.090676:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.090881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.098155:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053917568 00000100:00100000:0.0:1746129806.098161:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053917568 00002000:00100000:0.0:1746129806.098193:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2908160->2912255) req@ffff88009207e300 x1830949053917568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.098202:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949053917568 ext(2908160->2912255) 00002000:00010000:0.0:1746129806.098206:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:0.0:1746129806.098220:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6351 00000100:00100000:0.0:1746129806.098226:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949053917568:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129806.098359:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949053917568:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 133us (409us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129806.098365:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6351 00002000:00100000:0.0:1746129806.098370:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2908160->2912255) req@ffff88009207e300 x1830949053917568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/4536 e 0 to 0 dl 1746129817 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.099091:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949053917568 ext(2908160->2912255) 00002000:00010000:0.0:1746129806.099096:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:0.0:1746129806.104493:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053918080 00000100:00100000:0.0:1746129806.104502:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053918080 00002000:00100000:0.0:1746129806.104537:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009328b800 x1830949053918080/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.104546:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949053918080 ext(1048576->2097151) 00002000:00010000:0.0:1746129806.104551:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328b800 00000100:00100000:0.0:1746129806.104567:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6352 00000100:00100000:0.0:1746129806.104574:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949053918080:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129806.126746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.126792:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.147352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.160617:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.177125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.182443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.188292:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.209614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129806.210584:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129806.219144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.226570:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129806.227717:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129806.227749:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+307:1963:x1830949053920000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 955us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.227756:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7110 00000100:00100000:0.0:1746129806.232617:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.232649:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.232668:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.232687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.232750:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129806.234255:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129806.244122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.246489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.262498:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.266013:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.269972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.274811:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.278928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.278961:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.278986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.278999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.279011:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053922176 00000100:00100000:0.0:1746129806.279013:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053922176 00000100:00100000:0.0:1746129806.279111:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053922432 00000100:00100000:0.0:1746129806.279115:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053922432 00000100:00100000:0.0:1746129806.293216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.293874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.293989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.294011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.294033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.294047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.294058:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053923072 00000100:00100000:0.0:1746129806.294061:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053923072 00010000:00010000:0.0:1746129806.294079:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7e00/0x48868a4e43952039 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354366 expref: 22 pid: 8435 timeout: 852 lvb_type: 1 00000100:00080000:0.0:1746129806.294798:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129806.294843:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053854464:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129806.294881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.294891:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053923328 00000100:00100000:0.0:1746129806.294893:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053923328 00010000:00010000:0.0:1746129806.294903:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35439e expref: 9 pid: 8437 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746129806.294915:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7118 00000100:00100000:0.0:1746129806.294919:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949053923328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129806.294925:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129806.294933:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35439e expref: 9 pid: 8437 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746129806.294941:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35439e expref: 9 pid: 8437 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746129806.294952:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013094a400/0x48868a4e4395208d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35439e expref: 9 pid: 8437 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746129806.294963:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.294965:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.294969:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136898800/0x48868a4e439524f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.294976:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136898800/0x48868a4e439524f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.294990:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129806.295003:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949053923328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.295012:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7118 00010000:00010000:0.0:1746129806.297042:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136898600/0x48868a4e43952492 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3545ff expref: 6 pid: 3624 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746129806.297054:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053854592:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129806.297064:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e439521cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354470 expref: 19 pid: 8436 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746129806.297071:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053854720:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129806.297089:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297096:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297101:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297115:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297122:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297128:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297134:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d4f400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129806.297136:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297142:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297151:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.297155:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f400/0x48868a4e43952517 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129806.297183:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949053922560:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 17307us (17485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.297189:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14400 00000100:00100000:0.0:1746129806.301437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129806.303261:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303268:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303285:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303296:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303302:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303308:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3e400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129806.303311:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303317:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303327:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.303333:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3e400/0x48868a4e439524fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129806.303610:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949053921920:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 24221us (24688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.303618:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14396 00000100:00100000:0.0:1746129806.313094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.316124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.319275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.319410:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.319437:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.319455:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.319672:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7129 00000100:00100000:0.0:1746129806.319678:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+308:1962:x1830949053925120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129806.319684:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129806.319688:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35c00/0x48868a4e43951dd8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354232 expref: 308 pid: 14314 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746129806.319841:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35c00/0x48868a4e43951dd8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354232 expref: 307 pid: 14314 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746129806.319865:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff35c00/0x48868a4e43951dd8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354232 expref: 307 pid: 14314 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746129806.319879:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f6cd800) 00010000:00010000:0.0:1746129806.319882:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e4395251e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129806.319888:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e4395251e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129806.319893:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801310eda00/0x48868a4e4395251e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129806.319906:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129806.319919:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+306:1962:x1830949053925120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 242us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.319924:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7129 00000100:00100000:0.0:1746129806.352481:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053855616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.352520:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352540:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.352551:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352559:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.352571:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352579:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801348f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053857152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.352588:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352600:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129806.352604:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053855744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.352615:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352622:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.352633:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352640:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.352650:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352658:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053857280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.352668:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.352686:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053855616 00000100:00100000:0.0:1746129806.352691:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053855616 00000100:00100000:0.0:1746129806.352719:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053856128 00000100:00100000:0.0:1746129806.352721:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053856128 00000100:00100000:0.0:1746129806.352729:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053856640 00000100:00100000:0.0:1746129806.352730:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053856640 00000100:00100000:0.0:1746129806.352740:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053857152 00000100:00100000:0.0:1746129806.352742:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053857152 00000100:00100000:0.0:1746129806.352748:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053855744 00000100:00100000:0.0:1746129806.352750:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053855744 00000100:00100000:0.0:1746129806.352754:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053856256 00000100:00100000:0.0:1746129806.352756:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053856256 00000100:00100000:0.0:1746129806.352761:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053856768 00000100:00100000:0.0:1746129806.352762:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053856768 00000100:00100000:0.0:1746129806.352766:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053857280 00000100:00100000:0.0:1746129806.352768:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053857280 00000100:00100000:0.0:1746129806.352776:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14401 00000100:00100000:0.0:1746129806.352781:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053855616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.352976:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053855616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (456us total) trans 17179873896 rc 0/0 00000100:00100000:0.0:1746129806.352982:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14401 00000100:00100000:0.0:1746129806.352993:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14402 00000100:00100000:0.0:1746129806.352997:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053856128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.353072:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053856128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (519us total) trans 17179873897 rc 0/0 00000100:00100000:0.0:1746129806.353077:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14402 00000100:00100000:0.0:1746129806.353085:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14403 00000100:00100000:0.0:1746129806.353089:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053856640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.353175:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053856640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (603us total) trans 21474841078 rc 0/0 00000100:00100000:0.0:1746129806.353180:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14403 00000100:00100000:0.0:1746129806.353187:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14404 00000100:00100000:0.0:1746129806.353191:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053857152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129806.353245:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129806.353248:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129806.353249:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129806.353250:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129806.353252:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129806.353268:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053857152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (679us total) trans 21474841079 rc 0/0 00000100:00100000:0.0:1746129806.353273:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14404 00000100:00100000:0.0:1746129806.353281:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14405 00000100:00100000:0.0:1746129806.353285:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053855744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.356161:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053855744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2875us (3544us total) trans 17179873898 rc 0/0 00000100:00100000:0.0:1746129806.356167:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14405 00000100:00080000:0.0:1746129806.356276:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129806.356280:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746129806.356404:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4ca80/2, rc 0, transno 17179873898 00000100:00100000:0.0:1746129806.356408:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053855744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129806.356415:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4f800/2, rc 0, transno 17179873899 00000100:00100000:0.0:1746129806.356418:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129806.356425:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460a80/2, rc 0, transno 21474841080 00000100:00100000:0.0:1746129806.356427:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129806.356433:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135d8ca80/2, rc 0, transno 21474841081 00000100:00100000:0.0:1746129806.356435:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053857280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129806.356440:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4f480/2, rc 0, transno 17179873896 00000100:00100000:0.0:1746129806.356442:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053855616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129806.356448:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4e300/2, rc 0, transno 17179873897 00000100:00100000:0.0:1746129806.356450:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856128:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129806.356456:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461180/2, rc 0, transno 21474841078 00000100:00100000:0.0:1746129806.356458:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053856640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129806.356465:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801348f4380/2, rc 0, transno 21474841079 00000100:00100000:0.0:1746129806.356467:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801348f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053857152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.360650:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.364787:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368350:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.368416:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053925632 00000100:00100000:0.0:1746129806.368422:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053925632 00000100:00100000:0.0:1746129806.368551:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053925760 00000100:00100000:0.0:1746129806.368553:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053925760 00000100:00100000:0.0:1746129806.368737:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14420 00000100:00100000:0.0:1746129806.368742:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949053926144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129806.368747:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.368754:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136899200/0x48868a4e43952548 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354653 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129806.368763:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4896768, mtime: 0x6813d38e, atime: 0x6813d38e, ctime: 0x6813d38e, blocks: 0x15a9 00010000:00010000:0.0:1746129806.368769:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.368771:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.368774:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136899200/0x48868a4e43952548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354653 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.368783:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136899200/0x48868a4e43952548 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354653 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.368790:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136899200, rc 0) 00000100:00100000:0.0:1746129806.369077:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053926144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 334us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.369081:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14420 00000100:00100000:0.0:1746129806.374560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.374614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.379732:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053927168 00000100:00100000:0.0:1746129806.379742:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053927168 00000100:00100000:0.0:1746129806.379784:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053927296 00000100:00100000:0.0:1746129806.379787:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053927296 00000100:00100000:0.0:1746129806.379798:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053927680 00000100:00100000:0.0:1746129806.379800:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053927680 00000100:00100000:0.0:1746129806.379808:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053927808 00000100:00100000:0.0:1746129806.379810:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053927808 00000100:00100000:0.0:1746129806.379822:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6358 00000100:00100000:0.0:1746129806.379829:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053927168:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129806.379870:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136899c00/0x48868a4e43952572 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.379882:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.379884:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.379888:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136899c00/0x48868a4e43952572 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.379899:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136899c00/0x48868a4e43952572 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129806.381899:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6360 00000100:00100000:0.0:1746129806.381906:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053927680:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129806.381923:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136898a00/0x48868a4e43952580 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.381930:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.381932:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.381934:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136898a00/0x48868a4e43952580 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.381942:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136898a00/0x48868a4e43952580 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129806.429975:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.433029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.436402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.439217:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053928960 00000100:00100000:0.0:1746129806.439221:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053928960 00000100:00100000:0.0:1746129806.439260:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14425 00000100:00100000:0.0:1746129806.439266:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31076:x1830949053928960:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129806.439279:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.439291:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136899c00/0x48868a4e439525aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354668 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.439310:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b74c400/0x48868a4e43952556 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35463e expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.439321:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.439322:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.439330:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136899c00/0x48868a4e439525aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354668 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.439355:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b74c400/0x48868a4e43952556 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35463e expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129806.439403:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b74c400/0x48868a4e43952556 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35463e expref: 9 pid: 10930 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746129806.439579:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053857792:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129806.439625:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129806.442842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.446528:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.454052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.462107:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.465281:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053929600 00000100:00100000:0.0:1746129806.465286:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053929600 00010000:00010000:0.0:1746129806.465307:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a00b2000/0x48868a4e4395254f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35464c expref: 10 pid: 7975 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746129806.465340:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7133 00000100:00100000:0.0:1746129806.465346:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053929600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129806.465356:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129806.465372:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a00b2000/0x48868a4e4395254f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35464c expref: 10 pid: 7975 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746129806.465381:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a00b2000/0x48868a4e4395254f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35464c expref: 10 pid: 7975 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746129806.465405:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a00b2000/0x48868a4e4395254f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35464c expref: 10 pid: 7975 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746129806.465726:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.465728:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.465734:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130676200/0x48868a4e439525b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354676 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.465740:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130676200/0x48868a4e439525b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354676 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.465764:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130676200/0x48868a4e439525b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354676 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129806.465772:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053858432:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129806.466083:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129806.468088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.469797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.472305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.477675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.485519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.486122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.486135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.486147:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053930240 00000100:00100000:0.0:1746129806.486152:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053930240 00000100:00100000:0.0:1746129806.486171:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053930368 00000100:00100000:0.0:1746129806.486172:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053930368 00000100:00100000:0.0:1746129806.486179:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053930496 00000100:00100000:0.0:1746129806.486180:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053930496 00000100:00100000:0.0:1746129806.486189:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14430 00000100:00100000:0.0:1746129806.486193:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949053930240:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129806.486324:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129806.486327:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486329:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486331:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129806 -> 1746129807 00002000:00010000:0.0:1746129806.486332:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746129806.486354:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053930240:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 160us (1510us total) trans 21474841087 rc 0/0 00000100:00100000:0.0:1746129806.486359:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14430 00000100:00100000:0.0:1746129806.486369:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14431 00000100:00100000:0.0:1746129806.486373:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053930368:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129806.486461:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129806.486463:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486464:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486466:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129806 -> 1746129807 00002000:00010000:0.0:1746129806.486467:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129806.486482:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053930368:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 109us (360us total) trans 17179873904 rc 0/0 00000100:00100000:0.0:1746129806.486489:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14431 00000100:00100000:0.0:1746129806.486498:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14432 00000100:00100000:0.0:1746129806.486501:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053930496:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129806.486558:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129806.486560:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129804 -> 1746129806 00002000:00010000:0.0:1746129806.486562:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129804 -> 1746129806 00002000:00010000:0.0:1746129806.486563:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129804 -> 1746129807 00002000:00010000:0.0:1746129806.486565:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129806.486581:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053930496:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 79us (445us total) trans 17179873905 rc 0/0 00000100:00100000:0.0:1746129806.486586:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14432 00000100:00100000:0.0:1746129806.486615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.486640:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.486666:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.486690:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053930624 00000100:00100000:0.0:1746129806.486693:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053930624 00000100:00100000:0.0:1746129806.486703:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053930752 00000100:00100000:0.0:1746129806.486704:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053930752 00000100:00100000:0.0:1746129806.486710:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053930880 00000100:00100000:0.0:1746129806.486711:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053930880 00000100:00100000:0.0:1746129806.486719:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14433 00000100:00100000:0.0:1746129806.486722:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053930624:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129806.486771:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129806.486773:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486775:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486777:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129806 -> 1746129807 00002000:00010000:0.0:1746129806.486778:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129806.486792:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053930624:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 70us (177us total) trans 21474841088 rc 0/0 00000100:00100000:0.0:1746129806.486797:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14433 00000100:00100000:0.0:1746129806.486804:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14434 00000100:00100000:0.0:1746129806.486807:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053930752:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129806.486868:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4896768 -> 4896768 00002000:00010000:0.0:1746129806.486870:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486871:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.486873:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129806 -> 1746129807 00002000:00010000:0.0:1746129806.486874:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5545 -> 5545 00000100:00100000:0.0:1746129806.486885:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053930752:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 78us (244us total) trans 21474841089 rc 0/0 00000100:00100000:0.0:1746129806.486889:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14434 00000100:00100000:0.0:1746129806.486896:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14435 00000100:00100000:0.0:1746129806.486899:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053930880:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129806.486943:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129806.486945:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129805 -> 1746129806 00002000:00010000:0.0:1746129806.486946:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129805 -> 1746129806 00002000:00010000:0.0:1746129806.486948:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129805 -> 1746129807 00002000:00010000:0.0:1746129806.486950:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129806.486959:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053930880:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 60us (293us total) trans 17179873906 rc 0/0 00000100:00100000:0.0:1746129806.486966:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14435 00000100:00100000:0.0:1746129806.489432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.494039:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.527546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.543170:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053931648 00000100:00100000:0.0:1746129806.543178:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053931648 00000100:00100000:0.0:1746129806.543221:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4436 00000100:00100000:0.0:1746129806.543228:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31076:x1830949053931648:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129806.543462:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31076:x1830949053931648:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 233us (361us total) trans 8589944714 rc 0/0 00000100:00100000:0.0:1746129806.543468:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4436 00000100:00100000:0.0:1746129806.571278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.571813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.577900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.578836:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.583165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.584708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.589550:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.591721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.594327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.622394:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053933696 00000100:00100000:0.0:1746129806.622400:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053933696 00000100:00100000:0.0:1746129806.622434:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14454 00000100:00100000:0.0:1746129806.622441:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31088:x1830949053933696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129806.622454:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.622468:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952667 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3546bc expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.622488:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.622489:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129806.622496:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546bc expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.622508:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546bc expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.622517:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a56f9a00, rc 0) 00000100:00100000:0.0:1746129806.622551:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31088:x1830949053933696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.622555:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14454 00000100:00100000:0.0:1746129806.644260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.647472:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.662891:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.667682:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053862016:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129806.667698:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129806.667733:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949053934208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2003us (4895us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.667740:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7140 00000100:00100000:0.0:1746129806.674352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.684092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.696424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.713956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.726719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.726843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.742004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.752134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.767721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.767789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.775358:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053862528:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129806.775371:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053862656:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129806.775432:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129806.775492:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053936000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6294us (7780us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.775501:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7142 00000100:00100000:0.0:1746129806.775892:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.778805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.792246:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936896 00000100:00100000:0.0:1746129806.792253:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936896 00000100:00100000:0.0:1746129806.792291:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10769 00000100:00100000:0.0:1746129806.792298:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31086:x1830949053936896:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129806.792314:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129806.792317:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746129806.792339:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43952659 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546b5 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.792366:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129806.792371:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129806.792391:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0ff600/0x48868a4e43952698 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3546ed expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.792434:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0ff800/0x48868a4e4395269f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129806.792443:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439525d4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35468b expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.792449:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f901000/0x48868a4e43952636 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546ae expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.792455:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0ff800/0x48868a4e4395269f lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129806.792479:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f901000/0x48868a4e43952636 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546ae expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.792488:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f901000/0x48868a4e43952636 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546ae expref: 284 pid: 14313 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746129806.792497:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053862784:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129806.792557:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439525d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35468b expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129806.792564:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29800/0x48868a4e439525d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35468b expref: 7 pid: 16808 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746129806.792571:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053862912:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129806.792588:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129806.795779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.795813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.796575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.796614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:0.0:1746129806.816007:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944714 is committed 00000001:00080000:0.0:1746129806.816018:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944718 is committed 00000001:00080000:0.0:1746129806.816038:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944717 is committed 00000001:00080000:0.0:1746129806.816043:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944719 is committed 00000004:00080000:0.0:1746129806.816046:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2551 committed 00000004:00080000:0.0:1746129806.816052:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2533 committed 00000004:00080000:0.0:1746129806.816057:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2532 committed 00000004:00080000:0.0:1746129806.816059:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2531 committed 00000004:00080000:0.0:1746129806.816061:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2530 committed 00000004:00080000:0.0:1746129806.816062:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2550 committed 00000004:00080000:0.0:1746129806.816063:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2529 committed 00000004:00080000:0.0:1746129806.816065:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2549 committed 00000004:00080000:0.0:1746129806.816066:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2528 committed 00000004:00080000:0.0:1746129806.816068:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2548 committed 00000004:00080000:0.0:1746129806.816069:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2547 committed 00000004:00080000:0.0:1746129806.816070:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2546 committed 00000004:00080000:0.0:1746129806.816071:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2527 committed 00000004:00080000:0.0:1746129806.816073:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2526 committed 00000004:00080000:0.0:1746129806.816074:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2545 committed 00000004:00080000:0.0:1746129806.816075:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2544 committed 00000004:00080000:0.0:1746129806.816076:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2525 committed 00000100:00100000:0.0:1746129806.816103:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129806.816117:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053863040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.816167:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.816191:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053863168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.816205:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.816215:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053863680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.816228:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129806.816247:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053863040 00000100:00100000:0.0:1746129806.816252:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053863040 00000100:00100000:0.0:1746129806.816277:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053863552 00000100:00100000:0.0:1746129806.816279:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053863552 00000100:00100000:0.0:1746129806.816288:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053863168 00000100:00100000:0.0:1746129806.816289:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053863168 00000100:00100000:0.0:1746129806.816297:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053863680 00000100:00100000:0.0:1746129806.816298:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053863680 00000100:00100000:0.0:1746129806.816306:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053863296 00000100:00100000:0.0:1746129806.816307:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053863296 00000100:00100000:0.0:1746129806.816318:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14461 00000100:00100000:0.0:1746129806.816323:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3297:x1830949053863040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129806.816470:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129806.816473:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.816476:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.816477:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129807 -> 1746129807 00002000:00010000:0.0:1746129806.816479:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129806.816504:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053863040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 180us (337us total) trans 17179873915 rc 0/0 00000100:00100000:0.0:1746129806.816509:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14461 00000100:00100000:0.0:1746129806.816521:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14463 00000100:00100000:0.0:1746129806.816525:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053863168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129806.816587:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129806.816589:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.816591:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.816592:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129807 -> 1746129807 00002000:00010000:0.0:1746129806.816594:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129806.816611:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053863168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (404us total) trans 17179873917 rc 0/0 00000100:00100000:0.0:1746129806.816615:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14463 00000100:00100000:0.0:1746129806.816623:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14465 00000100:00100000:0.0:1746129806.816628:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053863296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129806.816688:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129806.816690:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.816692:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129806 -> 1746129806 00002000:00010000:0.0:1746129806.816694:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129807 -> 1746129807 00002000:00010000:0.0:1746129806.816695:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129806.816713:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053863296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (414us total) trans 17179873919 rc 0/0 00000100:00100000:0.0:1746129806.816718:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14465 00000100:00100000:0.0:1746129806.816726:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14468 00000100:00100000:0.0:1746129806.816730:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053863936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.816792:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053863936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (430us total) trans 17179873922 rc 0/0 00000100:00100000:0.0:1746129806.816797:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14468 00000004:00080000:0.0:1746129806.816820:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468e300/2, rc 0, transno 17179873917 00000100:00100000:0.0:1746129806.816824:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053863168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129806.816830:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423f800/2, rc 0, transno 17179873918 00000100:00100000:0.0:1746129806.816832:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053863680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129806.816837:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468d180/2, rc 0, transno 17179873915 00000100:00100000:0.0:1746129806.816839:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053863040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129806.817885:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053864704 00000100:00100000:0.0:1746129806.817888:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053864704 00000100:00100000:0.0:1746129806.817899:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053865216 00000100:00100000:0.0:1746129806.817901:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053865216 00000100:00100000:0.0:1746129806.817919:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053864576 00000100:00100000:0.0:1746129806.817921:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053864576 00000100:00100000:0.0:1746129806.817930:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053865088 00000100:00100000:0.0:1746129806.817931:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053865088 00000100:00100000:0.0:1746129806.817940:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14474 00000100:00100000:0.0:1746129806.817943:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053864704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.818019:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949053864704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (191us total) trans 21474841104 rc 0/0 00000100:00100000:0.0:1746129806.818024:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14474 00000100:00100000:0.0:1746129806.818032:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14475 00000100:00100000:0.0:1746129806.818036:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053865216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129806.818431:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949053865216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 394us (555us total) trans 21474841107 rc 0/0 00000100:00100000:0.0:1746129806.818435:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14475 00000100:00100000:0.0:1746129806.820784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.820960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.820990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.821011:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053937536 00000100:00100000:0.0:1746129806.821015:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053937536 00000100:00100000:0.0:1746129806.821040:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053937792 00000100:00100000:0.0:1746129806.821042:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053937792 00000100:00100000:0.0:1746129806.821467:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4437 00000100:00100000:0.0:1746129806.821509:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31088:x1830949053937536:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129806.821551:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31088:x1830949053937536:12345-192.168.204.31@tcp:49:cat.0 Request processed in 44us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129806.821946:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4437 00000100:00100000:0.0:1746129806.823046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.823112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.828908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.828948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.831303:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.831315:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.831890:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.832337:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.833059:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.836834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.838275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.839280:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.847073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.847274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.853298:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.853311:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.864793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.867443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.867493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.868624:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.870036:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.876440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.879954:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.880001:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.880766:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053942400 00000100:00100000:0.0:1746129806.880769:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053942400 00002000:00100000:0.0:1746129806.880787:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a504df80 x1830949053942400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.880801:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504df80 with x1830949053942400 ext(3145728->4194303) 00002000:00010000:0.0:1746129806.880804:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504df80 00000100:00100000:0.0:1746129806.880824:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6377 00000100:00100000:0.0:1746129806.880830:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949053942144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129806.883991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.894521:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.900305:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.902795:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949053942400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21550us (22793us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129806.902801:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6378 00002000:00100000:0.0:1746129806.902806:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a504df80 x1830949053942400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/440 e 0 to 0 dl 1746129817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.904680:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504df80 with x1830949053942400 ext(3145728->4194303) 00002000:00010000:0.0:1746129806.904686:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504df80 00000100:00100000:0.0:1746129806.905313:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949053942144:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24482us (25370us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129806.905319:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6377 00002000:00100000:0.0:1746129806.905325:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a504fb80 x1830949053942144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/440 e 0 to 0 dl 1746129817 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.905331:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949053942144 ext(3145728->4194303) 00002000:00010000:0.0:1746129806.905335:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504fb80 00000100:00100000:0.0:1746129806.905345:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053943424 00000100:00100000:0.0:1746129806.905350:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053943424 00002000:00100000:0.0:1746129806.905369:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1236991) req@ffff88009f6a4700 x1830949053943424/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.905375:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949053943424 ext(1048576->1236991) 00010000:00010000:0.0:1746129806.905390:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013186e600/0x48868a4e439526d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354725 expref: 13 pid: 3624 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746129806.905402:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013186e600/0x48868a4e439526d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1236991) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354725 expref: 13 pid: 3624 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746129806.905407:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a4700 00000100:00100000:0.0:1746129806.906125:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1736 00000100:00100000:0.0:1746129806.906132:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949053943424:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129806.918841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.920822:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.923392:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.923428:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.929688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.929760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.930462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.930555:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944192 00000100:00100000:0.0:1746129806.930562:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944192 00002000:00100000:0.0:1746129806.930594:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88013061dc00 x1830949053944192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.930602:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061dc00 with x1830949053944192 ext(4194304->4898815) 00002000:00010000:0.0:1746129806.930607:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061dc00 00000100:00100000:0.0:1746129806.930619:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944448 00000100:00100000:0.0:1746129806.930621:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944448 00002000:00100000:0.0:1746129806.930628:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff88013061f100 x1830949053944448/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.930634:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061f100 with x1830949053944448 ext(4194304->4898815) 00002000:00010000:0.0:1746129806.930636:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061f100 00000100:00100000:0.0:1746129806.930642:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944704 00000100:00100000:0.0:1746129806.930643:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944704 00002000:00100000:0.0:1746129806.930650:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1802240->1806335) req@ffff88013061d500 x1830949053944704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:547/0 lens 488/0 e 0 to 0 dl 1746129817 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129806.930655:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061d500 with x1830949053944704 ext(1802240->1806335) 00002000:00010000:0.0:1746129806.930658:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013061d500 00000100:00100000:0.0:1746129806.930666:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6382 00000100:00100000:0.0:1746129806.930671:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949053944192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129806.943886:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.943916:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.943959:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.951244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.951290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129806.958493:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.053966:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.059692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.111800:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129807.112433:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129807.138033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.143287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.143327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.143368:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053946880 00000100:00100000:0.0:1746129807.143383:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053946880 00010000:00010000:0.0:1746129807.143410:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094334000/0x48868a4e4395268a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546df expref: 19 pid: 3623 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746129807.143430:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053946752 00000100:00100000:0.0:1746129807.143432:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053946752 00010000:00010000:0.0:1746129807.143439:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3df600/0x48868a4e43952691 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546e6 expref: 19 pid: 1877 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746129807.143462:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7153 00000100:00100000:0.0:1746129807.143470:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053946880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129807.143481:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129807.143499:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094334000/0x48868a4e4395268a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546df expref: 19 pid: 3623 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.143509:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094334000/0x48868a4e4395268a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546df expref: 19 pid: 3623 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.143531:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129807.143563:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053946880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.143569:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7153 00000100:00100000:0.0:1746129807.143582:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7154 00000100:00100000:0.0:1746129807.143586:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949053946752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129807.143593:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129807.143599:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a3df600/0x48868a4e43952691 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546e6 expref: 19 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.143607:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a3df600/0x48868a4e43952691 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546e6 expref: 19 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.143617:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.143619:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.143625:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4395276a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1163264->1552383) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354780 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.143632:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4395276a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1163264->1552383) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354780 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.143656:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4395276a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1163264->1552383) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354780 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129807.143665:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053868544:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129807.149718:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.162107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.170141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.174834:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.181987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.182031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.184510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.196645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.198708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.199807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.199825:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053948800 00000100:00100000:0.0:1746129807.199827:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053948800 00000100:00100000:0.0:1746129807.199862:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14496 00000100:00100000:0.0:1746129807.199866:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949053948800:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.199878:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.199888:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009330be00/0x48868a4e439527c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3547a3 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129807.199922:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053868928:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129807.199969:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129807.203168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.203200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.204608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.216933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.234364:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.239083:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053950080 00000100:00100000:0.0:1746129807.239089:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053950080 00002000:00100000:0.0:1746129807.239123:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1163264->1552383) req@ffff88009ff39180 x1830949053950080/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:548/0 lens 488/0 e 0 to 0 dl 1746129818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129807.239133:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff39180 with x1830949053950080 ext(1163264->1552383) 00010000:00010000:0.0:1746129807.239140:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4395276a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354780 expref: 17 pid: 3624 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.239152:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a12bc00/0x48868a4e4395276a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1552383) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354780 expref: 17 pid: 3624 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746129807.239159:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff39180 00000100:00100000:0.0:1746129807.239177:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1737 00000100:00100000:0.0:1746129807.239183:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949053950080:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129807.242542:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.250021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.268838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.268907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.278461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.283420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.283457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.283529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.285920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.288745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.288773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.288786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.288799:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951872 00000100:00100000:0.0:1746129807.288803:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951872 00000100:00100000:0.0:1746129807.288831:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14501 00000100:00100000:0.0:1746129807.288837:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053952128:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129807.288844:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.288868:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3547e2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.288879:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.288881:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.288886:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e2 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.288895:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e2 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.288903:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5200, rc 0) 00000100:00100000:0.0:1746129807.288929:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053952128:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 93us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.288938:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14501 00000100:00080000:0.0:1746129807.288952:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129807.288973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.288983:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951744 00000100:00100000:0.0:1746129807.288986:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951744 00000100:00100000:0.0:1746129807.289000:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14503 00000100:00100000:0.0:1746129807.289005:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053951744:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129807.289011:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.289018:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43952812 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3547cd expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.289028:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.289035:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43952812 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547cd expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.289044:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b22c4a00/0x48868a4e43952812 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547cd expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.289056:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c4a00, rc 0) 00000100:00100000:0.0:1746129807.289070:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053951744:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 65us (98us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129807.289075:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14503 00000100:00100000:0.0:1746129807.289112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.289411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.289423:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952256 00000100:00100000:0.0:1746129807.289426:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952256 00000100:00100000:0.0:1746129807.289670:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14505 00000100:00100000:0.0:1746129807.289676:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053952256:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129807.289682:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.289689:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b22c5000/0x48868a4e43952820 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3547e9 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.289698:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.289700:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.289704:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b22c5000/0x48868a4e43952820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e9 expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.289713:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b22c5000/0x48868a4e43952820 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e9 expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.289720:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b22c5000, rc 0) 00000100:00100000:0.0:1746129807.289734:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053952256:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.289739:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14505 00000100:00100000:0.0:1746129807.300125:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053869824:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129807.300931:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e4395280b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547d4 expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.300945:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e4395280b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547d4 expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.301836:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbca00, rc 0) 00000100:00100000:0.0:1746129807.308584:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.316599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.316687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.316715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.318836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.322015:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1739 00000100:00100000:0.0:1746129807.322062:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949053953152:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129807.323839:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.326050:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.342812:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.355091:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14510 00000100:00100000:0.0:1746129807.356965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.363249:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.364359:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053954688 00000100:00100000:1.0:1746129807.364367:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053954688 00000100:00100000:1.0:1746129807.364430:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4446 00000100:00100000:1.0:1746129807.364437:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31100:x1830949053954688:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129807.364626:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31100:x1830949053954688:12345-192.168.204.31@tcp:35:cat.0 Request processed in 189us (1382us total) trans 8589944731 rc 0/0 00000100:00100000:1.0:1746129807.364632:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4446 00000100:00100000:0.0:1746129807.367748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.391293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.393509:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.393641:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053955072 00000100:00100000:1.0:1746129807.393645:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053955072 00000100:00100000:1.0:1746129807.393664:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14511 00000100:00100000:1.0:1746129807.393669:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31104:x1830949053955072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129807.393680:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129807.393692:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a4d400/0x48868a4e4395286d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354821 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.393708:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.393710:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.393715:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4d400/0x48868a4e4395286d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354821 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.393726:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a4d400/0x48868a4e4395286d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354821 expref: 19 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.393734:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4d400, rc 0) 00000100:00100000:1.0:1746129807.393769:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31104:x1830949053955072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 99us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.393774:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14511 00000100:00100000:0.0:1746129807.399964:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.403059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.403122:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053955456 00000100:00100000:0.0:1746129807.403129:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053955456 00002000:00100000:0.0:1746129807.403159:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1298432->1302527) req@ffff88009ff39500 x1830949053955456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:548/0 lens 488/0 e 0 to 0 dl 1746129818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129807.403168:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff39500 with x1830949053955456 ext(1298432->1302527) 00002000:00010000:0.0:1746129807.403172:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff39500 00000100:00100000:0.0:1746129807.403201:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6395 00000100:00100000:0.0:1746129807.403207:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949053955456:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129807.404355:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949053955456:12345-192.168.204.31@tcp:3:cat.0 Request processed in 113us (268us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129807.404363:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6395 00002000:00100000:0.0:1746129807.404381:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1298432->1302527) req@ffff88009ff39500 x1830949053955456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:548/0 lens 488/4536 e 0 to 0 dl 1746129818 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129807.404389:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff39500 with x1830949053955456 ext(1298432->1302527) 00002000:00010000:0.0:1746129807.404394:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff39500 00000100:00100000:0.0:1746129807.412162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.418824:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.424907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.424942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.425002:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053956352 00000100:00100000:0.0:1746129807.425009:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053956352 00000100:00100000:0.0:1746129807.425056:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053956480 00000100:00100000:0.0:1746129807.425058:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053956480 00000100:00100000:0.0:1746129807.425073:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14512 00000100:00100000:0.0:1746129807.425079:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949053956352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.425093:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.425106:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e43952897 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35482f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129807.425149:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053871104:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129807.425214:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129807.446575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.446628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.458486:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053956864 00000100:00100000:0.0:1746129807.458494:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053956864 00000100:00100000:0.0:1746129807.462773:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14516 00000100:00100000:0.0:1746129807.462788:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949053956864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.462803:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.462818:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e439528b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35484b expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129807.462874:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053871616:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129807.462958:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129807.464090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.464123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.464198:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053871616:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129807.464220:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e439528b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35484b expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.464230:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbca00/0x48868a4e439528b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35484b expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.464242:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbca00, rc 0) 00000100:00100000:0.0:1746129807.464266:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949053956864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1484us (5878us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129807.464272:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14516 00000100:00100000:0.0:1746129807.464287:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053957120 00000100:00100000:0.0:1746129807.464291:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053957120 00000100:00100000:0.0:1746129807.464310:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14517 00000100:00100000:0.0:1746129807.464314:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949053957120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.464321:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.464329:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e439528ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354859 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129807.464351:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053871744:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129807.464396:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880136366d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129807.466975:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053871744:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129807.466996:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e439528ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354859 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.467006:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc000/0x48868a4e439528ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354859 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.467013:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbc000, rc 0) 00000100:00100000:0.0:1746129807.467048:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949053957120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2731us (2923us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129807.467053:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14517 00000100:00100000:1.0:1746129807.469409:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.469479:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053957248 00000100:00100000:0.0:1746129807.469485:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053957248 00000100:00100000:0.0:1746129807.474108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.479169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.487622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.492559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.492626:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958144 00000100:00100000:1.0:1746129807.492633:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958144 00000100:00100000:1.0:1746129807.492666:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10783 00000100:00100000:1.0:1746129807.492672:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31115:x1830949053958144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129807.492712:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129807.492727:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0400/0x48868a4e439528f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354875 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.492825:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.492843:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.492883:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.492901:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.492906:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.492920:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493080:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e4395290e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493091:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e4395290e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493111:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e4395290e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129807.493128:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:1.0:1746129807.493238:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493258:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493263:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493268:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54b0000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129807.493272:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493286:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493315:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129807.493331:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129807.493334:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493339:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0000/0x48868a4e43952900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493377:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493392:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493397:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493401:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54b0c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129807.493403:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493407:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493422:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2a6d00) 00010000:00010000:1.0:1746129807.493425:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129807.493427:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493431:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0c00/0x48868a4e43952907 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129807.493490:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0400/0x48868a4e439528f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354875 expref: 292 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.493507:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e4395290e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354875 expref: 291 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.493513:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129807.493515:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129807.493517:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0e00, rc 0) 00000100:00100000:1.0:1746129807.493566:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31115:x1830949053958144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 888us (1012us total) trans 8589944735 rc 0/0 00000100:00100000:1.0:1746129807.493572:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10783 00000100:00100000:0.0:1746129807.493877:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.493912:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.493928:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958272 00000100:00100000:0.0:1746129807.493932:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958272 00010000:00010000:0.0:1746129807.493948:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd22a00/0x48868a4e439528d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354852 expref: 11 pid: 15044 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746129807.493968:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958400 00000100:00100000:0.0:1746129807.493970:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958400 00010000:00010000:0.0:1746129807.493979:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136920800/0x48868a4e43952889 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354828 expref: 17 pid: 14315 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746129807.493992:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7162 00000100:00100000:0.0:1746129807.493997:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053958272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129807.494005:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129807.494009:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd22a00/0x48868a4e439528d6 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354852 expref: 11 pid: 15044 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.494017:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd22a00/0x48868a4e439528d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354852 expref: 11 pid: 15044 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.494030:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bd22a00/0x48868a4e439528d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354852 expref: 11 pid: 15044 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.494042:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129807.494046:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c6800/0x48868a4e439528f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.494053:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c6800/0x48868a4e439528f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.494057:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129807.494084:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053958272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.494090:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7162 00000100:00100000:0.0:1746129807.494131:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7163 00000100:00100000:0.0:1746129807.494138:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949053958400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129807.494146:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129807.494150:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136920800/0x48868a4e43952889 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354828 expref: 17 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.494159:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136920800/0x48868a4e43952889 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354828 expref: 17 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.494170:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129807.494173:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c6800/0x48868a4e439528f2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.494179:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c6800/0x48868a4e439528f2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.494184:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3c6800/0x48868a4e439528f2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.494198:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129807.494219:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949053958400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.494225:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7163 00000100:00100000:0.0:1746129807.496768:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.504296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.504327:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.504526:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959040 00000100:00100000:1.0:1746129807.504531:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959040 00002000:00100000:1.0:1746129807.504560:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1384447) req@ffff88009c1c4700 x1830949053959040/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:548/0 lens 488/0 e 0 to 0 dl 1746129818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129807.504568:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4700 with x1830949053959040 ext(1048576->1384447) 00002000:00010000:1.0:1746129807.504572:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c4700 00000100:00100000:1.0:1746129807.504596:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6396 00000100:00100000:1.0:1746129807.504602:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949053959040:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129807.510340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.510402:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959552 00000100:00100000:1.0:1746129807.510410:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959552 00000100:00100000:1.0:1746129807.510502:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4449 00000100:00100000:1.0:1746129807.510511:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31111:x1830949053959552:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129807.510693:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31111:x1830949053959552:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 183us (359us total) trans 8589944737 rc 0/0 00000100:00100000:1.0:1746129807.510699:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4449 00000100:00100000:0.0:1746129807.531458:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.536781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.536820:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.536834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.536894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.536933:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959808 00000100:00100000:1.0:1746129807.536941:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959808 00010000:00010000:1.0:1746129807.536969:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bd22800/0x48868a4e43952819 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547db expref: 11 pid: 8436 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746129807.537000:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960320 00000100:00100000:1.0:1746129807.537002:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960320 00010000:00010000:1.0:1746129807.537011:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4c600/0x48868a4e439527cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547aa expref: 19 pid: 1877 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746129807.537040:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7165 00000100:00100000:1.0:1746129807.537045:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949053960064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.537055:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.537072:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a4d400/0x48868a4e4395286d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354821 expref: 21 pid: 3624 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.537081:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a4d400/0x48868a4e4395286d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354821 expref: 21 pid: 3624 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746129807.537100:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7166 00000100:00100000:0.0:1746129807.537106:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949053960320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129807.537112:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129807.537159:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a4c600/0x48868a4e439527cc lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547aa expref: 19 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.537165:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a4c600/0x48868a4e439527cc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547aa expref: 19 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.537177:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129807.537209:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949053960320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 105us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.537214:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7166 00010000:00010000:1.0:1746129807.537465:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.537468:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.537475:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.537483:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.537513:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129807.537523:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053872768:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129807.538189:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129807.538201:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960192 00000100:00100000:1.0:1746129807.538204:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960192 00000100:00100000:1.0:1746129807.538223:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4450 00000100:00100000:1.0:1746129807.538228:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31115:x1830949053960192:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129807.538568:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31115:x1830949053960192:12345-192.168.204.31@tcp:35:cat.0 Request processed in 337us (1671us total) trans 8589944738 rc 0/0 00000100:00100000:1.0:1746129807.538574:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4450 00000100:00100000:1.0:1746129807.540494:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053872768:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129807.540510:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.540541:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949053960064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3494us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.540549:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7165 00000100:00100000:0.0:1746129807.541076:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.548155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.554029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.554249:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960832 00000100:00100000:1.0:1746129807.554257:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960832 00010000:00010000:1.0:1746129807.554287:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e2 expref: 10 pid: 10930 timeout: 853 lvb_type: 1 00000100:00100000:1.0:1746129807.554326:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7167 00000100:00100000:1.0:1746129807.554334:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053960832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.554346:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.554363:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e2 expref: 10 pid: 10930 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746129807.554381:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e2 expref: 10 pid: 10930 timeout: 853 lvb_type: 1 00010000:00010000:1.0:1746129807.554399:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b22c5200/0x48868a4e43952804 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547e2 expref: 10 pid: 10930 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746129807.554418:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.554467:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129807.554937:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.554975:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949053960832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 642us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.554981:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7167 00000100:00100000:1.0:1746129807.554994:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960960 00000100:00100000:1.0:1746129807.554996:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960960 00010000:00010000:1.0:1746129807.555004:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f981600/0x48868a4e439526d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35471e expref: 18 pid: 10930 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746129807.555228:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7168 00000100:00100000:1.0:1746129807.555323:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949053960960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.555332:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.555341:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f981600/0x48868a4e439526d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35471e expref: 18 pid: 10930 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.555349:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f981600/0x48868a4e439526d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35471e expref: 18 pid: 10930 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.555360:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f981600/0x48868a4e439526d0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35471e expref: 18 pid: 10930 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.555380:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.555399:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949053960960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 165us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.555404:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7168 00000100:00100000:1.0:1746129807.555414:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7169 00000100:00100000:1.0:1746129807.555418:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949053961088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.556219:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.556231:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f981e00/0x48868a4e439526c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354710 expref: 20 pid: 3624 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.556240:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f981e00/0x48868a4e439526c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354710 expref: 20 pid: 3624 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.556253:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f981e00/0x48868a4e439526c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354710 expref: 20 pid: 3624 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.556261:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.556263:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.556269:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952938 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35488a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.556275:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35488a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.556302:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952938 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2420735) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35488a expref: 19 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129807.556312:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053873280:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129807.556385:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129807.558181:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949053873280:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129807.558197:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.558517:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949053961088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3095us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.558526:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7169 00000100:00100000:0.0:1746129807.560989:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.563614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.563875:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961600 00000100:00100000:1.0:1746129807.563881:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961600 00000100:00100000:1.0:1746129807.563920:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4451 00000100:00100000:1.0:1746129807.563926:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31109:x1830949053961600:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129807.564089:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31109:x1830949053961600:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 162us (480us total) trans 8589944739 rc 0/0 00000100:00100000:1.0:1746129807.564094:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4451 00000100:00100000:0.0:1746129807.631140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.682553:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.683000:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4452 00000100:00100000:1.0:1746129807.683009:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31120:x1830949053962112:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129807.684227:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31120:x1830949053962112:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1216us (1676us total) trans 8589944741 rc 0/0 00000100:00100000:1.0:1746129807.684236:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4452 00000100:00100000:0.0:1746129807.702258:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.718491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.722387:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.722450:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.723240:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14523 00000100:00100000:0.0:1746129807.723246:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949053962880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.723262:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.723269:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e439529a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3548ad expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129807.723301:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053873536:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129807.723388:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363660c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129807.726241:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053873536:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129807.726276:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e439529a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548ad expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129807.726290:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e439529a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548ad expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129807.726314:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbda00, rc 0) 00000100:00100000:1.0:1746129807.726749:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949053962880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3499us (4303us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129807.726757:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14523 00000100:00100000:0.0:1746129807.737104:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.743976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.761473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.761535:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963264 00000100:00100000:1.0:1746129807.761543:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963264 00010000:00010000:1.0:1746129807.761577:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091b90000/0x48868a4e439527f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547bf expref: 28 pid: 1877 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746129807.761629:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7170 00000100:00100000:1.0:1746129807.761639:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949053963264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.761654:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.761676:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091b90000/0x48868a4e439527f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547bf expref: 28 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.761687:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091b90000/0x48868a4e439527f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547bf expref: 28 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.761709:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091b90000/0x48868a4e439527f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547bf expref: 28 pid: 1877 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.761747:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.761750:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.761757:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b771400/0x48868a4e439529a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548b4 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.761766:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b771400/0x48868a4e439529a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548b4 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.761804:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b771400/0x48868a4e439529a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548b4 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129807.761818:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053873792:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129807.763285:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129807.763601:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053873792:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129807.763619:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.763659:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949053963264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2019us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.763667:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7170 00000100:00100000:0.0:1746129807.766069:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.768354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.768388:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963776 00000100:00100000:0.0:1746129807.768394:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963776 00000100:00100000:0.0:1746129807.768433:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10788 00000100:00100000:0.0:1746129807.768454:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31129:x1830949053963776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.768474:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.768494:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc000/0x48868a4e439529af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3548bb expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.768979:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbca00/0x48868a4e439529b6 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129807.768995:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbca00/0x48868a4e439529b6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129807.769011:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbca00/0x48868a4e439529b6 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129807.769023:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:0.0:1746129807.769141:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbc000/0x48868a4e439529af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548bb expref: 297 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.769187:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffbca00/0x48868a4e439529b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548bb expref: 296 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.769196:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129807.769198:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746129807.769202:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbca00, rc 0) 00000100:00100000:0.0:1746129807.769235:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31129:x1830949053963776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 795us (886us total) trans 8589944744 rc 0/0 00000100:00100000:0.0:1746129807.769242:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10788 00000100:00100000:0.0:1746129807.778940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.779271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.779412:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964032 00000100:00100000:1.0:1746129807.779416:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964032 00000100:00100000:1.0:1746129807.779443:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14526 00000100:00100000:1.0:1746129807.779448:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949053964032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129807.779454:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129807.779462:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1e00/0x48868a4e439529cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3548c9 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129807.779493:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053873920:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129807.780660:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129807.782885:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:1.0:1746129807.786376:0:1877:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129807 -> 1746129808 00002000:00010000:1.0:1746129807.786379:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129807 -> 1746129808 00002000:00010000:1.0:1746129807.786381:0:1877:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129807 -> 1746129808 00000100:00100000:1.0:1746129807.786397:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053873920:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129807.786420:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1e00/0x48868a4e439529cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c9 expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129807.786429:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1e00/0x48868a4e439529cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c9 expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129807.786441:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1e00, rc 0) 00000100:00100000:1.0:1746129807.786465:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053964032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7016us (7194us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129807.786470:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14526 00000100:00100000:0.0:1746129807.790274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.791386:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964288 00000100:00100000:1.0:1746129807.791391:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964288 00000100:00100000:1.0:1746129807.791421:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14528 00000100:00100000:1.0:1746129807.791427:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31126:x1830949053964288:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129807.791440:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129807.791449:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3548d7 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.791468:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.791473:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129807.791474:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129807.791477:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.791500:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.791511:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 27 pid: 20441 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746129807.791521:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053874176:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129807.791563:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129807.796756:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053874176:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129807.796783:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.796797:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0e00, rc 0) 00000100:00100000:1.0:1746129807.796838:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31126:x1830949053964288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5409us (6573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.796863:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14528 00000100:00100000:0.0:1746129807.797424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.804280:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.813601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.813664:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964800 00000100:00100000:1.0:1746129807.813675:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964800 00010000:00010000:1.0:1746129807.813703:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 32 pid: 20441 timeout: 853 lvb_type: 0 00000100:00100000:1.0:1746129807.813725:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7171 00000100:00100000:1.0:1746129807.813731:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949053964800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.813741:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.813758:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 32 pid: 20441 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.813772:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 32 pid: 20441 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.813790:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6a1400/0x48868a4e4395285f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1302527) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354813 expref: 32 pid: 20441 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.813818:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.813820:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.813826:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.813832:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.813883:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129807.813894:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053874304:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129807.813952:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129807.815707:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053874304:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129807.815724:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.815762:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949053964800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2030us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.815770:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7171 00000100:00100000:0.0:1746129807.820316:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.821873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.822494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.827537:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.828959:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.829047:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053965696 00000100:00100000:1.0:1746129807.829055:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053965696 00000100:00100000:1.0:1746129807.829097:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14529 00000100:00100000:1.0:1746129807.829104:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31129:x1830949053965696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129807.829118:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129807.829132:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3548de expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.829150:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.829151:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129807.829157:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 30 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.829168:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 30 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129807.829176:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1600, rc 0) 00000100:00100000:1.0:1746129807.829211:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31129:x1830949053965696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.829217:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14529 00000100:00100000:0.0:1746129807.831233:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.836614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.837131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.837163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.837179:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053966720 00000100:00100000:0.0:1746129807.837179:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053966592 00000100:00100000:1.0:1746129807.837185:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053966720 00000100:00100000:0.0:1746129807.837185:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053966592 00010000:00010000:1.0:1746129807.837213:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770800/0x48868a4e43952954 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354891 expref: 298 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.837213:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b771e00/0x48868a4e43952977 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354898 expref: 22 pid: 14315 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746129807.837233:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7172 00000100:00100000:1.0:1746129807.837239:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7173 00000100:00100000:0.0:1746129807.837239:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949053966592:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129807.837243:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1964:x1830949053966720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129807.837250:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129807.837250:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129807.837254:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770800/0x48868a4e43952954 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354891 expref: 298 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.837254:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b771e00/0x48868a4e43952977 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354898 expref: 22 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.837263:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b771e00/0x48868a4e43952977 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354898 expref: 22 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.837446:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770800/0x48868a4e43952954 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354891 expref: 298 pid: 14315 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746129807.837465:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129807.837469:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.837477:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129807.837481:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129807.837486:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129807.837488:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129807.837493:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129807.837516:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1964:x1830949053966720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 271us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129807.837522:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7173 00000100:00100000:0.0:1746129807.837823:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949053966592:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 584us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.837829:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7172 00000100:00100000:0.0:1746129807.850892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.850931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.851141:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6407 00000100:00100000:1.0:1746129807.851150:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949053966976:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129807.861651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.866621:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949053966976:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15461us (15677us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129807.866633:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6407 00002000:00100000:1.0:1746129807.866645:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2973696->4022271) req@ffff880095241f80 x1830949053966976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:548/0 lens 488/440 e 0 to 0 dl 1746129818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129807.866654:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949053966976 ext(2973696->4022271) 00002000:00010000:1.0:1746129807.866659:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241f80 00000100:00100000:0.0:1746129807.868419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.868628:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053967488 00000100:00100000:1.0:1746129807.868636:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053967488 00002000:00100000:1.0:1746129807.868667:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1585152->2097151) req@ffff880095242300 x1830949053967488/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:548/0 lens 488/0 e 0 to 0 dl 1746129818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129807.868675:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242300 with x1830949053967488 ext(1585152->2097151) 00010000:00010000:1.0:1746129807.868682:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 19 pid: 7975 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.868694:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 19 pid: 7975 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746129807.868700:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095242300 00000100:00100000:1.0:1746129807.868731:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1743 00000100:00100000:1.0:1746129807.868738:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949053967488:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129807.874126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.885019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.887999:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949053967488:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19254us (19579us total) trans 21474841109 rc 0/0 00000100:00100000:1.0:1746129807.888008:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1743 00002000:00100000:1.0:1746129807.888017:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1585152->2097151) req@ffff880095242300 x1830949053967488/t21474841109(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:548/0 lens 488/448 e 0 to 0 dl 1746129818 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129807.888025:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242300 with x1830949053967488 ext(1585152->2097151) 00010000:00010000:1.0:1746129807.888033:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 23 pid: 7975 timeout: 853 lvb_type: 0 00010000:00010000:1.0:1746129807.888046:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43952931 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354883 expref: 23 pid: 7975 timeout: 853 lvb_type: 0 00002000:00010000:1.0:1746129807.888052:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095242300 00000100:00100000:0.0:1746129807.896992:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.903323:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053968128 00000100:00100000:0.0:1746129807.903330:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053968128 00000100:00100000:0.0:1746129807.903370:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14532 00000100:00100000:0.0:1746129807.903377:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949053968128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129807.903392:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129807.903407:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3548fa expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129807.903433:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.903435:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129807.903443:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548fa expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.903457:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548fa expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129807.903466:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f400, rc 0) 00000100:00100000:0.0:1746129807.903685:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949053968128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 305us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129807.903694:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14532 00000100:00100000:0.0:1746129807.906464:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.935288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.940491:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129807.961812:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.972295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.972338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129807.975096:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053969280 00000100:00100000:1.0:1746129807.975103:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053969280 00002000:00100000:1.0:1746129807.975134:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88013061f800 x1830949053969280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:548/0 lens 488/0 e 0 to 0 dl 1746129818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129807.975143:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061f800 with x1830949053969280 ext(3145728->4194303) 00002000:00010000:1.0:1746129807.975148:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061f800 00000100:00100000:1.0:1746129807.975188:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6411 00000100:00100000:1.0:1746129807.975196:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949053969280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129807.990213:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053969280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15008us (17864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129807.990224:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6411 00002000:00100000:1.0:1746129807.990235:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88013061f800 x1830949053969280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:548/0 lens 488/440 e 0 to 0 dl 1746129818 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129807.990244:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061f800 with x1830949053969280 ext(3145728->4194303) 00002000:00010000:1.0:1746129807.990250:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061f800 00000100:00100000:0.0:1746129808.004766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.004813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.004910:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053969792 00000100:00100000:1.0:1746129808.004918:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053969792 00002000:00100000:1.0:1746129808.004961:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff880094a4dc00 x1830949053969792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.004970:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4dc00 with x1830949053969792 ext(4194304->4898815) 00002000:00010000:1.0:1746129808.004974:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4dc00 00000100:00100000:1.0:1746129808.005004:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6412 00000100:00100000:1.0:1746129808.005011:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949053969792:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129808.006944:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129808.014217:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949053969792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9198us (9394us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746129808.014227:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6412 00002000:00100000:1.0:1746129808.014237:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4898815) req@ffff880094a4dc00 x1830949053969792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/440 e 0 to 0 dl 1746129819 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.014245:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4dc00 with x1830949053969792 ext(4194304->4898815) 00002000:00010000:1.0:1746129808.014249:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4dc00 00000100:00100000:0.0:1746129808.023258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129808.023469:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129808.034765:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.034873:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129808.036290:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129808.036325:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.036389:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053970304 00000100:00100000:1.0:1746129808.036394:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053970304 00010000:00010000:1.0:1746129808.036410:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013186ea00/0x48868a4e439526e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354733 expref: 31 pid: 20441 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.036426:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7178 00000100:00100000:1.0:1746129808.036432:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949053970304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.036438:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.036447:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013186ea00/0x48868a4e439526e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354733 expref: 31 pid: 20441 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.036455:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013186ea00/0x48868a4e439526e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354733 expref: 31 pid: 20441 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.036468:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013186ea00/0x48868a4e439526e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354733 expref: 31 pid: 20441 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.041553:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.041558:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.041569:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.041578:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.041618:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.041630:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053875712:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129808.041714:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00080000:0.0:1746129808.046128:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129808.046202:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053875712:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129808.046215:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.047463:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949053970304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11027us (11136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.047471:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7178 00000100:00100000:0.0:1746129808.048596:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.048660:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053970816 00000100:00100000:1.0:1746129808.048667:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053970816 00002000:00100000:1.0:1746129808.048696:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (4018176->4022271) req@ffff88009468ea00 x1830949053970816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.048705:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ea00 with x1830949053970816 ext(4018176->4022271) 00002000:00010000:1.0:1746129808.048709:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ea00 00000100:00100000:1.0:1746129808.048736:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6413 00000100:00100000:1.0:1746129808.048742:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949053970816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129808.049603:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949053970816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 858us (1007us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129808.049610:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6413 00002000:00100000:1.0:1746129808.049616:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (4018176->4022271) req@ffff88009468ea00 x1830949053970816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/4536 e 0 to 0 dl 1746129819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.049667:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ea00 with x1830949053970816 ext(4018176->4022271) 00002000:00010000:1.0:1746129808.049670:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ea00 00000100:00100000:0.0:1746129808.051123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.059568:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.059612:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.060297:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971072 00000100:00100000:1.0:1746129808.060301:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971072 00010000:00010000:1.0:1746129808.060318:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7c00/0x48868a4e43952a34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354916 expref: 24 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.060336:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7179 00000100:00100000:1.0:1746129808.060341:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949053971072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.060349:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.060374:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7c00/0x48868a4e43952a34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354916 expref: 24 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.060383:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7c00/0x48868a4e43952a34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354916 expref: 24 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.060398:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7c00/0x48868a4e43952a34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354916 expref: 24 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.060410:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.060427:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949053971072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.060431:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7179 00000100:00100000:0.0:1746129808.065219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.066668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.066936:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971584 00000100:00100000:1.0:1746129808.066940:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971584 00002000:00100000:1.0:1746129808.066964:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012c088e00 x1830949053971584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.066972:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088e00 with x1830949053971584 ext(1048576->2097151) 00002000:00010000:1.0:1746129808.066976:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c088e00 00000100:00100000:1.0:1746129808.066987:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6414 00000100:00100000:1.0:1746129808.066991:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949053971584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129808.074735:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971840 00000100:00100000:0.0:1746129808.074741:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971840 00002000:00100000:0.0:1746129808.074770:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3108864->3112959) req@ffff88012b026a00 x1830949053971840/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.074778:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026a00 with x1830949053971840 ext(3108864->3112959) 00002000:00010000:0.0:1746129808.075000:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026a00 00000100:00100000:0.0:1746129808.075029:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6415 00000100:00100000:0.0:1746129808.075036:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949053971840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129808.075163:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949053971840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 128us (483us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129808.075169:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6415 00002000:00100000:0.0:1746129808.075175:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3108864->3112959) req@ffff88012b026a00 x1830949053971840/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/4536 e 0 to 0 dl 1746129819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.075181:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026a00 with x1830949053971840 ext(3108864->3112959) 00002000:00010000:0.0:1746129808.075184:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026a00 00000100:00100000:1.0:1746129808.081415:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949053971584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14415us (14739us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129808.081425:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6414 00002000:00100000:1.0:1746129808.081434:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012c088e00 x1830949053971584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/440 e 0 to 0 dl 1746129819 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.081442:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088e00 with x1830949053971584 ext(1048576->2097151) 00002000:00010000:1.0:1746129808.081446:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c088e00 00000100:00100000:0.0:1746129808.081627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.081946:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971968 00000100:00100000:1.0:1746129808.081952:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971968 00000100:00100000:1.0:1746129808.081997:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14539 00000100:00100000:1.0:1746129808.082004:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31136:x1830949053971968:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129808.082016:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.082040:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354932 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.082061:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.082068:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.082070:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.082073:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2379775] (req 2097152->2379775) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.082096:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.082106:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 29 pid: 20441 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.082115:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053876480:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.082457:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.083577:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053876480:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.083597:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2379775] (req 2097152->2379775) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.083609:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbd800, rc 0) 00000100:00100000:1.0:1746129808.083649:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a1eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31136:x1830949053971968:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1645us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.083655:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14539 00000100:00100000:0.0:1746129808.089827:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.089939:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.090153:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972224 00000100:00100000:1.0:1746129808.090157:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972224 00000100:00100000:1.0:1746129808.090235:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14541 00000100:00100000:1.0:1746129808.090241:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949053972224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129808.090248:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.090257:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc600/0x48868a4e43952a5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354940 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.090290:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053876608:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129808.090870:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.093888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.094037:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972352 00000100:00100000:1.0:1746129808.094042:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972352 00002000:00100000:1.0:1746129808.094075:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (4018176->4194303) req@ffff88012c089180 x1830949053972352/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.094083:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089180 with x1830949053972352 ext(4018176->4194303) 00010000:00010000:1.0:1746129808.094089:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 30 pid: 20441 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.094101:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 30 pid: 20441 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746129808.094107:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c089180 00000100:00100000:1.0:1746129808.094123:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1745 00000100:00100000:1.0:1746129808.094145:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949053972352:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129808.107695:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949053972352:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13558us (13805us total) trans 17179873929 rc 0/0 00000100:00100000:1.0:1746129808.107706:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1745 00002000:00100000:1.0:1746129808.107716:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (4018176->4194303) req@ffff88012c089180 x1830949053972352/t17179873929(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/448 e 0 to 0 dl 1746129819 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.107724:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089180 with x1830949053972352 ext(4018176->4194303) 00010000:00010000:1.0:1746129808.107733:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 32 pid: 20441 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.107748:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5283400/0x48868a4e43952a2d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4018176->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35490f expref: 32 pid: 20441 timeout: 854 lvb_type: 0 00002000:00010000:1.0:1746129808.107753:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c089180 00000100:00100000:0.0:1746129808.108896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.108963:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972608 00000100:00100000:1.0:1746129808.108970:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972608 00002000:00100000:1.0:1746129808.109002:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3108863) req@ffff880094768380 x1830949053972608/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129808.109011:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949053972608 ext(2097152->3108863) 00002000:00010000:1.0:1746129808.109014:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768380 00000100:00100000:1.0:1746129808.109029:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6416 00000100:00100000:1.0:1746129808.109036:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949053972608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129808.121618:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053876864:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129808.121634:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.121653:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949053972736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5982us (8874us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.121660:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7181 00000100:00100000:0.0:1746129808.127631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.130127:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.133994:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.155898:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.167728:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.171456:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053973888 00000100:00100000:0.0:1746129808.171461:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053973888 00002000:00100000:0.0:1746129808.171488:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4928063) req@ffff8800a504c000 x1830949053973888/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.171497:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c000 with x1830949053973888 ext(4194304->4928063) 00010000:00010000:0.0:1746129808.171502:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f000/0x48868a4e43952a49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35492b expref: 19 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.171513:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f000/0x48868a4e43952a49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35492b expref: 19 pid: 1877 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746129808.171519:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504c000 00000100:00100000:0.0:1746129808.171542:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1746 00000100:00100000:0.0:1746129808.171552:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949053973888:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129808.175605:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129808.190442:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.196013:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053877248:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129808.196033:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.196082:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949053974016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4709us (5646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.196091:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7182 00000100:00100000:0.0:1746129808.199183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.210587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.213970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.279908:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.307097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.307142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.307163:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975040 00000100:00100000:0.0:1746129808.307171:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975040 00000100:00100000:1.0:1746129808.308091:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14549 00000100:00100000:1.0:1746129808.308102:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949053975040:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129808.308109:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.308118:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67c00/0x48868a4e43952a96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354978 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.308155:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053877504:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129808.308206:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.310009:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053877504:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129808.310030:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67c00/0x48868a4e43952a96 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354978 expref: 32 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.310039:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67c00/0x48868a4e43952a96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354978 expref: 32 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.310060:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67c00, rc 0) 00000100:00100000:1.0:1746129808.310095:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949053975040:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1998us (3006us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129808.310100:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14549 00000100:00100000:0.0:1746129808.313702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.314638:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975168 00000100:00100000:1.0:1746129808.314646:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975168 00000100:00100000:1.0:1746129808.314692:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14550 00000100:00100000:1.0:1746129808.314699:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31148:x1830949053975168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129808.314713:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.314726:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43952a9d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35497f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.314750:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5282800/0x48868a4e43952a42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3108864->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354924 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.314757:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.314758:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.314761:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43952a9d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35497f expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.314785:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5282800/0x48868a4e43952a42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3108864->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354924 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.314798:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5282800/0x48868a4e43952a42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3108864->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354924 expref: 23 pid: 7975 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.314808:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053877632:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.314898:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.322839:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053877632:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.322880:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43952a9d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35497f expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.322895:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67400, rc 0) 00000100:00100000:1.0:1746129808.322944:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31148:x1830949053975168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8244us (9248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.322951:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14550 00000100:00100000:0.0:1746129808.323912:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.323954:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.324007:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975424 00000100:00100000:1.0:1746129808.324012:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975424 00000100:00100000:1.0:1746129808.324060:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10791 00000100:00100000:1.0:1746129808.324066:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31149:x1830949053975424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129808.324083:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.324096:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66000/0x48868a4e43952aa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354986 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.324151:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324162:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324171:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324180:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324185:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324189:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324273:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324281:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 296 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.324287:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14800/0x48868a4e43952a1f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354908 expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.324292:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.324318:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14800/0x48868a4e43952a1f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354908 expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.324326:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a14800/0x48868a4e43952a1f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354908 expref: 22 pid: 14315 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.324335:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053877760:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.324403:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 296 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.324410:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 296 pid: 14315 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.324416:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053877888:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.324434:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.337677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.337725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.337749:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975808 00000100:00100000:0.0:1746129808.337755:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975808 00010000:00010000:0.0:1746129808.337803:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 297 pid: 14315 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.337826:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7183 00000100:00100000:0.0:1746129808.337833:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949053975808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.337843:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.337866:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 297 pid: 14315 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.337874:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 297 pid: 14315 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.337892:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00000100:00100000:1.0:1746129808.337955:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053877760:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.337964:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32800/0x48868a4e439529ee lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548e5 expref: 297 pid: 14315 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.337978:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053877888:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129808.338366:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.338375:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.338379:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.338388:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.338421:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949053975808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 589us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.338427:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7183 00010000:00010000:1.0:1746129808.338536:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129808.341260:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.341344:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129808.344161:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344168:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129808.344206:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00000004:00200000:1.0:1746129808.344209:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129808.344223:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344231:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344242:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344246:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344251:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344256:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b66200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129808.344259:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344264:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344272:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129808.344274:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129808.344277:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344280:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952aab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344288:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344292:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344296:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344299:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b67800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129808.344302:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344306:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344310:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800932eff00) 00010000:00010000:1.0:1746129808.344312:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129808.344314:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344319:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952ab2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.344368:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66000/0x48868a4e43952aa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.344378:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.344390:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129808.344391:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129808.344393:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66600, rc 0) 00000100:00100000:1.0:1746129808.344421:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31149:x1830949053975424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 20355us (20512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.344427:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10791 00000100:00100000:0.0:1746129808.350230:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976320 00000100:00100000:0.0:1746129808.350233:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976320 00002000:00100000:0.0:1746129808.350257:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a504ce00 x1830949053976320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.350264:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ce00 with x1830949053976320 ext(2097152->3145727) 00002000:00010000:0.0:1746129808.350268:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504ce00 00000100:00100000:0.0:1746129808.350280:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6421 00000100:00100000:0.0:1746129808.350284:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949053976320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129808.358000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.360897:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053977088 00000100:00100000:1.0:1746129808.360905:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053977088 00000100:00100000:1.0:1746129808.360954:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14556 00000100:00100000:1.0:1746129808.360961:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31144:x1830949053977088:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129808.360977:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.360993:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67200/0x48868a4e43952ae3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549b0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.361020:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.361027:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbcc00/0x48868a4e439527fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547c6 expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.361033:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952667 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546bc expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.361037:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.361039:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.361041:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67200/0x48868a4e43952ae3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [241664->1048575] (req 241664->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b0 expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.361066:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952667 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546bc expref: 24 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.361077:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952667 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546bc expref: 24 pid: 1877 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.361086:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053878272:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.363097:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffbcc00/0x48868a4e439527fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547c6 expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.363113:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbcc00/0x48868a4e439527fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3547c6 expref: 10 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.363122:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053878400:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.363770:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.363782:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 22 pid: 1877 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.363791:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053878528:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.363812:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.364361:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.364470:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053977344 00000100:00100000:1.0:1746129808.364475:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053977344 00000100:00100000:1.0:1746129808.364507:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10792 00000100:00100000:1.0:1746129808.364514:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31149:x1830949053977344:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129808.364526:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.364539:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549b7 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.364611:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.364622:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.364633:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.364651:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.364666:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 12 pid: 16808 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.364673:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053878656:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.365748:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.367320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.367443:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053878656:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.367461:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:1.0:1746129808.367480:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053878272:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.367486:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053878400:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.367491:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053878528:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.367505:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67200/0x48868a4e43952ae3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [241664->1048575] (req 241664->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b0 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.367517:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67200, rc 0) 00000100:00100000:1.0:1746129808.367553:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31144:x1830949053977088:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6592us (9562us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.367559:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14556 00000100:00100000:0.0:1746129808.368300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.368599:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053977728 00000100:00100000:1.0:1746129808.368602:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053977728 00010000:00010000:1.0:1746129808.368615:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 22 pid: 1877 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.368628:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7187 00000100:00100000:1.0:1746129808.368632:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949053977728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.368638:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.368647:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 22 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.368654:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 22 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.368666:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f900c00/0x48868a4e4395262f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546a7 expref: 22 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.368675:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.368700:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949053977728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.368704:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7187 00000100:00100000:0.0:1746129808.369667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.370398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.370774:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7189 00000100:00100000:1.0:1746129808.370780:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949053977600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.370787:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.370791:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 13 pid: 16808 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.370803:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 13 pid: 16808 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.370814:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43952ab9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354986 expref: 13 pid: 16808 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.370834:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129808.370838:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.370858:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.370864:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.370878:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.371769:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949053977600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 988us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.371775:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7189 00010000:00010000:1.0:1746129808.371800:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.371806:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129808.371821:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:1.0:1746129808.371943:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e43952aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b7 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.371957:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b7 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.371963:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129808.371965:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129808.371967:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66200, rc 0) 00000100:00100000:1.0:1746129808.373068:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31149:x1830949053977344:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8551us (8712us total) trans 8589944749 rc 0/0 00000100:00100000:1.0:1746129808.373075:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10792 00000100:00100000:0.0:1746129808.373271:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.373377:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053977984 00000100:00100000:1.0:1746129808.373383:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053977984 00000100:00100000:1.0:1746129808.373415:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14557 00000100:00100000:1.0:1746129808.373420:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31148:x1830949053977984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129808.373431:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.373442:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a14a00/0x48868a4e43952aff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549be expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.373461:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.373468:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.373469:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.373472:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a14a00/0x48868a4e43952aff lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549be expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.373493:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 11 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.373504:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 11 pid: 3624 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.373517:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053878912:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.373569:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.377313:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053878912:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.377331:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a14a00/0x48868a4e43952aff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549be expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.377345:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a14a00, rc 0) 00000100:00100000:0.0:1746129808.378166:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.378199:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.378229:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.379267:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31148:x1830949053977984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5845us (5994us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.379274:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14557 00000100:00100000:1.0:1746129808.379298:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978496 00000100:00100000:1.0:1746129808.379302:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978496 00000100:00100000:1.0:1746129808.379321:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10793 00000100:00100000:1.0:1746129808.379326:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31149:x1830949053978496:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129808.379339:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.379363:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43952b06 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549c5 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.379421:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.379432:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b7 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.379438:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.379461:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b7 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.379470:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43952af1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549b7 expref: 13 pid: 16808 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.379479:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053879040:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.379515:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.381166:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053879040:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.381185:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129808.382631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129808.383140:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.383147:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:1.0:1746129808.383178:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00000004:00200000:1.0:1746129808.383182:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129808.383194:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.383217:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43952b06 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549c5 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.383233:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549c5 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.383239:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129808.383241:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129808.383243:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66e00, rc 0) 00000100:00100000:1.0:1746129808.383266:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31149:x1830949053978496:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3939us (5065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.383272:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10793 00000100:00100000:1.0:1746129808.385425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.385517:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978880 00000100:00100000:0.0:1746129808.385523:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978880 00000100:00100000:0.0:1746129808.385547:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10794 00000100:00100000:0.0:1746129808.385553:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31151:x1830949053978880:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129808.385568:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129808.385580:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282200/0x48868a4e43952b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549cc expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.385646:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.385657:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549c5 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.385663:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.385686:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549c5 expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.385695:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e43952b0d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549c5 expref: 11 pid: 16808 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.385705:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053879168:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.385749:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801363666c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.390962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.390994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.391033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.391053:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979008 00000100:00100000:0.0:1746129808.391060:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979008 00000100:00100000:0.0:1746129808.391102:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979136 00000100:00100000:0.0:1746129808.391112:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979136 00000100:00100000:0.0:1746129808.391134:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979264 00000100:00100000:0.0:1746129808.391137:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979264 00000100:00100000:0.0:1746129808.391151:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14558 00000100:00100000:0.0:1746129808.391157:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31144:x1830949053979008:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129808.391171:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129808.391184:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5282a00/0x48868a4e43952b22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549d3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.391208:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b771400/0x48868a4e439529a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548b4 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.391216:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129808.391223:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129808.391228:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.391230:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.391233:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5282a00/0x48868a4e43952b22 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549d3 expref: 33 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.391257:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 33 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129808.391266:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 33 pid: 3624 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.391281:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053879296:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129808.391363:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129808.391371:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.391379:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053879424:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129808.391404:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b771400/0x48868a4e439529a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548b4 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.391412:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b771400/0x48868a4e439529a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548b4 expref: 13 pid: 3624 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.391419:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053879552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.391436:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.391638:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14559 00000100:00100000:1.0:1746129808.391646:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053979136:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129808.391653:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.391661:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43952b29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549da expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.391686:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053879680:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129808.391710:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.391725:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14560 00000100:00100000:1.0:1746129808.391730:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053979264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129808.391742:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.391748:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67e00/0x48868a4e43952b30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549e1 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.391768:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053879808:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129808.391784:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.394532:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053879168:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129808.394556:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129808.394586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.394600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.394641:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053879296:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.394667:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053879424:192.168.204.31@tcp:104: 00002000:00010000:1.0:1746129808.395034:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129806 -> 1746129809 00002000:00010000:1.0:1746129808.395037:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129806 -> 1746129809 00002000:00010000:1.0:1746129808.395039:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129807 -> 1746129809 00000100:00100000:1.0:1746129808.395053:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053879680:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129808.395072:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43952b29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549da expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.395083:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b66200/0x48868a4e43952b29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549da expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.396516:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66200, rc 0) 00000100:00100000:1.0:1746129808.396544:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053979136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4900us (5549us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129808.396551:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14559 00010000:00010000:1.0:1746129808.396583:0:10930:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88013061ce00 x1830949053879808) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 14 pid: 3624 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.396600:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbd800/0x48868a4e43952a50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2379775) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354932 expref: 14 pid: 3624 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.396601:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.396607:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:1.0:1746129808.396608:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053879808:192.168.204.31@tcp:106: 00000004:00200000:0.0:1746129808.396622:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:1.0:1746129808.396624:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67e00/0x48868a4e43952b30 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549e1 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.396635:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67e00/0x48868a4e43952b30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549e1 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.396640:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67e00, rc 0) 00000100:00100000:1.0:1746129808.396656:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053979264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4926us (5623us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129808.396660:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14560 00010000:00010000:0.0:1746129808.396737:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282200/0x48868a4e43952b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549cc expref: 26 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.396748:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549cc expref: 25 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.396754:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.396756:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129808.396758:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283200, rc 0) 00000100:00100000:0.0:1746129808.396779:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31151:x1830949053978880:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11226us (11356us total) trans 8589944750 rc 0/0 00000100:00100000:0.0:1746129808.396784:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10794 00000100:00100000:0.0:1746129808.396822:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.396869:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979648 00000100:00100000:1.0:1746129808.396873:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979648 00000100:00100000:0.0:1746129808.396876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129808.396887:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.396902:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979776 00000100:00100000:1.0:1746129808.396904:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979776 00010000:00010000:1.0:1746129808.396912:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 34 pid: 3624 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.396924:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7193 00000100:00100000:1.0:1746129808.396928:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949053979648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.396934:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.396943:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.396950:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.396964:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094334200/0x48868a4e43952ac0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35498d expref: 10 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.396964:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053879552:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.396972:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.396985:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949053979648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (163us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129808.396985:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5282a00/0x48868a4e43952b22 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549d3 expref: 34 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.396989:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7193 00010000:00010000:0.0:1746129808.396992:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282a00, rc 0) 00000100:00100000:1.0:1746129808.397002:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7194 00000100:00100000:0.0:1746129808.397005:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31144:x1830949053979008:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5849us (6051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.397006:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949053979776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129808.397009:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14558 00010000:00010000:1.0:1746129808.397011:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.397018:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 33 pid: 3624 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.397025:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 33 pid: 3624 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.397035:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b771c00/0x48868a4e439529c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548c2 expref: 33 pid: 3624 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.397042:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.397057:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949053979776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.397062:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7194 00000100:00100000:0.0:1746129808.403424:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053980032 00000100:00100000:0.0:1746129808.403428:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053980032 00000100:00100000:0.0:1746129808.403450:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10795 00000100:00100000:0.0:1746129808.403456:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31149:x1830949053980032:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129808.403468:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129808.403479:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282800/0x48868a4e43952b3e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549e8 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.403515:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282800/0x48868a4e43952b3e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549e8 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.403525:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282800/0x48868a4e43952b3e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549e8 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.403538:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.403541:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129808.403543:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282800, rc 0) 00000100:00100000:0.0:1746129808.403566:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31149:x1830949053980032:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 110us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.403570:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10795 00000100:00100000:0.0:1746129808.407166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.411932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.412873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.412946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.414259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.419564:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053981184 00000100:00100000:0.0:1746129808.419575:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053981184 00010000:00010000:0.0:1746129808.419605:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549cc expref: 25 pid: 16808 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.419645:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7196 00000100:00100000:0.0:1746129808.419651:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949053981184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.419662:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.419667:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549cc expref: 25 pid: 16808 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.419678:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549cc expref: 25 pid: 16808 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.419697:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5283200/0x48868a4e43952b1b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549cc expref: 25 pid: 16808 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.419713:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.419718:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092610600/0x48868a4e43952b4c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129808.419726:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092610600/0x48868a4e43952b4c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129808.419731:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092610600/0x48868a4e43952b4c lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129808.419750:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.419785:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949053981184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 134us (5530us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.419794:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7196 00000100:00100000:0.0:1746129808.419883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.420752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.452482:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.452789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.453234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.453250:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053982336 00000100:00100000:1.0:1746129808.453257:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053982336 00000100:00100000:1.0:1746129808.453299:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053982464 00000100:00100000:1.0:1746129808.453301:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053982464 00000100:00100000:1.0:1746129808.453462:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053982592 00000100:00100000:1.0:1746129808.453465:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053982592 00000100:00100000:0.0:1746129808.453501:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14561 00000100:00100000:0.0:1746129808.453509:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949053982336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129808.453524:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129808.453539:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a3df200/0x48868a4e43952b53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3549f6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129808.453583:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053880320:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129808.453649:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.463821:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.465820:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.469201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.484299:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.489405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.510706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.510763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.515215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.516181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.517027:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053984128 00000100:00100000:0.0:1746129808.517032:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053984128 00002000:00100000:0.0:1746129808.517053:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (184320->188415) req@ffff88013061fb80 x1830949053984128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.517061:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061fb80 with x1830949053984128 ext(184320->188415) 00002000:00010000:0.0:1746129808.517064:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061fb80 00000100:00100000:0.0:1746129808.517090:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6428 00000100:00100000:0.0:1746129808.517095:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949053984128:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129808.517226:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949053984128:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 129us (1045us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129808.517238:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6428 00002000:00100000:0.0:1746129808.517244:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (184320->188415) req@ffff88013061fb80 x1830949053984128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/4536 e 0 to 0 dl 1746129819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.517251:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061fb80 with x1830949053984128 ext(184320->188415) 00002000:00010000:0.0:1746129808.517253:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061fb80 00000100:00100000:0.0:1746129808.525577:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.528319:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6429 00000100:00100000:0.0:1746129808.528333:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949053984384:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129808.529165:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949053984384:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 834us (3592us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129808.529173:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6429 00002000:00100000:0.0:1746129808.529181:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (741376->745471) req@ffff8800a645c700 x1830949053984384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/4536 e 0 to 0 dl 1746129819 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.529188:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949053984384 ext(741376->745471) 00002000:00010000:0.0:1746129808.529193:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c700 00000100:00100000:1.0:1746129808.529342:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.536759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.541226:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.570277:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.570316:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.572422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.572451:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.572660:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053985792 00000100:00100000:0.0:1746129808.572665:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053985792 00002000:00100000:0.0:1746129808.572692:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88013061ca80 x1830949053985792/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.572701:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061ca80 with x1830949053985792 ext(2097152->3145727) 00002000:00010000:0.0:1746129808.572705:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013061ca80 00000100:00100000:0.0:1746129808.572725:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053986048 00000100:00100000:0.0:1746129808.572728:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053986048 00002000:00100000:0.0:1746129808.572738:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a55a7800 x1830949053986048/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:549/0 lens 488/0 e 0 to 0 dl 1746129819 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129808.572745:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7800 with x1830949053986048 ext(3145728->4194303) 00002000:00010000:0.0:1746129808.572747:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a7800 00000100:00100000:0.0:1746129808.572757:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6433 00000100:00100000:0.0:1746129808.572762:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949053985792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129808.595419:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.596940:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.608512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.614232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.622625:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.629321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.629375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.664635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.667813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.667997:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053987712 00000100:00100000:0.0:1746129808.668001:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053987712 00000100:00100000:0.0:1746129808.668020:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10798 00000100:00100000:0.0:1746129808.668026:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31168:x1830949053987712:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129808.668035:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129808.668041:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136365c00/0x48868a4e43952bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354a43 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.668075:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.668083:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129808.668089:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129808.668095:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:0.0:1746129808.668144:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136365c00/0x48868a4e43952bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a43 expref: 28 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.668160:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a43 expref: 27 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.668167:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.668169:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129808.668172:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136364c00, rc 0) 00000100:00100000:1.0:1746129808.669361:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31168:x1830949053987712:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1332us (1546us total) trans 8589944755 rc 0/0 00000100:00100000:1.0:1746129808.669366:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10798 00000100:00100000:0.0:1746129808.671500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.678630:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.678682:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.683510:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.684317:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.686224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.690049:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.696979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.705959:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.717300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.717523:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053989504 00000100:00100000:1.0:1746129808.717531:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053989504 00000100:00100000:1.0:1746129808.717639:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10799 00000100:00100000:1.0:1746129808.717646:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31171:x1830949053989504:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129808.717666:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.717680:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f33c00/0x48868a4e43952bd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354a58 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.717726:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f33200/0x48868a4e43952bd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717737:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f33200/0x48868a4e43952bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717746:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f33200/0x48868a4e43952bd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717756:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952bdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717761:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717766:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952bdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717959:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f33a00/0x48868a4e43952be6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.717970:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e43952ba0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a3c expref: 298 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.717977:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a43 expref: 26 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.717982:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091f33a00/0x48868a4e43952be6 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129808.718007:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a43 expref: 26 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.718017:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136364c00/0x48868a4e43952bb5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a43 expref: 26 pid: 16808 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.718033:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053882368:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.718396:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e43952ba0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a3c expref: 298 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.718404:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98f200/0x48868a4e43952ba0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a3c expref: 298 pid: 14315 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.718940:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053882496:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.719447:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129808.719910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.719964:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949053882368:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.720999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.721086:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053990016 00000100:00100000:1.0:1746129808.721090:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053990016 00000100:00100000:0.0:1746129808.724251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.724293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.727779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.729515:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.730661:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.736538:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.738835:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.741212:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.743431:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14576 00000100:00100000:1.0:1746129808.743439:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949053991424:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129808.743475:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952c2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.743490:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.743501:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.743504:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129808.743506:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952c2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.743532:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.743541:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.743553:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053883008:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.743738:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14578 00000100:00100000:0.0:1746129808.743744:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949053991680:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129808.743759:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.743768:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.743774:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129808.743781:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 33 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.743786:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.743787:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.743789:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.743801:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 33 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.743818:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 33 pid: 1877 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.743826:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053883264:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.744162:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.744181:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14580 00000100:00100000:1.0:1746129808.744187:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949053991552:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129808.744202:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.744211:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.744217:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.744223:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 33 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.744229:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.744230:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.744232:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.744243:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 33 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.744250:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 33 pid: 20441 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.744257:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053883648:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.744277:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.744284:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 12 pid: 10930 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.744291:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053883904:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.744308:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.744314:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 12 pid: 4589 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.744326:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053884160:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.744336:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00010000:00010000:0.0:1746129808.744477:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129808.744484:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.744491:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053884416:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129808.744514:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.744521:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0e00/0x48868a4e439529d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548d7 expref: 12 pid: 1877 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.744527:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053884544:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.744542:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129808.746225:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053883008:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.746242:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952c2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129808.746903:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053883264:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.746927:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053884416:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129808.746953:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053884544:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129808.746970:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129808.747000:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.747013:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.747026:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053992192 00000100:00100000:0.0:1746129808.747030:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053992192 00010000:00010000:0.0:1746129808.747052:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a507f200/0x48868a4e43952a6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [4194304->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35494e expref: 28 pid: 7975 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.747068:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053992576 00000100:00100000:0.0:1746129808.747070:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053992576 00010000:00010000:0.0:1746129808.747078:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 13 pid: 10930 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.747091:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7207 00000100:00100000:0.0:1746129808.747097:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949053992192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.747107:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.747123:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a507f200/0x48868a4e43952a6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35494e expref: 28 pid: 7975 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.747132:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a507f200/0x48868a4e43952a6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35494e expref: 28 pid: 7975 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.747149:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507f200/0x48868a4e43952a6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35494e expref: 28 pid: 7975 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.747165:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.747188:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949053992192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.747193:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7207 00000100:00100000:0.0:1746129808.747205:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7208 00000100:00100000:0.0:1746129808.747209:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949053992576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.747214:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.747224:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 13 pid: 10930 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.747231:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 13 pid: 10930 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.747240:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.747251:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949053992576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.747255:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7208 00000100:00100000:0.0:1746129808.747285:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.747297:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053992320 00000100:00100000:0.0:1746129808.747299:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053992320 00010000:00010000:0.0:1746129808.747308:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43952ace lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549a2 expref: 13 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.747320:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7209 00000100:00100000:0.0:1746129808.747323:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949053992320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.747329:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.747334:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43952ace lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549a2 expref: 13 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.747340:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43952ace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549a2 expref: 13 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.747363:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43952ace lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3549a2 expref: 13 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.747371:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.747383:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949053992320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 59us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.747388:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7209 00000100:00100000:1.0:1746129808.747693:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053883648:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.747702:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6400/0x48868a4e43952bf4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a66 expref: 12 pid: 10930 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.747720:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053883904:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129808.747727:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053884160:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129808.747742:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129808.750981:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.751011:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.751037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.751049:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.751067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.751086:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.751104:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053992832 00000100:00100000:0.0:1746129808.751109:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053992832 00010000:00010000:0.0:1746129808.751131:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 13 pid: 4589 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.751148:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053992960 00000100:00100000:0.0:1746129808.751150:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053992960 00010000:00010000:0.0:1746129808.751157:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.751166:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993088 00000100:00100000:0.0:1746129808.751168:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993088 00010000:00010000:0.0:1746129808.751175:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 34 pid: 1877 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.751181:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993216 00000100:00100000:0.0:1746129808.751183:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993216 00010000:00010000:0.0:1746129808.751188:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 35 pid: 20441 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.751197:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7210 00000100:00100000:0.0:1746129808.751203:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949053992832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.751212:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.751230:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 13 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.751237:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 13 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.751256:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130521c00/0x48868a4e43952b7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a20 expref: 13 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.751268:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.751298:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949053992832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.751307:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7210 00000100:00100000:0.0:1746129808.751341:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7211 00000100:00100000:0.0:1746129808.751356:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949053992960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.751363:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.751372:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.751379:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.751390:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094334000/0x48868a4e43952ac7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354994 expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.751398:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.751411:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949053992960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.751415:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7211 00000100:00100000:0.0:1746129808.751425:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7212 00000100:00100000:0.0:1746129808.751429:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949053993088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.751434:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.751440:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 35 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.751447:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 35 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.751461:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1600/0x48868a4e439529e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548de expref: 35 pid: 1877 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.751468:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.751480:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949053993088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.751484:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7212 00000100:00100000:0.0:1746129808.751493:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7213 00000100:00100000:0.0:1746129808.751497:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949053993216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.751502:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.751508:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 33 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.751514:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 33 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.751523:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130521800/0x48868a4e43952b84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a2e expref: 33 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.751530:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.751531:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.751535:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.751542:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.751558:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.751572:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949053993216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.751577:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7213 00010000:00010000:1.0:1746129808.751829:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751837:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751881:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751892:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751898:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751903:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f32000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129808.751906:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751911:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751919:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.751924:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f32000/0x48868a4e43952c48 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129808.751960:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949053991552:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 7773us (8880us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.751965:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14580 00000100:00100000:0.0:1746129808.753815:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129808.754970:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.754978:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.754996:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129808.754997:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129808.755002:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.755009:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.755014:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136365400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129808.755017:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.755025:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.755035:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.755040:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136365400/0x48868a4e43952c3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129808.755047:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.755071:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.755084:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949053991680:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 11340us (12032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.755085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.755091:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14578 00000100:00100000:0.0:1746129808.755097:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993472 00000100:00100000:0.0:1746129808.755100:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993472 00010000:00010000:0.0:1746129808.755111:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094335c00/0x48868a4e43952ad5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35499b expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746129808.755130:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993728 00000100:00100000:1.0:1746129808.755132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.755132:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993728 00010000:00010000:0.0:1746129808.755140:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548fa expref: 29 pid: 20441 timeout: 854 lvb_type: 1 00000100:00100000:1.0:1746129808.755144:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993600 00000100:00100000:1.0:1746129808.755146:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993600 00000100:00100000:0.0:1746129808.755147:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993856 00000100:00100000:0.0:1746129808.755148:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993856 00010000:00010000:0.0:1746129808.755154:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130521000/0x48868a4e43952b61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a04 expref: 30 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.755155:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f26600/0x48868a4e439529fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548ec expref: 22 pid: 20441 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.755161:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053993984 00000100:00100000:0.0:1746129808.755163:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053993984 00000100:00100000:1.0:1746129808.755166:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7215 00010000:00010000:0.0:1746129808.755168:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43952a9d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35497f expref: 23 pid: 3624 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.755170:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949053993472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.755176:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129808.755177:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7216 00000100:00100000:0.0:1746129808.755180:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949053993728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.755185:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.755187:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094335c00/0x48868a4e43952ad5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35499b expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.755190:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548fa expref: 30 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.755195:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094335c00/0x48868a4e43952ad5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35499b expref: 12 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746129808.757126:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548fa expref: 28 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.757162:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094335c00/0x48868a4e43952ad5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35499b expref: 11 pid: 1877 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.757362:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.757363:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6f400/0x48868a4e43952a0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3548fa expref: 28 pid: 20441 timeout: 854 lvb_type: 1 00010000:00010000:1.0:1746129808.757364:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.757367:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a4ca00/0x48868a4e43952c41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.757373:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4ca00/0x48868a4e43952c41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.757410:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129808.757416:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.757428:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949053993472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2258us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.757428:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949053993728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2246us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.757433:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7216 00000100:00100000:1.0:1746129808.757436:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7215 00000100:00100000:0.0:1746129808.760977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.761132:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053994112 00000100:00100000:1.0:1746129808.761138:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053994112 00010000:00010000:1.0:1746129808.761156:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 854 lvb_type: 0 00000100:00100000:1.0:1746129808.761182:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7220 00000100:00100000:1.0:1746129808.761186:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949053994112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.761196:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.761208:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.761217:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.761235:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952bca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 94208->425983) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a51 expref: 27 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.761247:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.761249:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.761252:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952c2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.761259:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32e00/0x48868a4e43952c2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129808.761290:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.761325:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949053994112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 138us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.761331:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7220 00000100:00100000:0.0:1746129808.761748:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053994240 00000100:00100000:0.0:1746129808.761752:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053994240 00010000:00010000:0.0:1746129808.761764:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130521400/0x48868a4e43952bc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2125824->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a4a expref: 34 pid: 4589 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.761785:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7221 00000100:00100000:0.0:1746129808.761790:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949053994240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.761800:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.761809:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130521400/0x48868a4e43952bc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2203647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a4a expref: 34 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.761818:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130521400/0x48868a4e43952bc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2203647) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a4a expref: 34 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.761834:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130521400/0x48868a4e43952bc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2125824->2203647) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a4a expref: 34 pid: 4589 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.761842:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.761844:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129808.761877:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a507fc00/0x48868a4e43952c4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.761883:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507fc00/0x48868a4e43952c4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129808.761898:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.762509:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949053994240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 718us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.762514:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7221 00000100:00100000:0.0:1746129808.766509:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.769946:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.771597:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.771791:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053995136 00000100:00100000:1.0:1746129808.771795:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053995136 00000100:00100000:0.0:1746129808.771830:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.771868:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4460 00000100:00100000:1.0:1746129808.771875:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:7659:x1830949053995136:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746129808.771890:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.771900:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053994752 00000100:00100000:0.0:1746129808.771903:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053994752 00010000:00010000:0.0:1746129808.771915:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43952739 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354772 expref: 299 pid: 15044 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.771929:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7223 00000100:00100000:0.0:1746129808.771933:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1961:x1830949053994752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.771939:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.771942:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43952739 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354772 expref: 299 pid: 15044 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.771950:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43952739 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354772 expref: 299 pid: 15044 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.771963:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43952739 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354772 expref: 299 pid: 15044 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.771976:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.771980:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e43952c56 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129808.771986:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.772251:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949053994752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 315us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.772257:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7223 00000100:00100000:0.0:1746129808.772417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.772459:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7224 00000100:00100000:0.0:1746129808.772464:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1961:x1830949053995520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.772471:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.772475:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58600/0x48868a4e439526a6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546f4 expref: 299 pid: 14314 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.772481:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58600/0x48868a4e439526a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546f4 expref: 299 pid: 14314 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.772490:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58600/0x48868a4e439526a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546f4 expref: 299 pid: 14314 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.772497:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.772500:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e43952c56 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129808.772505:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.772516:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1961:x1830949053995520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.772521:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7224 00000100:00100000:0.0:1746129808.772554:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.772564:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053995392 00000100:00100000:0.0:1746129808.772566:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053995392 00000100:00100000:1.0:1746129808.772568:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:7659:x1830949053995136:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 694us (973us total) trans 8589944761 rc 0/0 00000100:00100000:1.0:1746129808.772573:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4460 00010000:00010000:0.0:1746129808.772574:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58a00/0x48868a4e439526ad lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546fb expref: 28 pid: 14314 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746129808.772585:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7225 00000100:00100000:0.0:1746129808.772588:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949053995392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129808.772593:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129808.772596:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58a00/0x48868a4e439526ad lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546fb expref: 27 pid: 14314 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.772607:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58a00/0x48868a4e439526ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546fb expref: 27 pid: 14314 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.772617:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eb58a00/0x48868a4e439526ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3546fb expref: 27 pid: 14314 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746129808.772623:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129808.772626:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e43952c56 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129808.772630:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129808.772641:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949053995392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129808.772646:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7225 00000100:00100000:0.0:1746129808.774328:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.774398:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.774559:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7227 00000100:00100000:1.0:1746129808.774566:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949053995776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129808.774575:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129808.774579:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770e00/0x48868a4e4395298c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35489f expref: 25 pid: 14315 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.774587:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770e00/0x48868a4e4395298c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35489f expref: 25 pid: 14315 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.774600:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b770e00/0x48868a4e4395298c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35489f expref: 25 pid: 14315 timeout: 854 lvb_type: 0 00010000:00010000:1.0:1746129808.774812:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129808.774816:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e43952c56 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129808.774822:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129808.774950:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949053995776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 385us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.774956:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7227 00000001:00080000:0.0:1746129808.791266:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944755 is committed 00000001:00080000:0.0:1746129808.791275:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944744 is committed 00000001:00080000:0.0:1746129808.791280:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944761 is committed 00000001:00080000:0.0:1746129808.791284:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944749 is committed 00000001:00080000:0.0:1746129808.791308:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944762 is committed 00000004:00080000:0.0:1746129808.791311:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2559 committed 00000004:00080000:0.0:1746129808.791316:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2542 committed 00000004:00080000:0.0:1746129808.791320:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2541 committed 00000004:00080000:0.0:1746129808.791322:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2540 committed 00000004:00080000:0.0:1746129808.791323:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2539 committed 00000004:00080000:0.0:1746129808.791325:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2558 committed 00000004:00080000:0.0:1746129808.791326:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2538 committed 00000004:00080000:0.0:1746129808.791328:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2557 committed 00000004:00080000:0.0:1746129808.791330:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2537 committed 00000004:00080000:0.0:1746129808.791331:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2556 committed 00000004:00080000:0.0:1746129808.791333:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2555 committed 00000004:00080000:0.0:1746129808.791334:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2554 committed 00000004:00080000:0.0:1746129808.791336:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2536 committed 00000004:00080000:0.0:1746129808.791337:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2535 committed 00000004:00080000:0.0:1746129808.791339:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2553 committed 00000004:00080000:0.0:1746129808.791340:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2552 committed 00000004:00080000:0.0:1746129808.791341:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2534 committed 00000001:00080000:0.0:1746129808.791356:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944760 is committed 00000100:00100000:0.0:1746129808.791477:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053885824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791510:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791526:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791537:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791548:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129808.791552:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791564:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791571:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791583:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791595:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053885952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791606:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791614:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053886464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791624:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791632:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129808.791635:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053886080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791645:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791653:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053886592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791664:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.791681:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053885824 00000100:00100000:0.0:1746129808.791686:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053885824 00000100:00100000:0.0:1746129808.791711:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886336 00000100:00100000:0.0:1746129808.791713:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886336 00000100:00100000:0.0:1746129808.791719:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886208 00000100:00100000:0.0:1746129808.791721:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886208 00000100:00100000:0.0:1746129808.791727:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886720 00000100:00100000:0.0:1746129808.791729:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886720 00000100:00100000:0.0:1746129808.791736:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053885952 00000100:00100000:0.0:1746129808.791737:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053885952 00000100:00100000:0.0:1746129808.791742:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886464 00000100:00100000:0.0:1746129808.791744:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886464 00000100:00100000:0.0:1746129808.791749:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886080 00000100:00100000:0.0:1746129808.791750:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886080 00000100:00100000:0.0:1746129808.791755:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886592 00000100:00100000:0.0:1746129808.791756:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886592 00000100:00100000:0.0:1746129808.791763:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14582 00000100:00100000:0.0:1746129808.791767:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053885824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.791930:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053885824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (419us total) trans 21474841116 rc 0/0 00000100:00100000:0.0:1746129808.791935:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14582 00000100:00100000:0.0:1746129808.791945:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14583 00000100:00100000:0.0:1746129808.791949:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053886336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792018:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053886336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (479us total) trans 21474841117 rc 0/0 00000100:00100000:0.0:1746129808.792022:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14583 00000100:00100000:0.0:1746129808.792031:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14584 00000100:00100000:0.0:1746129808.792035:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053886208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792100:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053886208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (534us total) trans 21474841118 rc 0/0 00000100:00100000:0.0:1746129808.792104:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14584 00000100:00100000:0.0:1746129808.792207:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14585 00000100:00100000:0.0:1746129808.792212:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053886720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792280:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053886720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (696us total) trans 21474841119 rc 0/0 00000100:00100000:0.0:1746129808.792285:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14585 00000100:00100000:0.0:1746129808.792294:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14586 00000100:00100000:0.0:1746129808.792297:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053885952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792387:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053885952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (779us total) trans 21474841120 rc 0/0 00000100:00100000:0.0:1746129808.792391:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14586 00000100:00100000:0.0:1746129808.792399:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14587 00000100:00100000:0.0:1746129808.792403:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053886464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792469:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053886464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (844us total) trans 21474841121 rc 0/0 00000100:00100000:0.0:1746129808.792473:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14587 00000100:00100000:0.0:1746129808.792482:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14588 00000100:00100000:0.0:1746129808.792485:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053886080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792556:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053886080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (909us total) trans 21474841122 rc 0/0 00000100:00100000:0.0:1746129808.792561:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14588 00000100:00100000:0.0:1746129808.792569:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14589 00000100:00100000:0.0:1746129808.792573:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053886592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129808.792631:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129808.792634:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129808.792636:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129808.792637:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129808.792638:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129808.792655:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053886592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (989us total) trans 21474841123 rc 0/0 00000100:00100000:0.0:1746129808.792659:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14589 00000100:00080000:0.0:1746129808.792677:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746129808.792701:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319880/2, rc 0, transno 21474841122 00000100:00100000:0.0:1746129808.792709:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053886080:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129808.792715:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5c00/2, rc 0, transno 21474841123 00000100:00100000:0.0:1746129808.792717:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053886592:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129808.792722:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136318380/2, rc 0, transno 21474841120 00000100:00100000:0.0:1746129808.792725:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136318380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053885952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129808.792729:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043800/2, rc 0, transno 21474841121 00000100:00100000:0.0:1746129808.792731:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053886464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792759:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792777:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129808.792792:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040a80/2, rc 0, transno 21474841118 00000100:00100000:0.0:1746129808.792795:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129808.792799:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5180/2, rc 0, transno 21474841119 00000100:00100000:0.0:1746129808.792801:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886720:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129808.792808:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631a680/2, rc 0, transno 21474841116 00000100:00100000:0.0:1746129808.792810:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053885824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129808.792815:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043b80/2, rc 0, transno 21474841117 00000100:00100000:0.0:1746129808.792817:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792829:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053886848 00000100:00100000:0.0:1746129808.792832:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053886848 00000100:00100000:0.0:1746129808.792863:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14590 00000100:00100000:0.0:1746129808.792868:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053886848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.792942:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053886848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (164us total) trans 21474841124 rc 0/0 00000100:00100000:0.0:1746129808.792946:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14590 00000004:00080000:0.0:1746129808.792963:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207f800/2, rc 0, transno 21474841124 00000100:00100000:0.0:1746129808.792966:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053886848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129808.795195:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053887104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129808.795225:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.798420:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053887616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129808.798463:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129808.798644:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.799162:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129808.799168:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053886976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129808.799186:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129808.799196:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053887488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129808.799206:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129808.799360:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053887488 00000100:00100000:1.0:1746129808.799363:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053887488 00000100:00100000:1.0:1746129808.799381:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14596 00000100:00100000:1.0:1746129808.799386:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949053887616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129808.799417:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14597 00000100:00100000:1.0:1746129808.799432:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949053887488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129808.799978:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053887616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 591us (1514us total) trans 17179873937 rc 0/0 00000100:00100000:1.0:1746129808.799984:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14596 00000100:00100000:0.0:1746129808.800241:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053887488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 819us (1033us total) trans 17179873939 rc 0/0 00000100:00100000:0.0:1746129808.800248:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14597 00000004:00080000:0.0:1746129808.800278:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b027800/2, rc 0, transno 17179873939 00000100:00100000:0.0:1746129808.800283:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053887488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129808.800289:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b024e00/2, rc 0, transno 17179873938 00000100:00100000:0.0:1746129808.800292:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053887104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129808.800297:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b027b80/2, rc 0, transno 17179873937 00000100:00100000:0.0:1746129808.800300:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053887616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129808.800307:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b025500/2, rc 0, transno 17179873940 00000100:00100000:0.0:1746129808.800309:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053886976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129808.802198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.805248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.805281:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.806259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.806272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129808.806291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129808.806491:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996288 00000100:00100000:1.0:1746129808.806498:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996288 00000100:00100000:1.0:1746129808.806535:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996416 00000100:00100000:1.0:1746129808.806538:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996416 00000100:00100000:1.0:1746129808.806549:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996544 00000100:00100000:1.0:1746129808.806551:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996544 00000100:00100000:1.0:1746129808.806565:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996672 00000100:00100000:1.0:1746129808.806567:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996672 00000100:00100000:1.0:1746129808.806575:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996800 00000100:00100000:1.0:1746129808.806576:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996800 00000100:00100000:1.0:1746129808.806588:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14599 00000100:00100000:1.0:1746129808.806594:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949053996288:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129808.806608:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.806623:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43952c72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354a90 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129808.806648:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d391, atime: 0x6813d391, ctime: 0x6813d391, blocks: 0x7e9 00010000:00010000:1.0:1746129808.806666:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.806668:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.806677:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43952c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a90 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.806690:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43952c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a90 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.806699:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b357200, rc 0) 00000100:00100000:1.0:1746129808.806732:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949053996288:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 138us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.806737:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14599 00000100:00100000:1.0:1746129808.806752:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14600 00000100:00100000:1.0:1746129808.806756:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949053996416:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129808.806762:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.806770:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b357800/0x48868a4e43952c79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354a97 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129808.806782:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d391, atime: 0x6813d390, ctime: 0x6813d391, blocks: 0x821 00010000:00010000:1.0:1746129808.806788:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.806789:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.806793:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b357800/0x48868a4e43952c79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a97 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.806806:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b357800/0x48868a4e43952c79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a97 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.806812:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b357800, rc 0) 00000100:00100000:1.0:1746129808.806826:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949053996416:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 70us (1545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.806831:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14600 00000100:00100000:1.0:1746129808.806840:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14601 00000100:00100000:1.0:1746129808.806845:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949053996544:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129808.806872:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129808.806880:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b357000/0x48868a4e43952c80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354a9e expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129808.806889:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d390, atime: 0x6813d390, ctime: 0x6813d390, blocks: 0x81f 00010000:00010000:1.0:1746129808.806895:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.806896:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129808.806899:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b357000/0x48868a4e43952c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a9e expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.806906:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b357000/0x48868a4e43952c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a9e expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129808.806912:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b357000, rc 0) 00000100:00100000:1.0:1746129808.806925:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949053996544:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 81us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129808.806933:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14601 00000100:00100000:0.0:1746129808.807272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.749276:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053888000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129809.749365:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129809.749537:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053888000 00000100:00100000:1.0:1746129809.749544:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053888000 00000100:00100000:1.0:1746129809.749575:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1746129809.749581:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053888000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746129809.749599:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 471531520 pending 25559040 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746129809.749631:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053888000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129809.749636:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1746129809.749730:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053888000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746129809.797018:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053888256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129809.797066:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129809.797107:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053888640:0@lo:400:kworker.0 00000100:00100000:1.0:1746129809.797188:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053888256 00000100:00100000:1.0:1746129809.797191:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053888256 00000100:00100000:1.0:1746129809.797210:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1746129809.797214:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053888256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746129809.797243:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 481624064 pending 18743296 free 3853516800 avail 3851419648 00000100:00100000:1.0:1746129809.797268:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949053888256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129809.797273:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1746129809.797319:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053888256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129809.797324:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ea7f7eb-2f74-477e-bfed-16dc08365411:3299:1830949053888128:0@lo:400:kworker.0 00000100:00100000:1.0:1746129809.797350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129809.797368:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053888768:0@lo:400:kworker.0 00000100:00100000:1.0:1746129809.797379:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129809.797404:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053888128 00000100:00100000:1.0:1746129809.797406:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053888128 00000100:00100000:1.0:1746129809.797421:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1746129809.797424:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3299:x1830949053888128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129809.797443:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d497050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3299:x1830949053888128:12345-0@lo:400:kworker.0 Request processed in 18us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129809.797447:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1746129809.797469:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ea7f7eb-2f74-477e-bfed-16dc08365411:3299:1830949053888128:0@lo:400:kworker.0 00000100:00100000:0.0:1746129809.797912:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129809.797939:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129809.797977:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1746129809.797983:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949053888512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129809.798011:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949053888512:12345-0@lo:400:kworker.0 Request processed in 28us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.798015:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1746129809.798036:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949053888512:0@lo:400:kworker.0 00000100:00100000:0.0:1746129809.798098:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053888640 00000100:00100000:0.0:1746129809.798101:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053888640 00000100:00100000:0.0:1746129809.798117:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1746129809.798121:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053888640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129809.798145:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053888640:12345-0@lo:400:kworker.0 Request processed in 24us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.798150:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1746129809.798167:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053888640:0@lo:400:kworker.0 00000100:00100000:1.0:1746129809.798390:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053888768:0@lo:400:kworker.0 00000100:00100000:0.0:1746129809.821894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.833535:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.833588:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129809.834742:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6443 00000100:00100000:1.0:1746129809.834749:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949053997440:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129809.834764:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.834771:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.834772:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.834774:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.834782:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129809.845665:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.846310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.846342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.846374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.846393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.846413:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997952 00000100:00100000:0.0:1746129809.846419:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997952 00000100:00100000:0.0:1746129809.846456:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998208 00000100:00100000:0.0:1746129809.846458:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998208 00000100:00100000:0.0:1746129809.846470:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998464 00000100:00100000:0.0:1746129809.846471:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998464 00000100:00100000:0.0:1746129809.846483:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998848 00000100:00100000:0.0:1746129809.846485:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998848 00000100:00100000:0.0:1746129809.846494:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998976 00000100:00100000:0.0:1746129809.846495:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998976 00000100:00100000:0.0:1746129809.846506:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6444 00000100:00100000:0.0:1746129809.846512:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1964:x1830949053997952:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129809.846537:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43952cb1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.846548:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.846550:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.846554:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43952cb1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.846565:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43952cb1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.847478:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6445 00000100:00100000:1.0:1746129809.847487:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1964:x1830949053998208:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129809.847505:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.847516:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.847518:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.847520:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.847528:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.848606:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6446 00000100:00100000:1.0:1746129809.848614:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1964:x1830949053998464:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129809.848635:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.848643:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.848645:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.848647:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.848655:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.850742:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6447 00000100:00100000:1.0:1746129809.850756:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1964:x1830949053998848:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129809.850787:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.850798:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.850800:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129809.850803:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.850813:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883184:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883200:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883207:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883213:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b356800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129809.883217:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883225:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883240:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.883246:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b356800/0x48868a4e43952caa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.883742:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1964:x1830949053997440:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 48989us (50149us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129809.883752:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6443 00010000:00010000:1.0:1746129809.896317:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.896339:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.896346:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.896352:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b357e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129809.896355:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.896361:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.896376:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.896381:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b357e00/0x48868a4e43952cb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.899175:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1964:x1830949053998208:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 51680us (52857us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129809.899186:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6445 00010000:00010000:1.0:1746129809.904884:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.904900:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.904908:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.904914:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b356000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129809.904918:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.904925:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.904941:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.904947:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b356000/0x48868a4e43952cbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.905021:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949053998464:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 56404us (58674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129809.905030:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6446 00010000:00010000:1.0:1746129809.917023:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.917037:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.917045:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.917050:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095230600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129809.917053:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.917060:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.917074:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.917078:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095230600/0x48868a4e43952cc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129809.917141:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949053998848:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 66387us (70763us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129809.917150:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6447 00000100:00100000:0.0:1746129809.924231:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129809.927938:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999360 00000100:00100000:1.0:1746129809.927945:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999360 00000100:00100000:1.0:1746129809.927978:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4462 00000100:00100000:1.0:1746129809.927985:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31171:x1830949053999360:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129809.928193:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9c9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31171:x1830949053999360:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 208us (560us total) trans 8589944763 rc 0/0 00000100:00100000:1.0:1746129809.928199:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4462 00000100:00100000:0.0:1746129809.930051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.958080:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.958132:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129809.958206:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999872 00000100:00100000:1.0:1746129809.958214:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999872 00000100:00100000:1.0:1746129809.958283:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000128 00000100:00100000:1.0:1746129809.958286:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000128 00000100:00100000:1.0:1746129809.958311:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10805 00000100:00100000:1.0:1746129809.958317:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31178:x1830949053999872:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129809.958366:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129809.958382:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee800/0x48868a4e43952cd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354aba expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.958467:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958479:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958489:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958499:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958504:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958508:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958590:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958596:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958605:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129809.958613:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:1.0:1746129809.958692:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958698:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958703:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958707:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bef000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129809.958710:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958714:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958722:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129809.958724:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129809.958728:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.958732:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43952cdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963426:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963438:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963449:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963454:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129809.963457:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963463:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963477:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88013265ba00) 00010000:00010000:1.0:1746129809.963479:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129809.963482:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963487:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43952ce2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129809.963552:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee800/0x48868a4e43952cd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aba expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.963563:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aba expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.963569:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129809.963571:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129809.963573:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef200, rc 0) 00000100:00100000:1.0:1746129809.965516:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31178:x1830949053999872:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7191us (7436us total) trans 8589944765 rc 0/0 00000100:00100000:1.0:1746129809.965525:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10805 00000100:00100000:0.0:1746129809.967804:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.967842:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.967893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.967908:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.967921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.967954:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.967975:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000256 00000100:00100000:0.0:1746129809.967982:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000256 00000100:00100000:0.0:1746129809.968010:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000384 00000100:00100000:0.0:1746129809.968013:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000384 00000100:00100000:0.0:1746129809.968023:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000512 00000100:00100000:0.0:1746129809.968024:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000512 00000100:00100000:0.0:1746129809.968030:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000640 00000100:00100000:0.0:1746129809.968032:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000640 00000100:00100000:0.0:1746129809.968039:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000768 00000100:00100000:0.0:1746129809.968040:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000768 00000100:00100000:0.0:1746129809.968048:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000896 00000100:00100000:0.0:1746129809.968049:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000896 00000100:00100000:0.0:1746129809.968061:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14605 00000100:00100000:0.0:1746129809.968066:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054000256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129809.968082:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129809.968097:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67000/0x48868a4e43952d1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ac8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.968116:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968118:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968124:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67000/0x48868a4e43952d1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ac8 expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968138:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67000/0x48868a4e43952d1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ac8 expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968148:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67000, rc 0) 00000100:00100000:0.0:1746129809.968181:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054000256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 114us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.968186:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14605 00000100:00100000:0.0:1746129809.968198:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14606 00000100:00100000:0.0:1746129809.968202:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054000384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129809.968211:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129809.968217:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b66200/0x48868a4e43952d21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354acf expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.968226:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968227:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968230:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66200/0x48868a4e43952d21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354acf expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968239:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b66200/0x48868a4e43952d21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354acf expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968245:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66200, rc 0) 00000100:00100000:0.0:1746129809.968258:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054000384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 56us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.968262:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14606 00000100:00100000:0.0:1746129809.968270:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14607 00000100:00100000:0.0:1746129809.968274:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054000512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129809.968279:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129809.968283:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43952d28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ad6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.968291:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968292:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968295:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43952d28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ad6 expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968302:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43952d28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ad6 expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968309:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67200, rc 0) 00000100:00100000:0.0:1746129809.968331:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054000512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 48us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.968336:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14607 00000100:00100000:0.0:1746129809.968344:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14608 00000100:00100000:0.0:1746129809.968348:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054000640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129809.968353:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129809.968358:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354add expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.968367:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968368:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968371:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354add expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968378:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354add expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968383:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67c00, rc 0) 00000100:00100000:0.0:1746129809.968396:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054000640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 48us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.968400:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14608 00000100:00100000:0.0:1746129809.968407:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14609 00000100:00100000:0.0:1746129809.968410:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054000768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129809.968416:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129809.968420:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ae4 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.968428:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968429:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968432:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ae4 expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968440:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ae4 expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968446:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66a00, rc 0) 00000100:00100000:0.0:1746129809.968458:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054000768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 47us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.968462:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14609 00000100:00100000:0.0:1746129809.968469:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14610 00000100:00100000:0.0:1746129809.968472:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054000896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129809.968476:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129809.968481:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e43952d3d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354aeb expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129809.968488:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968490:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129809.968493:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e43952d3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aeb expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968500:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e43952d3d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aeb expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129809.968505:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66e00, rc 0) 00000100:00100000:0.0:1746129809.968517:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054000896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 44us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129809.968521:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14610 00000100:00100000:0.0:1746129809.988320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.988365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.988402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129809.988478:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001536 00000100:00100000:1.0:1746129809.988485:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001536 00010000:00010000:1.0:1746129809.988517:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43952d0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ac1 expref: 10 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129809.988538:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001792 00000100:00100000:1.0:1746129809.988539:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001792 00010000:00010000:1.0:1746129809.988547:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43952c6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a89 expref: 10 pid: 16808 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129809.988557:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001664 00000100:00100000:1.0:1746129809.988559:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001664 00010000:00010000:1.0:1746129809.988567:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aba expref: 285 pid: 14315 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129809.988580:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7229 00000100:00100000:1.0:1746129809.988586:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054001536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129809.988596:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129809.988601:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43952d0c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ac1 expref: 10 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988610:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43952d0c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ac1 expref: 10 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988627:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43952d0c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ac1 expref: 10 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988640:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129809.988644:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988652:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988656:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129809.988687:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054001536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129809.988692:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7229 00000100:00100000:1.0:1746129809.988707:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7230 00000100:00100000:1.0:1746129809.988711:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054001792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129809.988717:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129809.988720:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43952c6b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a89 expref: 10 pid: 16808 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988726:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43952c6b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a89 expref: 10 pid: 16808 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988735:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43952c6b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a89 expref: 10 pid: 16808 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988742:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129809.988745:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988749:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988753:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129809.988767:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054001792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129809.988773:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7230 00000100:00100000:1.0:1746129809.988802:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7231 00000100:00100000:1.0:1746129809.988806:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1964:x1830949054001664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129809.988812:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129809.988815:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aba expref: 285 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988823:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aba expref: 285 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988832:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952ce9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aba expref: 285 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129809.988839:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129809.988842:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988867:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988873:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.988888:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129809.988902:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1964:x1830949054001664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129809.988907:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7231 00010000:00010000:1.0:1746129809.989023:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.989029:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129809.989045:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:1.0:1746129809.989157:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a56f9a00/0x48868a4e43952d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af2 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.989167:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af2 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.989173:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129809.989175:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129809.989177:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa6a00, rc 0) 00000100:00100000:1.0:1746129809.989198:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31183:x1830949054001152:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9743us (18828us total) trans 8589944768 rc 0/0 00000100:00100000:1.0:1746129809.989204:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10807 00000100:00100000:0.0:1746129809.997004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.997045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.997074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.997100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129809.997122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129809.997197:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054002176 00000100:00100000:1.0:1746129809.997205:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054002176 00002000:00100000:1.0:1746129809.997250:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012d634e00 x1830949054002176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:550/0 lens 488/0 e 0 to 0 dl 1746129820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129809.997259:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634e00 with x1830949054002176 ext(0->1048575) 00002000:00010000:1.0:1746129809.997265:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634e00 00000100:00100000:1.0:1746129809.997279:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054002432 00000100:00100000:1.0:1746129809.997282:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054002432 00002000:00100000:1.0:1746129809.997293:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012d634380 x1830949054002432/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:550/0 lens 488/0 e 0 to 0 dl 1746129820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129809.997300:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634380 with x1830949054002432 ext(1048576->2097151) 00002000:00010000:1.0:1746129809.997304:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d634380 00000100:00100000:1.0:1746129809.997310:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054002688 00000100:00100000:1.0:1746129809.997312:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054002688 00002000:00100000:1.0:1746129809.997319:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d635f80 x1830949054002688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:550/0 lens 488/0 e 0 to 0 dl 1746129820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129809.997336:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949054002688 ext(1048576->2097151) 00002000:00010000:1.0:1746129809.997338:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:1.0:1746129809.997347:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054002944 00000100:00100000:1.0:1746129809.997349:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054002944 00002000:00100000:1.0:1746129809.997358:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d637480 x1830949054002944/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:550/0 lens 488/0 e 0 to 0 dl 1746129820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129809.997363:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637480 with x1830949054002944 ext(1048576->2097151) 00002000:00010000:1.0:1746129809.997365:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637480 00000100:00100000:1.0:1746129809.997374:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6449 00000100:00100000:1.0:1746129809.997380:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054002176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129809.998476:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6450 00000100:00100000:1.0:1746129809.998484:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054002432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129809.999427:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001920 00000100:00100000:1.0:1746129809.999432:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001920 00000100:00100000:1.0:1746129809.999462:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10809 00000100:00100000:1.0:1746129809.999467:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31184:x1830949054001920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129809.999479:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129809.999493:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beea00/0x48868a4e43952d6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354b00 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.999541:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.999552:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af2 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.999558:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129809.999582:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af2 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129809.999592:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa6a00/0x48868a4e43952d4b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af2 expref: 8 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129809.999603:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053889280:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129809.999660:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.018339:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053889280:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129810.018358:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129810.022655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129810.023048:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.023054:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129810.023089:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00000004:00200000:0.0:1746129810.023092:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129810.023106:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.023117:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.023137:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beea00/0x48868a4e43952d6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b00 expref: 286 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.023151:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b00 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.023156:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.023158:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129810.023160:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef200, rc 0) 00000100:00100000:0.0:1746129810.023181:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31184:x1830949054001920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 23714us (26185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.023186:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10809 00000100:00100000:1.0:1746129810.025252:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054002432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26763us (28170us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.025261:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6450 00002000:00100000:1.0:1746129810.025269:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012d634380 x1830949054002432/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:550/0 lens 488/440 e 0 to 0 dl 1746129820 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.025277:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634380 with x1830949054002432 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.025282:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d634380 00000100:00100000:0.0:1746129810.032972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.038243:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.038347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.038375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.038631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.038786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.042076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.042113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.044401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.045462:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.045489:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.045542:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.045592:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054004480 00000100:00100000:1.0:1746129810.045596:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054004480 00010000:00010000:1.0:1746129810.045619:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b00 expref: 285 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.045636:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054004736 00000100:00100000:1.0:1746129810.045638:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054004736 00010000:00010000:1.0:1746129810.045646:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e43952c5d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a82 expref: 9 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.045659:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054004608 00000100:00100000:1.0:1746129810.045660:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054004608 00010000:00010000:1.0:1746129810.045667:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9cc00/0x48868a4e43952d59 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af9 expref: 286 pid: 14313 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.045677:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7233 00000100:00100000:1.0:1746129810.045682:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949054004480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.045690:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.045694:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b00 expref: 286 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.045702:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e43952d75 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b00 expref: 286 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.045716:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.045719:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045725:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045730:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.045749:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949054004480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.045754:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7233 00000100:00100000:1.0:1746129810.045766:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7234 00000100:00100000:1.0:1746129810.045770:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054004736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.045776:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.045780:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e43952c5d lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a82 expref: 9 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.045787:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e43952c5d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a82 expref: 9 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.045796:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.045799:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045803:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045808:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.045823:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054004736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.045827:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7234 00000100:00100000:1.0:1746129810.045837:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7235 00000100:00100000:1.0:1746129810.045841:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1962:x1830949054004608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.045869:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.045872:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9cc00/0x48868a4e43952d59 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af9 expref: 285 pid: 14313 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.045883:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9cc00/0x48868a4e43952d59 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354af9 expref: 285 pid: 14313 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.045891:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.045893:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045898:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045903:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.045908:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094da3200/0x48868a4e43952dbb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b3f expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.045918:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.045934:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1962:x1830949054004608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.045938:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7235 00000100:00100000:0.0:1746129810.047795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:1.0:1746129810.088168:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944768 is committed 00000001:00080000:1.0:1746129810.088176:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944765 is committed 00000001:00080000:1.0:1746129810.088181:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944763 is committed 00000001:00080000:1.0:1746129810.088185:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944767 is committed 00000001:00080000:1.0:1746129810.088188:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944764 is committed 00000001:00080000:1.0:1746129810.088191:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944769 is committed 00000004:00080000:1.0:1746129810.088194:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2567 committed 00000004:00080000:1.0:1746129810.088201:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2551 committed 00000004:00080000:1.0:1746129810.088205:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2550 committed 00000004:00080000:1.0:1746129810.088207:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2549 committed 00000004:00080000:1.0:1746129810.088209:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2548 committed 00000004:00080000:1.0:1746129810.088210:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2566 committed 00000004:00080000:1.0:1746129810.088212:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2547 committed 00000004:00080000:1.0:1746129810.088214:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2565 committed 00000004:00080000:1.0:1746129810.088215:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2546 committed 00000004:00080000:1.0:1746129810.088216:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2564 committed 00000004:00080000:1.0:1746129810.088218:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2563 committed 00000004:00080000:1.0:1746129810.088219:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2562 committed 00000004:00080000:1.0:1746129810.088220:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2545 committed 00000004:00080000:1.0:1746129810.088221:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2544 committed 00000004:00080000:1.0:1746129810.088222:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2561 committed 00000004:00080000:1.0:1746129810.088223:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2560 committed 00000004:00080000:1.0:1746129810.088224:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2543 committed 00000100:00100000:1.0:1746129810.088540:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053890176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.088571:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129810.088582:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053890688:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.088595:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129810.088603:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053891200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129810.088614:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129810.088629:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1746129810.088633:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053890048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.088648:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129810.088658:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053890560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.088668:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129810.088676:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053891072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129810.088686:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129810.088705:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053889792 00000100:00100000:1.0:1746129810.088711:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053889792 00000100:00100000:1.0:1746129810.088739:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890176 00000100:00100000:1.0:1746129810.088742:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890176 00000100:00100000:1.0:1746129810.088750:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890304 00000100:00100000:1.0:1746129810.088751:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890304 00000100:00100000:1.0:1746129810.088756:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890688 00000100:00100000:1.0:1746129810.088757:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890688 00000100:00100000:1.0:1746129810.088762:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053891200 00000100:00100000:1.0:1746129810.088763:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053891200 00000100:00100000:1.0:1746129810.088770:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890816 00000100:00100000:1.0:1746129810.088772:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890816 00000100:00100000:1.0:1746129810.088777:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890048 00000100:00100000:1.0:1746129810.088778:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890048 00000100:00100000:1.0:1746129810.088784:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053891328 00000100:00100000:1.0:1746129810.088785:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053891328 00000100:00100000:1.0:1746129810.088790:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890560 00000100:00100000:1.0:1746129810.088791:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890560 00000100:00100000:1.0:1746129810.088796:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053891072 00000100:00100000:1.0:1746129810.088797:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053891072 00000100:00100000:1.0:1746129810.088805:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14617 00000100:00100000:1.0:1746129810.088811:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3296:x1830949053889792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129810.088972:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129810.088975:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129809 -> 1746129809 00002000:00010000:1.0:1746129810.088977:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.088979:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129809 -> 1746129809 00002000:00010000:1.0:1746129810.088981:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129810.089001:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3296:x1830949053889792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (444us total) trans 17179873941 rc 0/0 00000100:00100000:1.0:1746129810.089006:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14617 00000100:00100000:1.0:1746129810.089018:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14619 00000100:00100000:1.0:1746129810.089021:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3296:x1830949053890304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.089097:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053890304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (507us total) trans 17179873942 rc 0/0 00000100:00100000:1.0:1746129810.089102:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14619 00000100:00100000:1.0:1746129810.090559:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14626 00000100:00100000:0.0:1746129810.091110:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053889920 00000100:00100000:0.0:1746129810.091115:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053889920 00000100:00100000:1.0:1746129810.091160:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3299:x1830949053891072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129810.091166:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890432 00000100:00100000:0.0:1746129810.091168:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890432 00000100:00100000:1.0:1746129810.091173:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053890944 00000100:00100000:1.0:1746129810.091176:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053890944 00000100:00100000:0.0:1746129810.091176:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053891456 00000100:00100000:0.0:1746129810.091177:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053891456 00000100:00100000:0.0:1746129810.091184:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14629 00000100:00100000:1.0:1746129810.091187:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14630 00000100:00100000:0.0:1746129810.091188:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053889920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.091190:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053890432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129810.091213:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14631 00000100:00100000:1.0:1746129810.091216:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053891456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129810.091529:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14632 00000100:00100000:1.0:1746129810.091534:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053890944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129810.091547:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129810.091550:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129808 -> 1746129808 00002000:00010000:0.0:1746129810.091552:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129808 -> 1746129808 00002000:00010000:0.0:1746129810.091553:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129808 -> 1746129808 00002000:00010000:0.0:1746129810.091555:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129810.091578:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053889920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 390us (845us total) trans 17179873947 rc 0/0 00000100:00100000:0.0:1746129810.091584:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14629 00002000:00010000:1.0:1746129810.091615:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129810.091617:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.091619:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.091621:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.091622:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129810.091639:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053890944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (846us total) trans 21474841126 rc 0/0 00000100:00100000:1.0:1746129810.091644:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14632 00000100:00100000:0.0:1746129810.091649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:0.0:1746129810.091671:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3100/2, rc 0, transno 17179873947 00000100:00100000:0.0:1746129810.091675:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053889920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129810.091683:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaea00/2, rc 0, transno 21474841126 00000100:00100000:0.0:1746129810.091689:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053890944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129810.091705:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053891584:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129810.091713:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830949053890432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 522us (941us total) trans 17179873948 rc 0/0 00000100:00100000:0.0:1746129810.091713:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053891712:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129810.091717:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14630 00000004:00080000:1.0:1746129810.091733:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adadf80/2, rc 0, transno 17179873948 00000100:00100000:1.0:1746129810.091735:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053890432:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746129810.091742:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e43952d9f lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b38 expref: 9 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746129810.093677:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859200/0x48868a4e43952da6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b38 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.093703:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859200, rc 0) 00000100:00100000:0.0:1746129810.093730:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31183:x1830949054004224:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 51473us (51615us total) trans 8589944769 rc 0/0 00000100:00100000:0.0:1746129810.093736:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10811 00000004:00080000:1.0:1746129810.096986:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adae300/2, rc 0, transno 21474841127 00000100:00100000:1.0:1746129810.096990:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053890816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129810.096997:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaf480/2, rc 0, transno 21474841128 00000100:00100000:1.0:1746129810.096999:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053891328:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129810.097163:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:1.0:1746129810.097166:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.097168:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.097169:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129808 -> 1746129808 00002000:00010000:1.0:1746129810.097171:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5545 -> 5545 00000100:00100000:1.0:1746129810.097210:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053891072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6645us (8522us total) trans 21474841131 rc 0/0 00000100:00100000:1.0:1746129810.097218:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14626 00000100:00100000:1.0:1746129810.097235:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053892096 00000100:00100000:1.0:1746129810.097240:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053892096 00000100:00100000:1.0:1746129810.097262:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14633 00000100:00100000:1.0:1746129810.097267:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053892096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129810.097349:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3297:x1830949053892096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (508us total) trans 21474841132 rc 0/0 00000100:00100000:1.0:1746129810.097355:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14633 00000004:00080000:1.0:1746129810.097373:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5493480/2, rc 0, transno 21474841133 00000100:00100000:1.0:1746129810.097376:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053891456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129810.099583:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054005120 00000100:00100000:1.0:1746129810.099589:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054005120 00000100:00100000:1.0:1746129810.099618:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4465 00000100:00100000:1.0:1746129810.099623:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31184:x1830949054005120:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:1.0:1746129810.099710:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31184:x1830949054005120:12345-192.168.204.31@tcp:49:cat.0 Request processed in 86us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.099715:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4465 00000100:00100000:1.0:1746129810.099821:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054005248 00000100:00100000:1.0:1746129810.099824:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054005248 00000100:00100000:1.0:1746129810.099842:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10814 00000100:00100000:1.0:1746129810.099861:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31178:x1830949054005248:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129810.099869:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.099882:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952dc9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354b4d expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.099914:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b4d expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.099925:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952dc9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b4d expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.099940:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.099942:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129810.099945:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f32000, rc 0) 00000100:00100000:1.0:1746129810.099966:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31178:x1830949054005248:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 118us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.099971:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10814 00000100:00100000:0.0:1746129810.104166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.104244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.104302:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054005504 00000100:00100000:1.0:1746129810.104309:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054005504 00000100:00100000:1.0:1746129810.104366:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:1.0:1746129810.104370:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1963:x1830949054005504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.104381:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.104398:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091f32000/0x48868a4e43952dc9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b4d expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.104411:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.104414:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.104513:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1963:x1830949054005504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.104518:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 712 00000100:00100000:0.0:1746129810.108156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.108239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.111894:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054006272 00000100:00100000:1.0:1746129810.111900:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054006272 00000100:00080000:0.0:1746129810.111940:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129810.111942:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952c87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aac expref: 11 pid: 8437 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746129810.111962:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054006400 00000100:00100000:1.0:1746129810.111964:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054006400 00000100:00100000:0.0:1746129810.111965:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7236 00010000:00010000:1.0:1746129810.111972:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ae4 expref: 31 pid: 20441 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746129810.111972:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054006272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.111982:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129810.111985:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7237 00000100:00100000:1.0:1746129810.111989:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054006400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.111993:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.112000:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ae4 expref: 31 pid: 20441 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.112000:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952c87 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aac expref: 11 pid: 8437 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.112008:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952c87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aac expref: 11 pid: 8437 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.113174:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ae4 expref: 31 pid: 20441 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.113216:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b66a00/0x48868a4e43952d36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ae4 expref: 31 pid: 20441 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.113229:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.113254:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054006400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1263us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.113259:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7237 00010000:00010000:0.0:1746129810.113505:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952c87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aac expref: 11 pid: 8437 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.113514:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.113532:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054006272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1562us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.113537:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7236 00000100:00080000:0.0:1746129810.113573:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129810.123363:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.123424:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054006528 00000100:00100000:1.0:1746129810.123432:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054006528 00000100:00100000:1.0:1746129810.123483:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 214 00000100:00100000:1.0:1746129810.123490:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949054006528:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129810.123548:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d494c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949054006528:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 58us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.123554:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 214 00000100:00100000:0.0:1746129810.132222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.133216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.133229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.133239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.134441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.135047:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054007424 00000100:00100000:1.0:1746129810.135053:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054007424 00002000:00100000:1.0:1746129810.135082:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009b00f800 x1830949054007424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.135091:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f800 with x1830949054007424 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.135095:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00f800 00000100:00100000:0.0:1746129810.136485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.136503:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054008064 00000100:00100000:0.0:1746129810.136506:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054008064 00002000:00100000:0.0:1746129810.136523:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2408448->2412543) req@ffff88012ba38a80 x1830949054008064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.136529:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38a80 with x1830949054008064 ext(2408448->2412543) 00002000:00010000:0.0:1746129810.136532:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38a80 00000100:00100000:0.0:1746129810.136541:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6457 00000100:00100000:0.0:1746129810.136545:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054007680:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.137500:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6459 00000100:00100000:0.0:1746129810.137505:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054008064:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129810.137565:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054008064:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 59us (1080us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129810.137570:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6459 00002000:00100000:0.0:1746129810.137575:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2408448->2412543) req@ffff88012ba38a80 x1830949054008064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/4536 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.137586:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38a80 with x1830949054008064 ext(2408448->2412543) 00002000:00010000:0.0:1746129810.137588:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38a80 00000100:00100000:0.0:1746129810.149262:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.149432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.149478:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.149652:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054008576 00000100:00100000:1.0:1746129810.149656:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054008576 00002000:00100000:1.0:1746129810.149677:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009faf5f80 x1830949054008576/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.149686:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf5f80 with x1830949054008576 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.149691:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf5f80 00000100:00100000:1.0:1746129810.149709:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054008704 00000100:00100000:1.0:1746129810.149710:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054008704 00002000:00100000:1.0:1746129810.149719:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009be65500 x1830949054008704/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.149724:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65500 with x1830949054008704 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.149727:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65500 00000100:00100000:1.0:1746129810.149736:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6460 00000100:00100000:1.0:1746129810.149739:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054008576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129810.150796:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6461 00000100:00100000:1.0:1746129810.150803:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054008704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129810.164747:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054007680:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28198us (31503us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129810.164755:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6457 00002000:00100000:0.0:1746129810.164763:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009b00fb80 x1830949054007680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.164772:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054007680 ext(1048576->2097151) 00002000:00010000:0.0:1746129810.164776:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00fb80 00000100:00100000:1.0:1746129810.164864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.164916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.164929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.164957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.167024:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054008576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17280us (17587us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.167031:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6460 00002000:00100000:1.0:1746129810.167036:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009faf5f80 x1830949054008576/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.167043:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf5f80 with x1830949054008576 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.167047:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf5f80 00000100:00100000:1.0:1746129810.167821:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054008704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17016us (18339us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.167827:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6461 00002000:00100000:1.0:1746129810.167833:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009be65500 x1830949054008704/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.167840:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65500 with x1830949054008704 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.167843:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65500 00000100:00100000:0.0:1746129810.171196:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.171814:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054009600 00000100:00100000:1.0:1746129810.171823:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054009600 00002000:00100000:1.0:1746129810.171977:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2686976->2691071) req@ffff88009be67100 x1830949054009600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129810.172123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129810.172172:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be67100 with x1830949054009600 ext(2686976->2691071) 00002000:00010000:1.0:1746129810.172177:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be67100 00000100:00100000:1.0:1746129810.172196:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6463 00000100:00100000:1.0:1746129810.172204:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054009600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129810.172373:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054009600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 170us (1185us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129810.172379:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6463 00002000:00100000:1.0:1746129810.172384:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2686976->2691071) req@ffff88009be67100 x1830949054009600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/4536 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.172391:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be67100 with x1830949054009600 ext(2686976->2691071) 00002000:00010000:1.0:1746129810.172394:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be67100 00000100:00100000:0.0:1746129810.173891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.173940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.175382:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054010240 00000100:00100000:0.0:1746129810.175386:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054010240 00000100:00100000:0.0:1746129810.175420:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14639 00000100:00100000:0.0:1746129810.175426:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31184:x1830949054010240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.175433:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.175440:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354b77 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.175457:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.175730:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.175738:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129810.175739:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129810.175743:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 5/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.175763:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.175774:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 24 pid: 7976 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.175783:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053893632:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129810.176007:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.176015:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 30 pid: 4589 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.176023:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053893760:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129810.176043:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129810.176213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.178403:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053893632:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129810.178523:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.178539:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054010624 00000100:00100000:0.0:1746129810.178543:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054010624 00002000:00100000:0.0:1746129810.178565:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3031040->3145727) req@ffff88009206df80 x1830949054010624/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.178574:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206df80 with x1830949054010624 ext(3031040->3145727) 00010000:00010000:0.0:1746129810.178580:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 25 pid: 7976 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.178590:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 25 pid: 7976 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746129810.178596:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009206df80 00000100:00100000:0.0:1746129810.178606:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1755 00000100:00100000:0.0:1746129810.178611:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054010624:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129810.178808:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053893760:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129810.178822:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 26 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.178833:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67600, rc 0) 00000100:00100000:1.0:1746129810.178878:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31184:x1830949054010240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3453us (3592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.178883:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14639 00000100:00100000:0.0:1746129810.179783:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.179921:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054010752 00000100:00100000:1.0:1746129810.179924:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054010752 00002000:00100000:1.0:1746129810.179943:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2408448->2809855) req@ffff88009206d500 x1830949054010752/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.179951:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206d500 with x1830949054010752 ext(2408448->2809855) 00010000:00010000:1.0:1746129810.179956:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 29 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.179964:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 29 pid: 4589 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746129810.179970:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009206d500 00000100:00100000:1.0:1746129810.180256:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1756 00000100:00100000:1.0:1746129810.180262:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054010752:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129810.182309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.182672:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054010880 00000100:00100000:1.0:1746129810.182679:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054010880 00000100:00100000:1.0:1746129810.182884:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14640 00000100:00100000:1.0:1746129810.182892:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31180:x1830949054010880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129810.183143:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.183158:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009faea600/0x48868a4e43952dfa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354b7e expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.183180:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129810.183184:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009faea600/0x48868a4e43952dfa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b7e expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.183194:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009faea600/0x48868a4e43952dfa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b7e expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.183201:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faea600, rc 0) 00000100:00100000:1.0:1746129810.183672:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:31180:x1830949054010880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 779us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.183678:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14640 00000100:00100000:0.0:1746129810.188016:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054010624:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9395us (9484us total) trans 21474841134 rc 0/0 00000100:00100000:0.0:1746129810.188028:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1755 00002000:00100000:0.0:1746129810.188037:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3031040->3145727) req@ffff88009206df80 x1830949054010624/t21474841134(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/448 e 0 to 0 dl 1746129821 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.188046:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206df80 with x1830949054010624 ext(3031040->3145727) 00010000:00010000:0.0:1746129810.188055:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 26 pid: 7976 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.188068:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952dd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3031040->18446744073709551615] (req 3031040->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b5b expref: 26 pid: 7976 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746129810.188074:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009206df80 00000100:00100000:1.0:1746129810.191512:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054010752:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 11243us (11723us total) trans 21474841135 rc 0/0 00000100:00100000:1.0:1746129810.191521:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1756 00002000:00100000:1.0:1746129810.191529:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2408448->2809855) req@ffff88009206d500 x1830949054010752/t21474841135(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/448 e 0 to 0 dl 1746129821 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.191538:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206d500 with x1830949054010752 ext(2408448->2809855) 00010000:00010000:1.0:1746129810.191546:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 32 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.191563:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095230c00/0x48868a4e43952dd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3031039] (req 2408448->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b54 expref: 32 pid: 4589 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746129810.191569:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009206d500 00000100:00100000:0.0:1746129810.191767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.193920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.201234:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.202133:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.202327:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.202810:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054011392 00000100:00100000:1.0:1746129810.202817:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054011392 00002000:00100000:1.0:1746129810.202866:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009206f480 x1830949054011392/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.202875:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f480 with x1830949054011392 ext(2097152->3145727) 00002000:00010000:1.0:1746129810.202879:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f480 00000100:00100000:1.0:1746129810.202905:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054011904 00000100:00100000:1.0:1746129810.202908:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054011904 00002000:00100000:1.0:1746129810.202920:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3739648->4194303) req@ffff88009206e680 x1830949054011904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.202925:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e680 with x1830949054011904 ext(3739648->4194303) 00002000:00010000:1.0:1746129810.202928:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206e680 00000100:00100000:1.0:1746129810.202944:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6464 00000100:00100000:1.0:1746129810.202950:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054011392:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.203553:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.203576:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054012160 00000100:00100000:0.0:1746129810.203578:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054012160 00002000:00100000:0.0:1746129810.203591:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88013061ea00 x1830949054012160/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.203597:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061ea00 with x1830949054012160 ext(2097152->3145727) 00002000:00010000:0.0:1746129810.203600:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013061ea00 00000100:00100000:0.0:1746129810.203610:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6467 00000100:00100000:0.0:1746129810.203614:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054012160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129810.221150:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054011392:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18193us (19917us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.221159:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6464 00002000:00100000:1.0:1746129810.221166:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009206f480 x1830949054011392/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.221179:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f480 with x1830949054011392 ext(2097152->3145727) 00002000:00010000:1.0:1746129810.221182:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f480 00000100:00100000:0.0:1746129810.224440:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.224496:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054012544 00000100:00100000:1.0:1746129810.224502:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054012544 00000100:00100000:1.0:1746129810.224540:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14641 00000100:00100000:1.0:1746129810.224546:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31180:x1830949054012544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129810.224560:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.224573:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354b85 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.224596:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f600/0x48868a4e43952dde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b62 expref: 35 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.224602:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129810.224603:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129810.224607:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b85 expref: 14 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.224837:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f600/0x48868a4e43952dde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b62 expref: 35 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.225027:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4d4f600/0x48868a4e43952dde lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b62 expref: 35 pid: 4589 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.225040:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053894144:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129810.225420:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.227381:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.227484:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053894144:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129810.227505:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b85 expref: 14 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.227517:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeae00, rc 0) 00000100:00100000:0.0:1746129810.227545:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.227754:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31180:x1830949054012544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3208us (3320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.227760:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14641 00000100:00100000:1.0:1746129810.227773:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054012800 00000100:00100000:1.0:1746129810.227775:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054012800 00000100:00100000:1.0:1746129810.227788:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14642 00000100:00100000:1.0:1746129810.227793:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31184:x1830949054012800:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129810.227799:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.227807:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354b8c expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.227820:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129810.227821:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129810.227824:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b8c expref: 38 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.227831:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b8c expref: 38 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.227837:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faeb800, rc 0) 00000100:00100000:1.0:1746129810.228232:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31184:x1830949054012800:12345-192.168.204.31@tcp:101:cat.0 Request processed in 437us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.228240:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14642 00000100:00100000:0.0:1746129810.235963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.240751:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.247564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.249588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.250305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.263351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.274024:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.274061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.285345:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.292710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.299746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.305620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.313120:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.313175:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.313239:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.313379:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054015744 00000100:00100000:1.0:1746129810.313389:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054015744 00010000:00010000:1.0:1746129810.313423:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43952d83 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b15 expref: 40 pid: 7976 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746129810.313447:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054016000 00000100:00100000:1.0:1746129810.313449:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054016000 00010000:00010000:1.0:1746129810.313458:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66200/0x48868a4e43952d21 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354acf expref: 14 pid: 20441 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746129810.313469:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054015872 00000100:00100000:1.0:1746129810.313471:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054015872 00010000:00010000:1.0:1746129810.313478:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b357800/0x48868a4e43952c79 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a97 expref: 10 pid: 3624 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746129810.313491:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7245 00000100:00100000:1.0:1746129810.313498:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949054015744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.313508:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.313529:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43952d83 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b15 expref: 40 pid: 7976 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.313538:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43952d83 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b15 expref: 40 pid: 7976 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.313563:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.313594:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949054015744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.313599:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7245 00000100:00100000:1.0:1746129810.313611:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7246 00000100:00100000:1.0:1746129810.313616:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054016000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.313621:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.313626:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b66200/0x48868a4e43952d21 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354acf expref: 14 pid: 20441 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.313633:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b66200/0x48868a4e43952d21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354acf expref: 14 pid: 20441 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.313640:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.313650:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054016000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.313653:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7246 00000100:00100000:1.0:1746129810.313659:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7247 00000100:00100000:1.0:1746129810.313662:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054015872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.313667:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.313671:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b357800/0x48868a4e43952c79 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a97 expref: 10 pid: 3624 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.313678:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b357800/0x48868a4e43952c79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a97 expref: 10 pid: 3624 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.313686:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.313688:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.313693:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 39 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.313700:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 39 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.313721:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 39 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129810.313730:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053894912:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129810.313768:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129810.321701:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053894912:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129810.321717:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.321758:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054015872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8093us (8520us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.321766:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7247 00000100:00100000:0.0:1746129810.323520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.329834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.333086:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.393842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.408222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.408974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.417662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.417679:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.417701:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054017536 00000100:00100000:0.0:1746129810.417708:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054017536 00010000:00010000:0.0:1746129810.417740:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354add expref: 33 pid: 20441 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746129810.417776:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054017664 00000100:00100000:0.0:1746129810.417779:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054017664 00010000:00010000:0.0:1746129810.417789:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ee00/0x48868a4e43952c8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aa5 expref: 10 pid: 8436 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746129810.417802:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7248 00000100:00100000:0.0:1746129810.417809:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054017536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.417821:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.417865:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354add expref: 33 pid: 20441 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746129810.417868:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7249 00010000:00010000:0.0:1746129810.417876:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354add expref: 33 pid: 20441 timeout: 856 lvb_type: 1 00000100:00100000:1.0:1746129810.417877:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054017664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.417887:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.417897:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e43952d2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354add expref: 33 pid: 20441 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.417898:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ee00/0x48868a4e43952c8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aa5 expref: 10 pid: 8436 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.417912:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ee00/0x48868a4e43952c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aa5 expref: 10 pid: 8436 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.418808:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.418880:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1962:x1830949054017536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1068us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.418888:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7248 00000100:00100000:0.0:1746129810.418931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.418945:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054017792 00000100:00100000:0.0:1746129810.418949:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054017792 00010000:00010000:0.0:1746129810.418964:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858e00/0x48868a4e43952d8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b23 expref: 25 pid: 7976 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746129810.418982:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7250 00000100:00100000:0.0:1746129810.418987:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054017792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.418994:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.419003:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f858e00/0x48868a4e43952d8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b23 expref: 25 pid: 7976 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.419011:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f858e00/0x48868a4e43952d8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b23 expref: 25 pid: 7976 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.419027:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f858e00/0x48868a4e43952d8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b23 expref: 25 pid: 7976 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.419036:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.419053:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054017792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.419057:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7250 00010000:00010000:1.0:1746129810.419522:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4d6ee00/0x48868a4e43952c8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354aa5 expref: 10 pid: 8436 timeout: 856 lvb_type: 1 00010000:00010000:1.0:1746129810.419544:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.419565:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054017664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1690us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.419571:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7249 00000100:00100000:0.0:1746129810.422678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.428121:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.428862:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.428920:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054018304 00000100:00100000:1.0:1746129810.428927:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054018304 00000100:00100000:1.0:1746129810.428962:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14646 00000100:00100000:1.0:1746129810.428968:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31189:x1830949054018304:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129810.428982:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.428996:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354bbd expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.429020:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.429027:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009faea600/0x48868a4e43952dfa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b7e expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.429033:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.429034:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.429037:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->2785279] (req 2097152->2785279) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.429060:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009faea600/0x48868a4e43952dfa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b7e expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.429068:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009faea600/0x48868a4e43952dfa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b7e expref: 32 pid: 7975 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.429077:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053895680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129810.429143:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.429151:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 25 pid: 7975 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.429157:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053895808:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129810.429178:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1746129810.429200:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054018432 00000100:00100000:1.0:1746129810.429202:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054018432 00002000:00100000:1.0:1746129810.429221:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1875968->2097151) req@ffff88009207dc00 x1830949054018432/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.429230:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949054018432 ext(1875968->2097151) 00010000:00010000:1.0:1746129810.429235:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952e71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354baf expref: 33 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.429247:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952e71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354baf expref: 33 pid: 4589 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746129810.429252:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207dc00 00000100:00100000:1.0:1746129810.429264:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1758 00000100:00100000:1.0:1746129810.429268:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1961:x1830949054018432:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129810.434721:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053895680:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129810.434742:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053895808:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129810.434772:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->2785279] (req 2097152->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 34 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.434980:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283600, rc 0) 00000100:00100000:1.0:1746129810.435040:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:31189:x1830949054018304:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6071us (6926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.435047:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14646 00000100:00100000:1.0:1746129810.436092:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1961:x1830949054018432:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 6820us (7244us total) trans 21474841136 rc 0/0 00000100:00100000:1.0:1746129810.436100:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1758 00002000:00100000:1.0:1746129810.436109:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1875968->2097151) req@ffff88009207dc00 x1830949054018432/t21474841136(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/448 e 0 to 0 dl 1746129821 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.436118:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949054018432 ext(1875968->2097151) 00010000:00010000:1.0:1746129810.436127:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354baf expref: 34 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.436138:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952e71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1875968->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354baf expref: 34 pid: 4589 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746129810.436144:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207dc00 00000100:00100000:0.0:1746129810.436784:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.436838:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.438657:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7252 00000100:00100000:1.0:1746129810.438665:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054018688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.438673:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.438682:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 25 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.438690:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 25 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.438701:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67600/0x48868a4e43952df3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b77 expref: 25 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.438890:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.438892:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.438899:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.438907:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.438934:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129810.438945:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053895936:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129810.439181:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.440659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.441888:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949053895936:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129810.441902:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.441926:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054018688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3263us (5088us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.441934:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7252 00000100:00100000:1.0:1746129810.444772:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054019072 00000100:00100000:1.0:1746129810.444780:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054019072 00002000:00100000:1.0:1746129810.444816:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a8fd1c00 x1830949054019072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.444825:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1c00 with x1830949054019072 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.444829:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd1c00 00000100:00100000:1.0:1746129810.445142:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6479 00000100:00100000:1.0:1746129810.445149:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054019072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.452396:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.455398:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054019072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10243us (10852us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.455408:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6479 00002000:00100000:1.0:1746129810.455415:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a8fd1c00 x1830949054019072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.455423:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1c00 with x1830949054019072 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.455427:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd1c00 00000100:00100000:0.0:1746129810.455838:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.460894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.461058:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054019712 00000100:00100000:1.0:1746129810.461065:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054019712 00000100:00100000:1.0:1746129810.461099:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14647 00000100:00100000:1.0:1746129810.461105:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31197:x1830949054019712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129810.461120:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.461135:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5283200/0x48868a4e43952e86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354bc4 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.461160:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.461167:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129810.461169:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129810.461172:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5283200/0x48868a4e43952e86 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bc4 expref: 25 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.461197:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.461207:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283600/0x48868a4e43952e7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2785279) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bbd expref: 31 pid: 7976 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.461218:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053896192:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129810.461689:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.465816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.466050:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053896192:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129810.466073:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5283200/0x48868a4e43952e86 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bc4 expref: 25 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.466093:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5283200, rc 0) 00000100:00100000:1.0:1746129810.466134:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31197:x1830949054019712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5028us (5247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.466141:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14647 00000100:00100000:0.0:1746129810.488031:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.519360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.545181:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054020224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 35573us (35774us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129810.545191:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6481 00002000:00100000:0.0:1746129810.545201:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a8fd2680 x1830949054020224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.545210:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2680 with x1830949054020224 ext(2097152->3145727) 00002000:00010000:0.0:1746129810.545215:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2680 00000100:00100000:0.0:1746129810.545256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.545337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.545364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.545381:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021248 00000100:00100000:0.0:1746129810.545387:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021248 00000100:00100000:0.0:1746129810.545412:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021120 00000100:00100000:0.0:1746129810.545414:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021120 00000100:00100000:0.0:1746129810.545433:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021376 00000100:00100000:0.0:1746129810.545435:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021376 00000100:00100000:0.0:1746129810.545449:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14648 00000100:00100000:0.0:1746129810.545454:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1962:x1830949054021248:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.545466:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.545478:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952ea2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354bd9 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.545497:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.545499:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.545505:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952ea2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd9 expref: 35 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.545519:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952ea2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd9 expref: 35 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.545528:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9800, rc 0) 00000100:00100000:0.0:1746129810.545547:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1962:x1830949054021248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 93us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.545552:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14648 00000100:00100000:0.0:1746129810.545563:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14649 00000100:00100000:0.0:1746129810.545568:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054021120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.545573:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.545580:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858a00/0x48868a4e43952ea9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354bd2 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129810.545615:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053896448:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129810.545666:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c596c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.545681:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14650 00000100:00100000:0.0:1746129810.545685:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1962:x1830949054021376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.545691:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.545696:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952eb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354be0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.545703:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.545705:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.545708:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be0 expref: 35 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.545716:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a4d800/0x48868a4e43952eb0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be0 expref: 35 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.545722:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4d800, rc 0) 00000100:00100000:0.0:1746129810.545735:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1962:x1830949054021376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 49us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.545740:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14650 00002000:00010000:1.0:1746129810.553414:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129809 -> 1746129810 00002000:00010000:1.0:1746129810.553420:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129808 -> 1746129811 00002000:00010000:1.0:1746129810.553422:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129809 -> 1746129810 00000100:00100000:1.0:1746129810.553442:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053896448:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129810.553469:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f858a00/0x48868a4e43952ea9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd2 expref: 14 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129810.553484:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858a00/0x48868a4e43952ea9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd2 expref: 14 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129810.553503:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858a00, rc 0) 00000100:00100000:1.0:1746129810.553541:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054021120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7971us (8202us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129810.553548:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14649 00000100:00100000:0.0:1746129810.561979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.562007:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021632 00000100:00100000:0.0:1746129810.562014:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021632 00002000:00100000:0.0:1746129810.562054:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880094d8e300 x1830949054021632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.562063:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e300 with x1830949054021632 ext(0->1048575) 00002000:00010000:0.0:1746129810.562069:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8e300 00000100:00100000:0.0:1746129810.562088:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6484 00000100:00100000:0.0:1746129810.562095:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1962:x1830949054021632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.577595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.580327:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022144 00000100:00100000:1.0:1746129810.580340:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022144 00000100:00100000:1.0:1746129810.580386:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10819 00000100:00100000:1.0:1746129810.580394:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31203:x1830949054022144:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129810.580413:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.580428:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282c00/0x48868a4e43952eb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354be7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.580525:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.580537:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.580545:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 290 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.580550:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.580575:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 290 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.580584:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 290 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.580593:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053896576:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129810.580673:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 14 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.580680:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 14 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.580688:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053896704:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129810.580705:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.580956:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.580974:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021888 00000100:00100000:0.0:1746129810.580977:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021888 00002000:00100000:0.0:1746129810.580998:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880094d8f800 x1830949054021888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.581007:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f800 with x1830949054021888 ext(4194304->4931583) 00002000:00010000:0.0:1746129810.581011:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8f800 00000100:00100000:0.0:1746129810.581024:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6485 00000100:00100000:0.0:1746129810.581028:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054021888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.582444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.583718:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1962:x1830949054021632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21619us (21741us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129810.583727:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6484 00002000:00100000:0.0:1746129810.583736:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880094d8e300 x1830949054021632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.583745:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e300 with x1830949054021632 ext(0->1048575) 00002000:00010000:0.0:1746129810.583750:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8e300 00000100:00100000:0.0:1746129810.591810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.591908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.591932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.591953:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022656 00000100:00100000:0.0:1746129810.591959:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022656 00010000:00010000:0.0:1746129810.591985:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 291 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.592007:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022784 00000100:00100000:0.0:1746129810.592009:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022784 00010000:00010000:0.0:1746129810.592017:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 15 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.592030:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7255 00000100:00100000:0.0:1746129810.592035:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1963:x1830949054022656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.592046:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.592051:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 291 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.592060:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 291 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.592079:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.592083:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592091:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592098:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592102:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592106:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.592136:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1963:x1830949054022656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.592142:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7255 00000100:00100000:0.0:1746129810.592157:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7256 00000100:00100000:0.0:1746129810.592161:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054022784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.592167:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.592171:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 15 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.592178:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 15 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.592187:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.592189:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592195:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592200:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592208:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592213:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592216:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592228:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.592242:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054022784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.592247:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7256 00000100:00100000:0.0:1746129810.592453:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054021888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11423us (11497us total) trans 0 rc 737280/737280 00000100:00100000:0.0:1746129810.592460:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6485 00002000:00100000:0.0:1746129810.592468:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880094d8f800 x1830949054021888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.592476:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f800 with x1830949054021888 ext(4194304->4931583) 00002000:00010000:0.0:1746129810.592480:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8f800 00010000:00010000:0.0:1746129810.592619:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43952e47 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b9a expref: 290 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.592630:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053896576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129810.592638:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ea00/0x48868a4e43952e24 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b93 expref: 14 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.592649:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053896704:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129810.592664:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592670:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592674:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129810.592689:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:0.0:1746129810.592786:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282c00/0x48868a4e43952eb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.592799:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 290 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.592806:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 290 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.592810:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282a00, rc 0) 00000100:00100000:0.0:1746129810.592827:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31203:x1830949054022144:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12435us (15243us total) trans 8589944780 rc 0/0 00000100:00100000:0.0:1746129810.592832:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10819 00000100:00100000:0.0:1746129810.592841:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022528 00000100:00100000:0.0:1746129810.592843:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022528 00000100:00100000:0.0:1746129810.592870:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10821 00000100:00100000:0.0:1746129810.592874:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31206:x1830949054022528:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129810.592885:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.592893:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e200/0x48868a4e43952ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354bf5 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.592937:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592944:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592949:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.592957:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129810.592962:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129810.602703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.602786:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022912 00000100:00100000:1.0:1746129810.602795:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022912 00010000:00010000:1.0:1746129810.602826:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 290 pid: 14315 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.602874:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7257 00000100:00100000:1.0:1746129810.602881:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1961:x1830949054022912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.602894:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.602899:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 290 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.602909:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 290 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.602926:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5282a00/0x48868a4e43952ebe lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354be7 expref: 290 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.602936:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.602940:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.602948:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.602954:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.602960:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.602964:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.602983:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.603016:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949054022912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 135us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.603021:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7257 00010000:00010000:1.0:1746129810.603076:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603081:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129810.603114:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00000004:00200000:1.0:1746129810.603118:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129810.603130:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603137:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603145:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603150:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603155:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603159:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faea800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129810.603163:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603168:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603175:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129810.603177:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129810.603180:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603184:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea800/0x48868a4e43952ecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603191:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603195:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603199:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603202:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009faea000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129810.603204:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603207:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603212:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e8c7700) 00010000:00010000:1.0:1746129810.603213:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129810.603215:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603219:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faea000/0x48868a4e43952ed3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129810.603244:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faeb000/0x48868a4e43952ec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.603257:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 7 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.603263:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 7 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.603268:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009faebc00, rc 0) 00000100:00100000:1.0:1746129810.603291:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31204:x1830949054022272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 17629us (20852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.603297:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10820 00000100:00100000:0.0:1746129810.623528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.623557:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023040 00000100:00100000:0.0:1746129810.623564:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023040 00000100:00100000:0.0:1746129810.623596:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14651 00000100:00100000:0.0:1746129810.623604:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31201:x1830949054023040:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.623618:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.623632:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186e400/0x48868a4e43952ef6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354bfc expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.623655:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 37 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.623668:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129810.623669:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129810.623672:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186e400/0x48868a4e43952ef6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bfc expref: 14 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.623696:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 37 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.623707:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 37 pid: 4589 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.623717:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053896832:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129810.623771:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.623800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.623880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.623896:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023296 00000100:00100000:0.0:1746129810.623899:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023296 00010000:00010000:0.0:1746129810.623915:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 7 pid: 15044 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.623934:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7258 00000100:00100000:0.0:1746129810.623939:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054023296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.623947:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.623952:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 7 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.623965:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 7 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.623980:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009faebc00/0x48868a4e43952eda lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bee expref: 7 pid: 15044 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.623991:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.623994:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.624000:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.624005:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.624019:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.624038:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054023296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.624044:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7258 00010000:00010000:0.0:1746129810.624065:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.624071:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129810.624085:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:0.0:1746129810.624192:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e200/0x48868a4e43952ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.624207:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.624212:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.624214:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129810.624216:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ec00, rc 0) 00000100:00100000:0.0:1746129810.624236:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31206:x1830949054022528:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 31361us (32434us total) trans 8589944781 rc 0/0 00000100:00100000:0.0:1746129810.624242:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10821 00000100:00100000:0.0:1746129810.624253:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023168 00000100:00100000:0.0:1746129810.624255:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023168 00000100:00100000:0.0:1746129810.624270:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10822 00000100:00100000:0.0:1746129810.624274:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31204:x1830949054023168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129810.624282:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.624288:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43952f04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354c03 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.624337:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.624345:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.624351:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.624366:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.624374:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 15 pid: 14315 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.624381:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053896960:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129810.624407:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129810.636931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.637050:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023552 00000100:00100000:0.0:1746129810.637057:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023552 00000100:00100000:0.0:1746129810.637090:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4473 00000100:00100000:0.0:1746129810.637096:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b9c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31203:x1830949054023552:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129810.637246:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b9c8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31203:x1830949054023552:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 149us (322us total) trans 8589944782 rc 0/0 00000100:00100000:0.0:1746129810.637252:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4473 00000100:00100000:0.0:1746129810.637300:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053896832:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129810.637333:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186e400/0x48868a4e43952ef6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bfc expref: 14 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.637346:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186e400, rc 0) 00000100:00100000:0.0:1746129810.637359:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31201:x1830949054023040:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13757us (13837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.637364:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14651 00000100:00100000:0.0:1746129810.637384:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053896960:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129810.637393:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129810.642247:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.642271:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023808 00000100:00100000:0.0:1746129810.642278:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023808 00010000:00010000:0.0:1746129810.642306:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 16 pid: 14315 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.642339:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7259 00000100:00100000:0.0:1746129810.642345:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054023808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.642356:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.642361:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 16 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.642370:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 16 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.642388:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43952eef lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bf5 expref: 16 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.642398:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.642403:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.642410:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.642416:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.642431:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.642460:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054023808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.642466:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7259 00010000:00010000:0.0:1746129810.642487:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.642493:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129810.642529:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00000004:00200000:0.0:1746129810.642532:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129810.642555:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.642563:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.642585:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec400/0x48868a4e43952f04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c03 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.642598:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c03 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.642602:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.642604:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129810.642606:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800921ed400, rc 0) 00000100:00100000:0.0:1746129810.642631:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31204:x1830949054023168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 18356us (18830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.642637:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10822 00000100:00100000:0.0:1746129810.642674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.642758:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023680 00000100:00100000:0.0:1746129810.642762:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023680 00002000:00100000:0.0:1746129810.642784:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1327104->2088959) req@ffff88012c089500 x1830949054023680/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 504/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.642792:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089500 with x1830949054023680 ext(1327104->2088959) 00010000:00010000:0.0:1746129810.642798:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 38 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746129810.642807:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 38 pid: 4589 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746129810.642812:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c089500 00000100:00100000:0.0:1746129810.642823:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1760 00000100:00100000:0.0:1746129810.642827:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054023680:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129810.659072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.659113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.659125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.659161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.659178:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023936 00000100:00100000:1.0:1746129810.659185:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023936 00000100:00100000:1.0:1746129810.659220:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054024192 00000100:00100000:1.0:1746129810.659222:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054024192 00000100:00100000:1.0:1746129810.660141:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14655 00000100:00100000:1.0:1746129810.660146:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054024192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129810.660153:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.660160:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43952f27 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354c18 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.660169:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.660171:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.660175:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43952f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c18 expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129810.660184:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5282200/0x48868a4e43952f27 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c18 expref: 11 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129810.660190:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5282200, rc 0) 00000100:00100000:1.0:1746129810.660207:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054024192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 61us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.660210:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14655 00000100:00100000:1.0:1746129810.664534:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054023680:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 21704us (21857us total) trans 17179873950 rc 0/0 00000100:00100000:1.0:1746129810.664542:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1760 00002000:00100000:1.0:1746129810.664550:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1327104->2088959) req@ffff88012c089500 x1830949054023680/t17179873950(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 504/448 e 0 to 0 dl 1746129821 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.664558:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089500 with x1830949054023680 ext(1327104->2088959) 00010000:00010000:1.0:1746129810.664566:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 40 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.664577:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 40 pid: 4589 timeout: 856 lvb_type: 0 00002000:00010000:1.0:1746129810.664583:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c089500 00000100:00100000:1.0:1746129810.672036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.672102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.673214:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054024704 00000100:00100000:0.0:1746129810.673223:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054024704 00000100:00100000:1.0:1746129810.673225:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054024448 00000100:00100000:1.0:1746129810.673228:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054024448 00010000:00010000:1.0:1746129810.673250:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 40 pid: 4589 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746129810.673256:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10823 00000100:00100000:0.0:1746129810.673263:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31204:x1830949054024704:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:1.0:1746129810.673266:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7260 00000100:00100000:1.0:1746129810.673270:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054024448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.673276:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129810.673281:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.673289:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43952f2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354c26 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.673296:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 40 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.673305:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 40 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.673334:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4d6f800/0x48868a4e43952e55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2023424->2088959) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba1 expref: 40 pid: 4589 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.673346:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.673348:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.673353:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013186e400/0x48868a4e43952ef6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bfc expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.673360:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186e400/0x48868a4e43952ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bfc expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.673373:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.673382:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.673385:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013186e400/0x48868a4e43952ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bfc expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.673390:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129810.673395:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053897216:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129810.673399:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.673403:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.673407:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129810.673447:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746129810.676866:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43952f43 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.676881:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43952f43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.676892:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43952f43 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129810.676904:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9091072 00010000:00010000:0.0:1746129810.676978:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.676985:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.676990:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.676996:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ab600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129810.676999:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677005:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677015:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129810.677017:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129810.677021:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677025:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43952f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677038:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677043:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677047:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677050:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1abe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129810.677052:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677055:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677211:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f8a7600) 00010000:00010000:0.0:1746129810.677213:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129810.677215:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677219:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abe00/0x48868a4e43952f3c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.677258:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43952f2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c26 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.677270:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43952f43 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c26 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.677276:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.677278:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129810.677280:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa400, rc 0) 00000100:00100000:0.0:1746129810.677333:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31204:x1830949054024704:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4070us (5230us total) trans 8589944783 rc 0/0 00000100:00100000:0.0:1746129810.677340:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10823 00000100:00100000:0.0:1746129810.678360:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949053897216:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129810.678374:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.678397:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054024448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5125us (6367us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.678405:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7260 00000100:00100000:0.0:1746129810.682598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.682746:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025088 00000100:00100000:1.0:1746129810.682755:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025088 00002000:00100000:1.0:1746129810.682790:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012c088a80 x1830949054025088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.682800:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088a80 with x1830949054025088 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.682805:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c088a80 00000100:00100000:1.0:1746129810.682825:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6486 00000100:00100000:1.0:1746129810.682833:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1962:x1830949054025088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.686651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.686704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.687508:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025216 00000100:00100000:1.0:1746129810.687512:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025216 00002000:00100000:1.0:1746129810.687533:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012c089c00 x1830949054025216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.687541:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089c00 with x1830949054025216 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.687545:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c089c00 00000100:00100000:1.0:1746129810.687558:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6487 00000100:00100000:1.0:1746129810.687563:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054025216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129810.693589:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025472 00000100:00100000:0.0:1746129810.693597:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025472 00000100:00100000:0.0:1746129810.693633:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 713 00000100:00100000:0.0:1746129810.693640:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054025472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.693651:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.693669:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43952f43 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c26 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.693686:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.693689:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.694179:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054025472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 538us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.694186:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 713 00000100:00100000:1.0:1746129810.695536:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.695636:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025728 00000100:00100000:0.0:1746129810.695642:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025728 00000100:00100000:0.0:1746129810.695668:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10824 00000100:00100000:0.0:1746129810.695674:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31204:x1830949054025728:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129810.695690:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.695703:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437e800/0x48868a4e43952f58 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354c34 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.695782:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695793:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695801:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695810:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695815:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695820:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695826:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009437fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129810.695829:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695835:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695843:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129810.695861:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129810.695865:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695869:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437fe00/0x48868a4e43952f5f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129810.695889:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009437e800/0x48868a4e43952f58 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c34 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.695895:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009437e800/0x48868a4e43952f58 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c34 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.695900:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437e800, rc 0) 00000100:00100000:0.0:1746129810.695926:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31204:x1830949054025728:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 252us (392us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129810.695930:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10824 00000100:00100000:1.0:1746129810.697140:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054025088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14306us (14546us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.697148:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6486 00002000:00100000:1.0:1746129810.697155:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012c088a80 x1830949054025088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.697164:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c088a80 with x1830949054025088 ext(1048576->2097151) 00002000:00010000:1.0:1746129810.697168:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c088a80 00000100:00100000:1.0:1746129810.698632:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025984 00000100:00100000:1.0:1746129810.698637:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025984 00000100:00100000:1.0:1746129810.698663:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4474 00000100:00100000:1.0:1746129810.698669:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31204:x1830949054025984:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129810.698797:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31204:x1830949054025984:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 128us (184us total) trans 8589944784 rc 0/0 00000100:00100000:1.0:1746129810.698803:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4474 00000100:00100000:1.0:1746129810.712015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.714511:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026496 00000100:00100000:1.0:1746129810.714517:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026496 00002000:00100000:1.0:1746129810.714541:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a8fd2a00 x1830949054026496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.714550:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949054026496 ext(3145728->4194303) 00002000:00010000:1.0:1746129810.714553:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:1.0:1746129810.714567:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6489 00000100:00100000:1.0:1746129810.714573:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054026496:12345-192.168.204.31@tcp:3:cat.0 00000001:00080000:0.0:1746129810.724459:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873947 is committed 00000001:00080000:0.0:1746129810.724480:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873906 is committed 00000001:00080000:0.0:1746129810.724492:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873895 is committed 00000001:00080000:0.0:1746129810.724505:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873948 is committed 00000001:00080000:0.0:1746129810.724515:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873929 is committed 00000001:00080000:0.0:1746129810.724551:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873924 is committed 00000001:00080000:0.0:1746129810.724556:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873949 is committed 00000001:00080000:0.0:1746129810.724577:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873930 is committed 00000100:00100000:1.0:1746129810.726383:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054026240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13940us (14366us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.726393:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6488 00002000:00100000:1.0:1746129810.726402:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880092ada300 x1830949054026240/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.726410:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949054026240 ext(2097152->3145727) 00002000:00010000:1.0:1746129810.726415:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:0.0:1746129810.727299:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054026496:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12723us (12829us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129810.727317:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6489 00002000:00100000:0.0:1746129810.727324:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a8fd2a00 x1830949054026496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.727331:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949054026496 ext(3145728->4194303) 00002000:00010000:0.0:1746129810.727334:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:0.0:1746129810.738673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.770004:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.774374:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.776118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.777224:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.779970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.783637:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.786766:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.793445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.793606:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054027904 00000100:00100000:1.0:1746129810.793614:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054027904 00010000:00010000:1.0:1746129810.793649:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b8c expref: 21 pid: 7975 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.793691:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7265 00000100:00100000:1.0:1746129810.793698:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054027904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.793711:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.793729:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b8c expref: 21 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.793738:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b8c expref: 21 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.793755:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faeb800/0x48868a4e43952e08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b8c expref: 21 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.793781:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.793825:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054027904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 127us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.793831:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7265 00000100:00100000:0.0:1746129810.795280:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.795381:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054028032 00000100:00100000:1.0:1746129810.795385:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054028032 00010000:00010000:1.0:1746129810.795404:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b85 expref: 9 pid: 7975 timeout: 856 lvb_type: 0 00000100:00100000:1.0:1746129810.795468:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7266 00000100:00100000:1.0:1746129810.795475:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054028032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.795485:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.795497:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b85 expref: 9 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.795507:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b85 expref: 9 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.795522:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009faeae00/0x48868a4e43952e01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b85 expref: 9 pid: 7975 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.795532:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.795533:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129810.795539:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43952f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c42 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.795546:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43952f6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2932735) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c42 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129810.795571:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43952f6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2932735) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c42 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129810.795582:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053898240:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129810.795645:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129810.797821:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949053898240:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129810.797840:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.797896:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054028032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2421us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.797906:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7266 00000100:00100000:0.0:1746129810.809157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.811938:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.812100:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054028544 00000100:00100000:1.0:1746129810.812107:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054028544 00000100:00100000:1.0:1746129810.812255:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4475 00000100:00100000:1.0:1746129810.812266:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31206:x1830949054028544:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129810.812580:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31206:x1830949054028544:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 318us (647us total) trans 8589944785 rc 0/0 00000100:00100000:1.0:1746129810.812586:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4475 00000100:00100000:0.0:1746129810.830176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.836016:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.836190:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054029056 00000100:00100000:1.0:1746129810.836198:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054029056 00000100:00100000:1.0:1746129810.836235:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4476 00000100:00100000:1.0:1746129810.836241:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31214:x1830949054029056:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129810.836427:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31214:x1830949054029056:12345-192.168.204.31@tcp:35:cat.0 Request processed in 185us (422us total) trans 8589944787 rc 0/0 00000100:00100000:1.0:1746129810.836433:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4476 00000100:00100000:0.0:1746129810.838998:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.839652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.839684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.865843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.892907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.892930:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.893492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.893967:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054030208 00000100:00100000:0.0:1746129810.893971:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054030208 00000100:00100000:0.0:1746129810.893996:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14662 00000100:00100000:0.0:1746129810.894002:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054030208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.894009:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.894017:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009437f400/0x48868a4e43952fba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354c73 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129810.894045:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053898880:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129810.894071:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129810.896575:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053898880:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129810.896597:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009437f400/0x48868a4e43952fba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c73 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129810.896608:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009437f400/0x48868a4e43952fba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c73 expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129810.896633:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009437f400, rc 0) 00000100:00100000:1.0:1746129810.896667:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054030208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2665us (3174us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129810.896673:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14662 00000100:00100000:0.0:1746129810.897157:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.897240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.897448:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7268 00000100:00100000:1.0:1746129810.897456:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054030464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129810.897463:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129810.897467:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c03 expref: 9 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.897475:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c03 expref: 9 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.897507:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43952f0b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c03 expref: 9 pid: 14315 timeout: 856 lvb_type: 0 00010000:00010000:1.0:1746129810.897516:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129810.897520:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.897525:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.897530:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129810.897547:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129810.897568:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054030464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129810.897574:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7268 00000100:00100000:0.0:1746129810.900497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.904415:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.904453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.909237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.909254:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054030976 00000100:00100000:0.0:1746129810.909260:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054030976 00010000:00010000:0.0:1746129810.909279:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43952c72 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a90 expref: 7 pid: 3624 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746129810.909321:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7269 00000100:00100000:0.0:1746129810.909327:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054030976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129810.909337:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129810.909351:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43952c72 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a90 expref: 7 pid: 3624 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.909364:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43952c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a90 expref: 7 pid: 3624 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746129810.909383:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129810.909991:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054030976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 663us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.909996:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7269 00000100:00100000:0.0:1746129810.910254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.915987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.916841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.921456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.922820:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.922877:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054032128 00000100:00100000:1.0:1746129810.922881:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054032128 00002000:00100000:1.0:1746129810.922902:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a504c000 x1830949054032128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.922909:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c000 with x1830949054032128 ext(2097152->3145727) 00002000:00010000:1.0:1746129810.922912:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c000 00000100:00100000:1.0:1746129810.922931:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6496 00000100:00100000:1.0:1746129810.922936:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054032128:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129810.932589:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054032128:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9643us (9761us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.932601:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6496 00002000:00100000:1.0:1746129810.932613:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a504c000 x1830949054032128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.932622:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c000 with x1830949054032128 ext(2097152->3145727) 00002000:00010000:1.0:1746129810.932627:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c000 00000100:00100000:0.0:1746129810.941097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.945999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.969413:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.974461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.978365:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054033024 00000100:00100000:0.0:1746129810.978372:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054033024 00000100:00100000:0.0:1746129810.978411:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4477 00000100:00100000:0.0:1746129810.978417:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31220:x1830949054033024:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129810.978997:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31220:x1830949054033024:12345-192.168.204.31@tcp:35:cat.0 Request processed in 579us (696us total) trans 8589944790 rc 0/0 00000100:00100000:0.0:1746129810.979003:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4477 00000100:00100000:0.0:1746129810.980723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.981192:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.981269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129810.981282:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054033536 00000100:00100000:0.0:1746129810.981285:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054033536 00000100:00100000:0.0:1746129810.981297:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054033664 00000100:00100000:0.0:1746129810.981298:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054033664 00000100:00100000:0.0:1746129810.981319:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14668 00000100:00100000:0.0:1746129810.981324:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054033536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.981329:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.981336:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d6a00/0x48868a4e4395300e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354c9d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.981346:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.981348:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.981355:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d6a00/0x48868a4e4395300e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c9d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.981369:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d6a00/0x48868a4e4395300e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c9d expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.981379:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d6a00, rc 0) 00000100:00100000:0.0:1746129810.981400:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054033536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.981405:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14668 00000100:00100000:0.0:1746129810.981416:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14669 00000100:00100000:0.0:1746129810.981430:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054033664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129810.981437:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129810.981445:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ca4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129810.981459:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.981460:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129810.981464:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.981473:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129810.981480:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d7000, rc 0) 00000100:00100000:0.0:1746129810.981494:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054033664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129810.981499:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14669 00000100:00100000:0.0:1746129810.982054:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054033280 00000100:00100000:0.0:1746129810.982058:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054033280 00002000:00100000:0.0:1746129810.982081:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a8fd2300 x1830949054033280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129810.982089:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2300 with x1830949054033280 ext(2097152->3145727) 00002000:00010000:0.0:1746129810.982092:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2300 00000100:00100000:0.0:1746129810.982115:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6497 00000100:00100000:0.0:1746129810.982120:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054033280:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129810.986930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.988699:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054034176 00000100:00100000:1.0:1746129810.988707:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054034176 00002000:00100000:1.0:1746129810.988739:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012c043480 x1830949054034176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/0 e 0 to 0 dl 1746129821 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.988749:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043480 with x1830949054034176 ext(3145728->4194303) 00002000:00010000:1.0:1746129810.988753:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c043480 00000100:00100000:1.0:1746129810.988784:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6499 00000100:00100000:1.0:1746129810.988790:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054034176:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129810.995467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129810.995668:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054033280:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13545us (13668us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129810.995677:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6497 00002000:00100000:1.0:1746129810.995687:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a8fd2300 x1830949054033280/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:551/0 lens 488/440 e 0 to 0 dl 1746129821 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129810.995695:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2300 with x1830949054033280 ext(2097152->3145727) 00002000:00010000:1.0:1746129810.995700:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2300 00000100:00100000:0.0:1746129811.003993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.007172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.010020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.014293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.014344:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.033061:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.040460:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.042958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.048869:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054036096 00000100:00100000:0.0:1746129811.048878:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054036096 00000100:00100000:0.0:1746129811.048939:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10829 00000100:00100000:0.0:1746129811.048950:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31224:x1830949054036096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129811.048971:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.048988:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135676c00/0x48868a4e43953054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354cc7 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.049074:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049090:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049099:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049109:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049114:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049118:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049205:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e43953069 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049213:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e43953069 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049222:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e43953069 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129811.049230:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129811.049296:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049318:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049324:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049328:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135676800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.049332:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049337:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049345:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129811.049348:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.049351:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049355:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135676800/0x48868a4e4395305b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049381:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049386:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049393:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049397:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135677800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.049399:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049404:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049410:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02900) 00010000:00010000:0.0:1746129811.049412:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.049414:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049418:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135677800/0x48868a4e43953062 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.049447:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135676c00/0x48868a4e43953054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cc7 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.049457:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e43953069 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cc7 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.049463:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.049464:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129811.049466:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676000, rc 0) 00000100:00100000:0.0:1746129811.049517:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31224:x1830949054036096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 571us (737us total) trans 8589944793 rc 0/0 00000100:00100000:0.0:1746129811.049523:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10829 00000100:00100000:0.0:1746129811.049723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.050689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.052160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.053620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.053696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.055589:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.056431:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054037248 00000100:00100000:0.0:1746129811.056987:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054037632 00000100:00100000:0.0:1746129811.056991:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054037632 00002000:00100000:0.0:1746129811.057020:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8fd1880 x1830949054037632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.057028:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1880 with x1830949054037632 ext(3145728->4194303) 00010000:00010000:0.0:1746129811.057035:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 12 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.057045:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 12 pid: 8435 timeout: 857 lvb_type: 1 00002000:00010000:0.0:1746129811.057051:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8fd1880 00000100:00100000:0.0:1746129811.057075:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1766 00000100:00100000:0.0:1746129811.057080:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054037632:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129811.057400:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054037248 00002000:00100000:1.0:1746129811.057419:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009207f480 x1830949054037248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.057426:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f480 with x1830949054037248 ext(2097152->3145727) 00010000:00010000:1.0:1746129811.057432:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 13 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.057440:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 13 pid: 8435 timeout: 857 lvb_type: 1 00002000:00010000:1.0:1746129811.057444:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207f480 00000100:00100000:1.0:1746129811.057460:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1767 00000100:00100000:1.0:1746129811.057466:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054037248:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129811.059072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.059111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.072318:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054037632:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15222us (15911us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.072330:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1766 00002000:00100000:1.0:1746129811.072339:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8fd1880 x1830949054037632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.072346:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1880 with x1830949054037632 ext(3145728->4194303) 00010000:00010000:1.0:1746129811.072355:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 13 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.072365:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 13 pid: 8435 timeout: 857 lvb_type: 1 00002000:00010000:1.0:1746129811.072371:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8fd1880 00000100:00100000:1.0:1746129811.077422:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054037248:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19947us (21828us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.077433:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1767 00002000:00100000:1.0:1746129811.077442:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009207f480 x1830949054037248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.077450:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f480 with x1830949054037248 ext(2097152->3145727) 00010000:00010000:1.0:1746129811.077459:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 11 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.077469:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 11 pid: 8435 timeout: 857 lvb_type: 1 00002000:00010000:1.0:1746129811.077476:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207f480 00000100:00100000:0.0:1746129811.083238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.085065:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054037888 00000100:00100000:1.0:1746129811.085073:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054037888 00010000:00010000:1.0:1746129811.085104:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 11 pid: 8435 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746129811.085138:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7277 00000100:00100000:1.0:1746129811.085144:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054037888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.085154:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.085171:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 11 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.085181:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 11 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.085199:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e43953015 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ca4 expref: 11 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.085222:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.085224:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.085230:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.085238:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.085269:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.085279:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053901184:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129811.085364:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.085420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.089189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.092629:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053901184:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129811.092651:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.092672:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054037888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7528us (9445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.092679:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7277 00000100:00100000:1.0:1746129811.092740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.097215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.100665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.102120:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054038912 00000100:00100000:1.0:1746129811.102130:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054038912 00002000:00100000:1.0:1746129811.102168:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3923968->3928063) req@ffff88012d637b80 x1830949054038912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.102178:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637b80 with x1830949054038912 ext(3923968->3928063) 00010000:00010000:1.0:1746129811.102187:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 11 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.102200:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 11 pid: 3624 timeout: 857 lvb_type: 0 00002000:00010000:1.0:1746129811.102207:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d637b80 00000100:00100000:1.0:1746129811.102513:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1769 00000100:00100000:1.0:1746129811.102521:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054038912:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129811.102701:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054038912:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 177us (2057us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129811.102707:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1769 00002000:00100000:1.0:1746129811.102712:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3923968->3928063) req@ffff88012d637b80 x1830949054038912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746129822 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.102720:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637b80 with x1830949054038912 ext(3923968->3928063) 00010000:00010000:1.0:1746129811.102725:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 11 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.102733:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 11 pid: 3624 timeout: 857 lvb_type: 0 00002000:00010000:1.0:1746129811.102738:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d637b80 00000100:00100000:0.0:1746129811.108446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.108592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.109312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.122420:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.123735:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7279 00000100:00100000:1.0:1746129811.124330:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054039808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.124346:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.124368:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.124381:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.124400:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e4395307e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3854336->3928063) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cd5 expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.125959:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.125963:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.125972:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.125980:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.126016:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.126027:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053901568:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129811.126804:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.129521:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053901568:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129811.129539:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.129574:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054039808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5831us (7159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.129583:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7279 00000100:00100000:0.0:1746129811.131437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.160478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.164659:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.189354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.189417:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054040448 00000100:00100000:1.0:1746129811.189426:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054040448 00010000:00010000:1.0:1746129811.189457:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43953077 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2654208->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cce expref: 17 pid: 3624 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.189496:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7280 00000100:00100000:1.0:1746129811.189503:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054040448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.189515:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.189531:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43953077 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2654208->2854911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cce expref: 17 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.189542:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43953077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2654208->2854911) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cce expref: 17 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.189565:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b357200/0x48868a4e43953077 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2654208->2854911) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cce expref: 17 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.189598:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.189600:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.189606:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.189614:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.189641:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.189652:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053901824:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129811.192370:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.208015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.208065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.208228:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054040704 00000100:00100000:1.0:1746129811.208237:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054040704 00002000:00100000:1.0:1746129811.208277:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012d635f80 x1830949054040704/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.208287:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949054040704 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.208291:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:1.0:1746129811.208544:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054040960 00000100:00100000:1.0:1746129811.208548:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054040960 00002000:00100000:1.0:1746129811.208562:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012d637480 x1830949054040960/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.208575:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637480 with x1830949054040960 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.208578:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637480 00000100:00100000:1.0:1746129811.208637:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6505 00000100:00100000:1.0:1746129811.208644:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054040704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129811.231446:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054040704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 22795us (23432us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.231455:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6505 00002000:00100000:1.0:1746129811.231464:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012d635f80 x1830949054040704/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.231473:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949054040704 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.231478:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:0.0:1746129811.249646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.249736:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054041216 00000100:00100000:1.0:1746129811.249743:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054041216 00002000:00100000:1.0:1746129811.249782:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012d637800 x1830949054041216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.249790:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637800 with x1830949054041216 ext(4194304->4931583) 00002000:00010000:1.0:1746129811.249795:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637800 00000100:00100000:1.0:1746129811.249826:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6507 00000100:00100000:1.0:1746129811.249832:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054041216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129811.261398:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054041216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11558us (11751us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129811.261409:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6507 00002000:00100000:1.0:1746129811.261421:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012d637800 x1830949054041216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.261429:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637800 with x1830949054041216 ext(4194304->4931583) 00002000:00010000:1.0:1746129811.261434:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d637800 00000100:00100000:0.0:1746129811.267670:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.276515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.276567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.276649:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054041856 00000100:00100000:1.0:1746129811.276657:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054041856 00000100:00100000:1.0:1746129811.276706:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4480 00000100:00100000:1.0:1746129811.276712:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31230:x1830949054041856:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129811.276907:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31230:x1830949054041856:12345-192.168.204.31@tcp:35:cat.0 Request processed in 194us (339us total) trans 8589944796 rc 0/0 00000100:00100000:1.0:1746129811.276913:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4480 00000100:00100000:0.0:1746129811.280906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.280952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.281039:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054042112 00000100:00100000:1.0:1746129811.281047:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054042112 00000100:00100000:1.0:1746129811.281090:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054041984 00000100:00100000:1.0:1746129811.281093:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054041984 00000100:00100000:1.0:1746129811.281110:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14677 00000100:00100000:1.0:1746129811.281117:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054042112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129811.281132:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.281146:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354cf8 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.281164:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.281166:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.281174:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 22 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.281187:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 22 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.281197:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f200, rc 0) 00000100:00100000:1.0:1746129811.281231:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054042112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.281237:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14677 00000100:00100000:1.0:1746129811.281251:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14678 00000100:00100000:1.0:1746129811.281255:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054041984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129811.281262:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.281270:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354cf1 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.281280:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.281281:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.281285:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 17 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.281293:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 17 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.281315:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98fa00, rc 0) 00000100:00100000:1.0:1746129811.281330:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054041984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.281336:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14678 00000100:00100000:0.0:1746129811.285941:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.286998:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054042368 00000100:00100000:1.0:1746129811.287006:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054042368 00002000:00100000:1.0:1746129811.287041:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009fd44e00 x1830949054042368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.287050:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44e00 with x1830949054042368 ext(0->1048575) 00002000:00010000:1.0:1746129811.287055:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44e00 00000100:00100000:1.0:1746129811.287081:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6508 00000100:00100000:1.0:1746129811.287087:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054042368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129811.304949:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054042368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17854us (19006us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.304961:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6508 00002000:00100000:1.0:1746129811.304971:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009fd44e00 x1830949054042368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.304980:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44e00 with x1830949054042368 ext(0->1048575) 00002000:00010000:1.0:1746129811.304985:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44e00 00000100:00100000:0.0:1746129811.334030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.334547:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054042624 00000100:00100000:1.0:1746129811.334555:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054042624 00002000:00100000:1.0:1746129811.334588:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009fd45500 x1830949054042624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.334596:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45500 with x1830949054042624 ext(2097152->3145727) 00002000:00010000:1.0:1746129811.334601:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd45500 00000100:00100000:1.0:1746129811.334630:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6509 00000100:00100000:1.0:1746129811.334636:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054042624:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.345894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.345928:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.345953:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.346175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.346236:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6511 00000100:00100000:0.0:1746129811.346242:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054043136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.346602:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054043648 00000100:00100000:0.0:1746129811.346605:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054043648 00000100:00100000:0.0:1746129811.346637:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10831 00000100:00100000:0.0:1746129811.346642:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31233:x1830949054043648:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129811.346656:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.346669:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130675400/0x48868a4e439530c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354cff expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.346739:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346749:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346758:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346767:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346772:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346776:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346876:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6c00/0x48868a4e439530d9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346884:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6c00/0x48868a4e439530d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346890:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6c00/0x48868a4e439530d9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129811.346897:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129811.346960:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346966:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346971:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346976:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d6a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.346979:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346984:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.346992:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129811.346995:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.346998:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347002:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6a00/0x48868a4e439530cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347019:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347024:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347032:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347036:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d7000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.347037:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347042:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347047:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b900) 00010000:00010000:0.0:1746129811.347049:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.347051:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347055:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7000/0x48868a4e439530d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.347087:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130675400/0x48868a4e439530c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cff expref: 24 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.347097:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6c00/0x48868a4e439530d9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cff expref: 23 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.347102:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.347104:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129811.347106:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d6c00, rc 0) 00000100:00100000:0.0:1746129811.347142:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31233:x1830949054043648:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 499us (966us total) trans 8589944797 rc 0/0 00000100:00100000:0.0:1746129811.347148:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10831 00000100:00100000:0.0:1746129811.347684:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054042624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13046us (13661us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129811.347690:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6509 00002000:00100000:0.0:1746129811.347697:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009fd45500 x1830949054042624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.347705:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45500 with x1830949054042624 ext(2097152->3145727) 00002000:00010000:0.0:1746129811.347708:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd45500 00000100:00100000:0.0:1746129811.353052:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.353076:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054043904 00000100:00100000:0.0:1746129811.353082:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054043904 00000100:00100000:0.0:1746129811.353111:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10832 00000100:00100000:0.0:1746129811.353117:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31235:x1830949054043904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129811.353135:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.353148:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6200/0x48868a4e439530e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d06 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.353223:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.353234:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.353243:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.353252:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00000100:00100000:1.0:1746129811.353340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.354036:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054044032 00000100:00100000:1.0:1746129811.354040:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054044032 00000100:00100000:1.0:1746129811.354065:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 716 00000100:00100000:1.0:1746129811.354070:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054044032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.354077:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.354090:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6c00/0x48868a4e439530d9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cff expref: 23 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.354104:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.354107:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.354129:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054044032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.354134:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 716 00010000:00010000:0.0:1746129811.356007:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.356027:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356357:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c400/0x48868a4e439530fc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356370:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c400/0x48868a4e439530fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129811.356374:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054044160 00010000:00010000:1.0:1746129811.356376:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c400/0x48868a4e439530fc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129811.356379:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054044160 00000004:00200000:1.0:1746129811.356383:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000100:00100000:0.0:1746129811.356417:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14679 00000100:00100000:0.0:1746129811.356423:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31233:x1830949054044160:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129811.356435:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.356445:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d0d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.356455:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356461:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.356464:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.356466:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356471:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d6400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.356471:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.356474:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.356477:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.356478:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.356480:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.356481:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2228224->2310143] (req 2228224->2310143) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 13 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.356488:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129811.356491:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129811.356494:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356497:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6400/0x48868a4e439530ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.356504:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.356507:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356512:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.356513:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 25 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.356516:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356519:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8d7c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129811.356521:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.356525:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129811.356527:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053901952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.356584:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.356590:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746129811.356597:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053902080:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.356609:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129811.357663:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02900) 00010000:00010000:1.0:1746129811.357668:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129811.357673:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.357679:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d7c00/0x48868a4e439530f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.357722:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8d6200/0x48868a4e439530e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d06 expref: 302 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.357733:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c400/0x48868a4e439530fc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d06 expref: 301 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.357739:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.357741:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129811.357743:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b74c400, rc 0) 00000100:00100000:1.0:1746129811.357779:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:31235:x1830949054043904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4661us (4733us total) trans 8589944798 rc 0/0 00000100:00100000:1.0:1746129811.357785:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10832 00000100:00100000:1.0:1746129811.370502:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054043136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23932us (24244us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.370514:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6511 00002000:00100000:1.0:1746129811.370526:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009fd44700 x1830949054043136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.370534:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44700 with x1830949054043136 ext(2097152->3145727) 00010000:00010000:1.0:1746129811.370542:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 24 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.370553:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 24 pid: 7975 timeout: 857 lvb_type: 1 00002000:00010000:1.0:1746129811.370559:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd44700 00000100:00100000:0.0:1746129811.373085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.373255:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054044288 00000100:00100000:1.0:1746129811.373263:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054044288 00010000:00010000:1.0:1746129811.373291:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.373339:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7281 00000100:00100000:1.0:1746129811.373346:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054044288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.373358:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.373375:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.373385:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.373405:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b356c00/0x48868a4e43953085 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cdc expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.373432:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.376834:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054044288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3478us (3744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.376844:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7281 00000100:00100000:0.0:1746129811.378035:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054043264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31770us (32077us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129811.378044:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6512 00002000:00100000:0.0:1746129811.378053:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009fd45180 x1830949054043264/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.378062:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd45180 with x1830949054043264 ext(3145728->4194303) 00010000:00010000:0.0:1746129811.378076:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 22 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.378088:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 22 pid: 7975 timeout: 857 lvb_type: 1 00002000:00010000:0.0:1746129811.378095:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd45180 00000100:00100000:0.0:1746129811.381417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.381457:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.381515:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054044416 00000100:00100000:1.0:1746129811.381520:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054044416 00000100:00100000:1.0:1746129811.381554:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 717 00000100:00100000:1.0:1746129811.381560:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1963:x1830949054044416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.381568:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.381585:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c400/0x48868a4e439530fc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d06 expref: 302 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.381597:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.381601:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.381621:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1963:x1830949054044416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.381626:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 717 00000100:00100000:1.0:1746129811.388786:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054045184 00000100:00100000:1.0:1746129811.388795:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054045184 00002000:00100000:1.0:1746129811.388832:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094eb4380 x1830949054045184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.388841:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4380 with x1830949054045184 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.388862:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4380 00000100:00100000:0.0:1746129811.389221:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054044928 00000100:00100000:0.0:1746129811.389226:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054044928 00010000:00010000:0.0:1746129811.389243:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 24 pid: 7975 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.389264:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7282 00000100:00100000:0.0:1746129811.389270:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054044928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.389280:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.389308:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 24 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.389320:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 24 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.389340:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f200/0x48868a4e439530b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf8 expref: 24 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.389356:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.389358:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.389365:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.389372:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.389397:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 11 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.389409:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053902208:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129811.389473:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.389602:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6513 00000100:00100000:1.0:1746129811.389608:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054045184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.395654:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053902208:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129811.395684:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.396169:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054044928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6896us (9063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.396178:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7282 00000100:00100000:0.0:1746129811.396457:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054045440 00000100:00100000:0.0:1746129811.396462:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054045440 00002000:00100000:0.0:1746129811.396487:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2228224->2232319) req@ffff8800a8fd0e00 x1830949054045440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.396496:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0e00 with x1830949054045440 ext(2228224->2232319) 00002000:00010000:0.0:1746129811.396500:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0e00 00000100:00100000:0.0:1746129811.396512:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6514 00000100:00100000:0.0:1746129811.396517:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054045440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129811.396619:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054045440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 102us (230us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129811.396624:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6514 00002000:00100000:0.0:1746129811.396628:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2228224->2232319) req@ffff8800a8fd0e00 x1830949054045440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.396634:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0e00 with x1830949054045440 ext(2228224->2232319) 00002000:00010000:0.0:1746129811.396636:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd0e00 00000100:00100000:0.0:1746129811.401089:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.402186:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054045184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12576us (13472us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.402193:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6513 00002000:00100000:1.0:1746129811.402200:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094eb4380 x1830949054045184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.402207:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4380 with x1830949054045184 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.402211:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4380 00000100:00100000:0.0:1746129811.405597:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.405671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.405695:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054046080 00000100:00100000:0.0:1746129811.405702:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054046080 00010000:00010000:0.0:1746129811.405732:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd9ce00/0x48868a4e43952dad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b1c expref: 24 pid: 8437 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.405760:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7283 00000100:00100000:0.0:1746129811.405766:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054046080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.405778:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746129811.405795:0:7109:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746129811.405800:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bd9ce00/0x48868a4e43952dad lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b1c expref: 24 pid: 8437 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.405811:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bd9ce00/0x48868a4e43952dad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354b1c expref: 24 pid: 8437 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.405836:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.405896:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054046080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.405902:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7283 00000100:00100000:0.0:1746129811.405931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.405943:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054045952 00000100:00100000:0.0:1746129811.405945:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054045952 00010000:00010000:0.0:1746129811.405956:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43952d28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ad6 expref: 12 pid: 20441 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.405988:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7284 00000100:00100000:0.0:1746129811.405993:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054045952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.406000:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.406007:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43952d28 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ad6 expref: 12 pid: 20441 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.406014:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43952d28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ad6 expref: 12 pid: 20441 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.406024:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.406039:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054045952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.406043:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7284 00000100:00100000:0.0:1746129811.406119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.406130:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054046208 00000100:00100000:0.0:1746129811.406133:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054046208 00010000:00010000:0.0:1746129811.406152:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b357000/0x48868a4e43952c80 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a9e expref: 7 pid: 3624 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.406164:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7285 00000100:00100000:0.0:1746129811.406168:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054046208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.406174:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.406180:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b357000/0x48868a4e43952c80 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a9e expref: 7 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.406192:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b357000/0x48868a4e43952c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354a9e expref: 7 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.406203:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.406205:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.406210:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1146880->1433599) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d1b expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.406217:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1146880->1433599) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d1b expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.406242:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1146880->1433599) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d1b expref: 23 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.406252:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053902720:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129811.406328:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.407363:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054045824 00000100:00100000:1.0:1746129811.407368:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054045824 00002000:00100000:1.0:1746129811.407393:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2306048->2310143) req@ffff88009fd46300 x1830949054045824/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.407406:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46300 with x1830949054045824 ext(2306048->2310143) 00002000:00010000:1.0:1746129811.407409:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd46300 00000100:00100000:1.0:1746129811.407429:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6515 00000100:00100000:1.0:1746129811.407433:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054045824:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129811.407536:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054045824:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 102us (1948us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129811.407541:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6515 00002000:00100000:1.0:1746129811.407546:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2306048->2310143) req@ffff88009fd46300 x1830949054045824/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.407553:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46300 with x1830949054045824 ext(2306048->2310143) 00002000:00010000:1.0:1746129811.407556:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd46300 00000100:00100000:0.0:1746129811.409468:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053902720:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129811.409487:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.409510:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054046208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3341us (3391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.409518:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7285 00000100:00100000:0.0:1746129811.409580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.409686:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054046464 00000100:00100000:1.0:1746129811.409690:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054046464 00000100:00100000:1.0:1746129811.409721:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4482 00000100:00100000:1.0:1746129811.409727:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31233:x1830949054046464:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129811.409972:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31233:x1830949054046464:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 245us (392us total) trans 8589944800 rc 0/0 00000100:00100000:1.0:1746129811.409977:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4482 00000100:00100000:0.0:1746129811.411601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.412557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.424160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.424240:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.424312:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054047232 00000100:00100000:1.0:1746129811.424320:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054047232 00002000:00100000:1.0:1746129811.424355:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009a04fb80 x1830949054047232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.424363:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949054047232 ext(4194304->4931583) 00002000:00010000:1.0:1746129811.424368:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04fb80 00000100:00100000:1.0:1746129811.424381:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054047360 00000100:00100000:1.0:1746129811.424383:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054047360 00002000:00100000:1.0:1746129811.424393:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1429504->1433599) req@ffff88009a04e680 x1830949054047360/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.424400:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e680 with x1830949054047360 ext(1429504->1433599) 00002000:00010000:1.0:1746129811.424402:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04e680 00000100:00100000:1.0:1746129811.424413:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6517 00000100:00100000:1.0:1746129811.424419:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054047232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.428422:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.429550:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054047232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5130us (5397us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129811.429559:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6517 00002000:00100000:1.0:1746129811.429565:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009a04fb80 x1830949054047232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.429573:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949054047232 ext(4194304->4931583) 00002000:00010000:1.0:1746129811.429576:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04fb80 00000100:00100000:0.0:1746129811.433839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.433922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.434189:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054047744 00000100:00100000:1.0:1746129811.434196:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054047744 00000100:00100000:1.0:1746129811.435190:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4483 00000100:00100000:1.0:1746129811.435197:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:7658:x1830949054047744:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129811.435677:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:7658:x1830949054047744:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 480us (1840us total) trans 8589944801 rc 0/0 00000100:00100000:1.0:1746129811.435682:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4483 00000100:00100000:0.0:1746129811.440047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.440098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.440292:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054048128 00000100:00100000:1.0:1746129811.440307:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054048128 00010000:00010000:1.0:1746129811.440325:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c65 expref: 302 pid: 14315 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.440347:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7286 00000100:00100000:1.0:1746129811.440353:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1961:x1830949054048128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.440362:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.440367:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c65 expref: 302 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.440375:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c65 expref: 302 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.440390:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26800/0x48868a4e43952fb3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c65 expref: 302 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.440403:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.440407:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.440415:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.440421:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.440447:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.440464:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1961:x1830949054048128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.440469:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7286 00000100:00100000:0.0:1746129811.447709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.450663:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.451055:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.451092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.451161:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054048384 00000100:00100000:1.0:1746129811.451169:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054048384 00000100:00100000:1.0:1746129811.451200:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054048512 00000100:00100000:1.0:1746129811.451202:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054048512 00000100:00100000:1.0:1746129811.451213:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054048640 00000100:00100000:1.0:1746129811.451214:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054048640 00000100:00100000:1.0:1746129811.451226:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14686 00000100:00100000:1.0:1746129811.451233:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054048384:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129811.451247:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.451260:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08da00/0x48868a4e43953157 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d45 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.451315:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053902976:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129811.451375:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efd300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.451393:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14687 00000100:00100000:1.0:1746129811.451398:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054048512:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129811.451405:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.451413:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395315e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d4c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.451422:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.451424:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.451430:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395315e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d4c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.451442:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395315e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d4c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.451453:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08d800, rc 0) 00000100:00100000:1.0:1746129811.451471:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054048512:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 74us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.451476:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14687 00000100:00100000:1.0:1746129811.451490:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14688 00000100:00100000:1.0:1746129811.451495:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054048640:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129811.451500:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.451505:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e43953165 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d53 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.451520:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e43953165 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d53 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.451527:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e43953165 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d53 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.451539:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c400, rc 0) 00000100:00100000:1.0:1746129811.451552:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054048640:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 57us (460us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129811.451557:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14688 00002000:00010000:1.0:1746129811.457160:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129808 -> 1746129812 00002000:00010000:1.0:1746129811.457167:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129808 -> 1746129812 00002000:00010000:1.0:1746129811.457169:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129808 -> 1746129812 00000100:00100000:1.0:1746129811.457192:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053902976:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129811.457222:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08da00/0x48868a4e43953157 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d45 expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.457235:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08da00/0x48868a4e43953157 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d45 expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.457245:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08da00, rc 0) 00000100:00100000:1.0:1746129811.457586:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054048384:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6352us (6928us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129811.457595:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14686 00000100:00100000:0.0:1746129811.462495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.464397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.464465:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054049024 00000100:00100000:1.0:1746129811.464469:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054049024 00010000:00010000:1.0:1746129811.464487:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d29 expref: 11 pid: 14314 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.464518:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7287 00000100:00100000:1.0:1746129811.464524:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054049024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.464533:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.464538:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d29 expref: 11 pid: 14314 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.464549:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d29 expref: 11 pid: 14314 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.464562:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e4395313b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d29 expref: 11 pid: 14314 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.464575:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.464579:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e43953173 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.464584:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e43953173 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.464589:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e43953173 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.464614:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.464637:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054049024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.464643:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7287 00000100:00100000:0.0:1746129811.466501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.468420:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.470794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.470836:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.470922:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054049408 00000100:00100000:1.0:1746129811.470927:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054049408 00000100:00100000:1.0:1746129811.470951:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054049536 00000100:00100000:1.0:1746129811.470958:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054049536 00000100:00100000:1.0:1746129811.470985:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14689 00000100:00100000:1.0:1746129811.470992:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054049408:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129811.471005:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.471018:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08c800/0x48868a4e4395318f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d68 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.471058:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053903360:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129811.471108:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4efdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.472648:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053903360:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129811.472668:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c800/0x48868a4e4395318f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d68 expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.472678:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c800/0x48868a4e4395318f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d68 expref: 7 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.472685:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c800, rc 0) 00000100:00100000:1.0:1746129811.472716:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054049408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1725us (1927us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129811.472721:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14689 00000100:00100000:0.0:1746129811.474494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477015:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477051:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477063:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477083:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477094:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477116:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.477128:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054050048 00000100:00100000:1.0:1746129811.477130:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054050048 00000100:00100000:0.0:1746129811.478513:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14693 00000100:00100000:0.0:1746129811.478521:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054050304:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129811.478539:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478550:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095230a00/0x48868a4e43952e78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bb6 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478557:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013094be00/0x48868a4e43952f19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c11 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478567:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952ea2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd9 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478573:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.478575:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.478577:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478589:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952ea2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd9 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478596:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9800/0x48868a4e43952ea2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bd9 expref: 10 pid: 7975 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.478602:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053904000:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.478620:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013094be00/0x48868a4e43952f19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c11 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478627:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013094be00/0x48868a4e43952f19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c11 expref: 10 pid: 3624 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.478633:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053904256:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.478648:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095230a00/0x48868a4e43952e78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bb6 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478657:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095230a00/0x48868a4e43952e78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bb6 expref: 16 pid: 4589 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746129811.478664:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053904384:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.478676:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.478688:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14695 00000100:00100000:0.0:1746129811.478693:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054050176:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129811.478705:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478712:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953118 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1146880->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d1b expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478717:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129811.478718:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129811.478720:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478730:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953118 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1146880->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d1b expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478736:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953118 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1146880->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d1b expref: 21 pid: 3624 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746129811.478743:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053904640:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.478754:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.478765:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14696 00000100:00100000:0.0:1746129811.478770:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054050432:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129811.478782:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478790:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478796:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395315e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d4c expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478802:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478807:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.478809:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.478810:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478824:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478831:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 16 pid: 7975 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.478837:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053904896:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.478888:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395315e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d4c expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.478895:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395315e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d4c expref: 10 pid: 8436 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.478901:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053905024:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.478918:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.478925:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 10 pid: 3624 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746129811.478932:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053905152:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.478942:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.485092:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053905024:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.485120:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053905152:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129811.485183:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053904000:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129811.485191:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053904256:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.485892:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053904640:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.485906:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.485961:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053904896:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.485976:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.486004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.486107:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053904384:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129811.486120:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.486625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.486874:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054051328 00000100:00100000:1.0:1746129811.486880:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054051328 00010000:00010000:1.0:1746129811.487650:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e4395302a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cb9 expref: 17 pid: 3624 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746129811.487668:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7290 00000100:00100000:1.0:1746129811.487674:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054051328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.487682:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.487690:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e4395302a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cb9 expref: 17 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.487699:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e4395302a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cb9 expref: 17 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.487709:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e4395302a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cb9 expref: 17 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.487722:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.487739:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054051328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.487744:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7290 00000100:00100000:0.0:1746129811.495263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.495307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.495321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.495403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.495491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.496839:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054051712 00000100:00100000:1.0:1746129811.496842:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054051712 00010000:00010000:1.0:1746129811.496869:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b356600/0x48868a4e43953111 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d14 expref: 23 pid: 4589 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.496885:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7293 00000100:00100000:1.0:1746129811.496891:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054050688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.496898:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.496908:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ea0600/0x48868a4e43952f51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c2d expref: 9 pid: 8435 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.496962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496970:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.496997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129811.497024:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ea0600/0x48868a4e43952f51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c2d expref: 9 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.497050:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ea0600/0x48868a4e43952f51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c2d expref: 9 pid: 8435 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.497080:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.497116:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054050688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 225us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.497125:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7293 00000100:00100000:1.0:1746129811.497136:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054052224 00000100:00100000:1.0:1746129811.497138:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054052224 00010000:00010000:1.0:1746129811.497147:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009330f400/0x48868a4e4395301c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cab expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.497161:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7296 00000100:00100000:1.0:1746129811.497165:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054052352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.497171:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.497178:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.497186:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 13 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.497203:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b356800/0x48868a4e4395308c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ce3 expref: 12 pid: 3624 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.497212:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.497225:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054052352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.497230:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7296 00000100:00100000:1.0:1746129811.497245:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7299 00000100:00100000:1.0:1746129811.497250:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054052480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.497256:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.497263:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 17 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.497270:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 16 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.497279:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439530bd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354cf1 expref: 16 pid: 7975 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.497286:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.497287:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.497290:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.497308:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.497322:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.497334:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054052480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.497340:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7299 00000100:00100000:1.0:1746129811.497361:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054051968 00000100:00100000:1.0:1746129811.497364:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054051968 00002000:00100000:1.0:1746129811.497376:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2228224->2310143) req@ffff88009f6a5f80 x1830949054051968/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.497384:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5f80 with x1830949054051968 ext(2228224->2310143) 00010000:00010000:1.0:1746129811.497388:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 10 pid: 4589 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.497396:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 10 pid: 4589 timeout: 857 lvb_type: 0 00002000:00010000:1.0:1746129811.497401:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a5f80 00000100:00100000:1.0:1746129811.497418:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1773 00000100:00100000:1.0:1746129811.497422:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054051968:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:0.0:1746129811.497576:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497583:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497594:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497600:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497610:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497615:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98e600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129811.497617:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497622:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497630:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.497636:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98e600/0x48868a4e439531d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.497674:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054050432:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 18904us (20556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.497679:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14696 00010000:00010000:1.0:1746129811.498199:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498207:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498221:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498228:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498234:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498238:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98fe00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129811.498241:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498247:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498255:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.498260:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fe00/0x48868a4e439531c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.498572:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054050304:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 20051us (21506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.498578:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14693 00000100:00100000:1.0:1746129811.503453:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054051968:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 6022us (6618us total) trans 17179873953 rc 0/0 00000100:00100000:1.0:1746129811.503462:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1773 00002000:00100000:1.0:1746129811.503471:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2228224->2310143) req@ffff88009f6a5f80 x1830949054051968/t17179873953(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/448 e 0 to 0 dl 1746129822 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.503479:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5f80 with x1830949054051968 ext(2228224->2310143) 00010000:00010000:1.0:1746129811.503486:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 12 pid: 4589 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.503496:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f8d6000/0x48868a4e4395310a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2228224->3145727] (req 2228224->2310143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d0d expref: 12 pid: 4589 timeout: 857 lvb_type: 0 00002000:00010000:1.0:1746129811.503501:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6a5f80 00000100:00100000:1.0:1746129811.509636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.510582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129811.511167:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511174:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511192:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511197:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511203:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511207:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98e400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129811.511210:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511215:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511224:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.511230:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98e400/0x48868a4e439531ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.511732:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054050176:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 33037us (34635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.511738:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14695 00000100:00100000:0.0:1746129811.511964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.512105:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054053248 00000100:00100000:1.0:1746129811.512109:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054053248 00000100:00100000:1.0:1746129811.512138:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4484 00000100:00100000:1.0:1746129811.512143:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31242:x1830949054053248:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129811.512353:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31242:x1830949054053248:12345-192.168.204.31@tcp:35:cat.0 Request processed in 209us (388us total) trans 8589944805 rc 0/0 00000100:00100000:1.0:1746129811.512358:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4484 00000100:00100000:0.0:1746129811.513437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.514238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.514572:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054053760 00000100:00100000:1.0:1746129811.514576:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054053760 00000100:00100000:1.0:1746129811.514601:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14697 00000100:00100000:1.0:1746129811.514606:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054053760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129811.514619:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.514632:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354d8b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129811.514651:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d393, atime: 0x6813d393, ctime: 0x6813d393, blocks: 0x821 00010000:00010000:1.0:1746129811.514663:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.514664:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.514671:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.514681:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.514688:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08de00, rc 0) 00000100:00100000:1.0:1746129811.514710:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054053760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 104us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.514715:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14697 00000100:00100000:0.0:1746129811.514968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.515029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.515041:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.516088:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14699 00000100:00100000:0.0:1746129811.516093:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054054272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.516099:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.516106:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354da7 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129811.516118:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d394, atime: 0x6813d393, ctime: 0x6813d394, blocks: 0x102b 00010000:00010000:0.0:1746129811.516124:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.516125:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.516129:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.516138:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.516145:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092610200, rc 0) 00000100:00100000:0.0:1746129811.516157:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054054272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.516161:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14699 00000100:00100000:0.0:1746129811.516187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.516631:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054054144 00000100:00100000:0.0:1746129811.516634:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054054144 00000100:00100000:0.0:1746129811.516655:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14702 00000100:00100000:0.0:1746129811.516660:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054054144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.516666:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.516672:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092611400/0x48868a4e43953229 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354da0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129811.516681:0:7975:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d393, atime: 0x6813d393, ctime: 0x6813d393, blocks: 0x15e9 00010000:00010000:0.0:1746129811.516687:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.516688:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.516692:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092611400/0x48868a4e43953229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da0 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.516701:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092611400/0x48868a4e43953229 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da0 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.516707:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092611400, rc 0) 00000100:00100000:0.0:1746129811.517067:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054054144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 405us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.517072:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14702 00000100:00100000:0.0:1746129811.517508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.517539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.517566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.517624:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054054656 00000100:00100000:1.0:1746129811.517627:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054054656 00010000:00010000:1.0:1746129811.517639:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a10a600/0x48868a4e43952e94 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354bcb expref: 26 pid: 15044 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.517655:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7304 00000100:00100000:1.0:1746129811.517660:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054054528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.517668:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.517672:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26200/0x48868a4e43952ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c8f expref: 26 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.517680:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26200/0x48868a4e43952ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c8f expref: 26 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.517699:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f26200/0x48868a4e43952ff9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354c8f expref: 26 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.518638:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.518643:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e439531ff lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.518652:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.518681:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054054528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1020us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.518687:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7304 00000100:00100000:0.0:1746129811.519202:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.519279:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054054912 00000100:00100000:1.0:1746129811.519283:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054054912 00000100:00100000:1.0:1746129811.519321:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4485 00000100:00100000:1.0:1746129811.519327:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094c61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:27193:x1830949054054912:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129811.519462:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094c61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:27193:x1830949054054912:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 135us (260us total) trans 8589944806 rc 0/0 00000100:00100000:1.0:1746129811.519473:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4485 00000100:00100000:0.0:1746129811.521637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.521671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.521700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.522500:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.522547:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.522699:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054055552 00000100:00100000:1.0:1746129811.522702:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054055552 00010000:00010000:1.0:1746129811.522712:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952e63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba8 expref: 300 pid: 15044 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.522731:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7310 00000100:00100000:1.0:1746129811.522738:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1963:x1830949054055552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.522745:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.522749:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952e63 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba8 expref: 300 pid: 15044 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.522756:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952e63 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba8 expref: 300 pid: 15044 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.522767:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d7f8e00/0x48868a4e43952e63 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ba8 expref: 300 pid: 15044 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.522776:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.522779:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e439531ff lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.522784:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e439531ff lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.522789:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e439531ff lrc: 5/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.522795:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43953230 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dae expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.522826:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.522947:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1963:x1830949054055552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 210us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.522953:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7310 00000100:00100000:1.0:1746129811.537885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000001:00080000:1.0:1746129811.544709:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944797 is committed 00000001:00080000:1.0:1746129811.544724:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944783 is committed 00000001:00080000:1.0:1746129811.544728:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944782 is committed 00000001:00080000:1.0:1746129811.544738:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944806 is committed 00000001:00080000:1.0:1746129811.544742:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944805 is committed 00000001:00080000:1.0:1746129811.544754:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944784 is committed 00000001:00080000:1.0:1746129811.544758:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944807 is committed 00000004:00080000:1.0:1746129811.544762:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2575 committed 00000004:00080000:1.0:1746129811.544772:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2560 committed 00000004:00080000:1.0:1746129811.544780:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2559 committed 00000004:00080000:1.0:1746129811.544782:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2558 committed 00000004:00080000:1.0:1746129811.544783:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2557 committed 00000004:00080000:1.0:1746129811.544785:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2574 committed 00000004:00080000:1.0:1746129811.544786:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2556 committed 00000004:00080000:1.0:1746129811.544787:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2573 committed 00000004:00080000:1.0:1746129811.544788:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2555 committed 00000004:00080000:1.0:1746129811.544790:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2572 committed 00000004:00080000:1.0:1746129811.544791:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2571 committed 00000004:00080000:1.0:1746129811.544792:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2570 committed 00000004:00080000:1.0:1746129811.544793:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2554 committed 00000004:00080000:1.0:1746129811.544794:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2553 committed 00000004:00080000:1.0:1746129811.544795:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2569 committed 00000004:00080000:1.0:1746129811.544797:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2568 committed 00000004:00080000:1.0:1746129811.544798:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2552 committed 00000100:00100000:1.0:1746129811.544989:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053906304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129811.545041:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129811.545063:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053906816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129811.545077:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129811.545092:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746129811.545097:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053906688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129811.545108:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129811.545115:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053907200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129811.545125:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129811.545144:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053906304 00000100:00100000:1.0:1746129811.545149:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053906304 00000100:00100000:1.0:1746129811.545172:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053906816 00000100:00100000:1.0:1746129811.545173:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053906816 00000100:00100000:1.0:1746129811.545179:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053906688 00000100:00100000:1.0:1746129811.545181:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053906688 00000100:00100000:1.0:1746129811.545187:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053907200 00000100:00100000:1.0:1746129811.545188:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053907200 00000100:00100000:1.0:1746129811.545198:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14703 00000100:00100000:1.0:1746129811.545202:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053906304:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129811.545343:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129811.545346:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:1.0:1746129811.545347:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129809 00002000:00010000:1.0:1746129811.545349:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:1.0:1746129811.545351:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746129811.545372:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949053906304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (332us total) trans 21474841141 rc 0/0 00000100:00100000:1.0:1746129811.545377:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14703 00000100:00100000:1.0:1746129811.545388:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14704 00000100:00100000:1.0:1746129811.545391:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949053906816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.546882:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14710 00000100:00100000:0.0:1746129811.546888:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949053906944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.546913:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053907712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.546935:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.546947:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053908224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.546957:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.546965:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129811.546968:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053907328:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.546978:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.546984:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053907840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.546996:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129811.547758:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949053906816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2365us (2679us total) trans 21474841147 rc 0/0 00000100:00100000:1.0:1746129811.547763:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14704 00000100:00100000:1.0:1746129811.547804:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841133 gen 2 00000004:00080000:1.0:1746129811.547808:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461180, transno 21474841078 00000004:00080000:1.0:1746129811.547813:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801348f4380, transno 21474841079 00000004:00080000:1.0:1746129811.547815:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460a80, transno 21474841080 00000004:00080000:1.0:1746129811.547817:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135d8ca80, transno 21474841081 00000004:00080000:1.0:1746129811.547819:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131462300, transno 21474841082 00000004:00080000:1.0:1746129811.547821:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801348f5f80, transno 21474841083 00000004:00080000:1.0:1746129811.547823:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461c00, transno 21474841084 00000004:00080000:1.0:1746129811.547825:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801348f7b80, transno 21474841085 00000004:00080000:1.0:1746129811.547827:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c7480, transno 21474841086 00000004:00080000:1.0:1746129811.547829:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8791880, transno 21474841090 00000004:00080000:1.0:1746129811.547831:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6eca80, transno 21474841091 00000004:00080000:1.0:1746129811.547832:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8791c00, transno 21474841092 00000004:00080000:1.0:1746129811.547834:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792680, transno 21474841093 00000004:00080000:1.0:1746129811.547836:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790a80, transno 21474841094 00000004:00080000:1.0:1746129811.547838:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6ee680, transno 21474841095 00000004:00080000:1.0:1746129811.547839:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790000, transno 21474841096 00000004:00080000:1.0:1746129811.547842:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790380, transno 21474841097 00000004:00080000:1.0:1746129811.547843:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6ec700, transno 21474841098 00000004:00080000:1.0:1746129811.547859:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645ca80, transno 21474841099 00000004:00080000:1.0:1746129811.547861:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad2680, transno 21474841100 00000004:00080000:1.0:1746129811.547867:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645e300, transno 21474841101 00000004:00080000:1.0:1746129811.547870:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a7b80, transno 21474841102 00000004:00080000:1.0:1746129811.547872:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241880, transno 21474841103 00000004:00080000:1.0:1746129811.547873:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad1880, transno 21474841104 00000004:00080000:1.0:1746129811.547876:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6680, transno 21474841105 00000004:00080000:1.0:1746129811.547877:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a7480, transno 21474841106 00000004:00080000:1.0:1746129811.547879:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241500, transno 21474841107 00000004:00080000:1.0:1746129811.547881:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631a680, transno 21474841116 00000004:00080000:1.0:1746129811.547883:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c043b80, transno 21474841117 00000004:00080000:1.0:1746129811.547884:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040a80, transno 21474841118 00000004:00080000:1.0:1746129811.547886:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5180, transno 21474841119 00000004:00080000:1.0:1746129811.547888:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136318380, transno 21474841120 00000004:00080000:1.0:1746129811.547889:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c043800, transno 21474841121 00000004:00080000:1.0:1746129811.547891:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319880, transno 21474841122 00000004:00080000:1.0:1746129811.547893:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5c00, transno 21474841123 00000004:00080000:1.0:1746129811.547895:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009207f800, transno 21474841124 00000004:00080000:1.0:1746129811.547897:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac380, transno 21474841125 00000004:00080000:1.0:1746129811.547898:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaea00, transno 21474841126 00000004:00080000:1.0:1746129811.547900:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adae300, transno 21474841127 00000004:00080000:1.0:1746129811.547901:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaf480, transno 21474841128 00000004:00080000:1.0:1746129811.547903:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095243480, transno 21474841129 00000004:00080000:1.0:1746129811.547905:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241c00, transno 21474841130 00000004:00080000:1.0:1746129811.547906:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaf800, transno 21474841131 00000004:00080000:1.0:1746129811.547908:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf4000, transno 21474841132 00000004:00080000:1.0:1746129811.547910:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5493480, transno 21474841133 00000100:00100000:1.0:1746129811.547915:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009a04f100 x1830949053906688/t21474841142(21474841142) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129827 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746129811.547923:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f100/2, rc 0, transno 21474841142 00000100:00100000:1.0:1746129811.547927:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053906688:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129811.547937:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8793100/2, rc 0, transno 21474841143 00000100:00100000:1.0:1746129811.547939:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053907200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129811.547946:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd45c00/2, rc 0, transno 21474841141 00000100:00100000:1.0:1746129811.547949:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053906304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129811.547954:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04df80/2, rc 0, transno 21474841147 00000100:00100000:1.0:1746129811.547956:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053906816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.548115:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053906944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1227us (1717us total) trans 21474841148 rc 0/0 00000100:00100000:0.0:1746129811.548120:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14710 00000004:00080000:1.0:1746129811.548180:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 45 done 00000100:00100000:1.0:1746129811.548203:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053908480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129811.548221:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129811.548239:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053908480 00000100:00100000:1.0:1746129811.548243:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053908480 00000100:00100000:1.0:1746129811.548258:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14715 00000100:00100000:1.0:1746129811.548261:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949053908480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.548303:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179873948 gen 2 00000004:00080000:0.0:1746129811.548306:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4f480, transno 17179873896 00000004:00080000:0.0:1746129811.548311:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4e300, transno 17179873897 00000004:00080000:0.0:1746129811.548313:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4ca80, transno 17179873898 00000004:00080000:0.0:1746129811.548315:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4f800, transno 17179873899 00000004:00080000:0.0:1746129811.548317:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4fb80, transno 17179873900 00000004:00080000:0.0:1746129811.548319:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4d500, transno 17179873901 00000004:00080000:0.0:1746129811.548320:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4d880, transno 17179873902 00000004:00080000:0.0:1746129811.548322:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4c000, transno 17179873903 00000004:00080000:0.0:1746129811.548324:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093289c00, transno 17179873907 00000004:00080000:0.0:1746129811.548326:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288a80, transno 17179873908 00000004:00080000:0.0:1746129811.548328:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093289500, transno 17179873909 00000004:00080000:0.0:1746129811.548335:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18380, transno 17179873910 00000004:00080000:0.0:1746129811.548337:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288e00, transno 17179873911 00000004:00080000:0.0:1746129811.548339:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093289880, transno 17179873912 00000004:00080000:0.0:1746129811.548341:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328ad80, transno 17179873913 00000004:00080000:0.0:1746129811.548343:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328a300, transno 17179873914 00000004:00080000:0.0:1746129811.548345:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468d180, transno 17179873915 00000004:00080000:0.0:1746129811.548346:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423f100, transno 17179873916 00000004:00080000:0.0:1746129811.548348:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468e300, transno 17179873917 00000100:00100000:1.0:1746129811.548351:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949053908480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (129us total) trans 21474841149 rc 0/0 00000004:00080000:0.0:1746129811.548351:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423f800, transno 17179873918 00000004:00080000:0.0:1746129811.548353:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e4380, transno 17179873919 00000100:00100000:1.0:1746129811.548355:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14715 00000004:00080000:0.0:1746129811.548355:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423e300, transno 17179873920 00000004:00080000:0.0:1746129811.548357:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423df80, transno 17179873921 00000004:00080000:0.0:1746129811.548358:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d500, transno 17179873922 00000004:00080000:0.0:1746129811.548361:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b025f80, transno 17179873933 00000004:00080000:0.0:1746129811.548363:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024380, transno 17179873934 00000004:00080000:0.0:1746129811.548365:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024700, transno 17179873935 00000004:00080000:0.0:1746129811.548367:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024000, transno 17179873936 00000004:00080000:0.0:1746129811.548369:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b027b80, transno 17179873937 00000004:00080000:0.0:1746129811.548371:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024e00, transno 17179873938 00000004:00080000:1.0:1746129811.548372:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061f480/2, rc 0, transno 21474841149 00000004:00080000:0.0:1746129811.548373:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b027800, transno 17179873939 00000100:00100000:1.0:1746129811.548374:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053908480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129811.548374:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b025500, transno 17179873940 00000004:00080000:0.0:1746129811.548376:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad2a00, transno 17179873941 00000004:00080000:0.0:1746129811.548378:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4e680, transno 17179873942 00000004:00080000:0.0:1746129811.548380:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad3480, transno 17179873943 00000004:00080000:0.0:1746129811.548382:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad500, transno 17179873944 00000004:00080000:0.0:1746129811.548384:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad0a80, transno 17179873945 00000004:00080000:0.0:1746129811.548386:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adadc00, transno 17179873946 00000004:00080000:0.0:1746129811.548388:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad3100, transno 17179873947 00000004:00080000:0.0:1746129811.548390:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adadf80, transno 17179873948 00000100:00100000:0.0:1746129811.548395:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f6a4000 x1830949053907328/t17179873956(17179873956) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129827 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746129811.548401:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a4000/2, rc 0, transno 17179873956 00000100:00100000:0.0:1746129811.548404:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053907328:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129811.548411:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a4380/2, rc 0, transno 17179873957 00000100:00100000:0.0:1746129811.548413:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053907840:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129811.548418:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a7800/2, rc 0, transno 17179873955 00000100:00100000:0.0:1746129811.548420:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053907712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129811.548580:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 40 done 00000100:00100000:0.0:1746129811.549879:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3296:x1830949053908224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2748us (2918us total) trans 17179873958 rc 0/0 00000100:00100000:0.0:1746129811.549884:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14712 00000100:00100000:0.0:1746129811.549896:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053907584 00000100:00100000:0.0:1746129811.549899:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053907584 00000100:00100000:0.0:1746129811.549913:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053908096 00000100:00100000:0.0:1746129811.549915:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053908096 00000100:00100000:0.0:1746129811.549922:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053907456 00000100:00100000:0.0:1746129811.549923:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053907456 00000100:00100000:0.0:1746129811.549932:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14716 00000100:00100000:0.0:1746129811.549936:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949053907584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129811.550752:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129811.550755:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129812 -> 1746129812 00002000:00010000:0.0:1746129811.550757:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129811.550758:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129812 -> 1746129812 00002000:00010000:0.0:1746129811.550760:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:1.0:1746129811.550792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.550794:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053907584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 857us (1080us total) trans 17179873962 rc 0/0 00000100:00100000:0.0:1746129811.550800:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14716 00000004:00080000:0.0:1746129811.550821:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc000/2, rc 0, transno 17179873958 00000100:00100000:0.0:1746129811.550824:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053908224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129811.550833:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053908352:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129811.550860:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551261:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551268:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129811.551280:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129811.551365:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551373:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551378:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551382:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.551384:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551389:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551395:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.551397:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129811.551399:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551403:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e4395324c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551413:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551418:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551422:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551425:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.551427:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551431:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551435:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129811.551436:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.551438:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551441:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e4395323e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551447:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551451:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551455:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551458:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.551460:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551464:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551468:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2e00) 00010000:00010000:0.0:1746129811.551470:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.551472:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551476:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43953245 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.551506:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e43953237 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354db5 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.551514:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e43953237 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354db5 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.551520:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68200, rc 0) 00000100:00100000:0.0:1746129811.551554:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31244:x1830949054055808:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13382us (13677us total) trans 8589944808 rc 301/301 00000100:00100000:0.0:1746129811.551560:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10840 00000100:00100000:0.0:1746129811.552189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.558544:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054056192 00000100:00100000:0.0:1746129811.558553:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054056192 00000100:00100000:0.0:1746129811.558601:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10841 00000100:00100000:0.0:1746129811.558608:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31237:x1830949054056192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129811.558626:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.558641:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354dbc expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.558685:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dbc expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.558697:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dbc expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.558830:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.558833:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129811.558836:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe29600, rc 0) 00000100:00100000:0.0:1746129811.559375:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31237:x1830949054056192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 766us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.559381:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10841 00000100:00100000:0.0:1746129811.564269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.564346:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054056448 00000100:00100000:1.0:1746129811.564354:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054056448 00000100:00100000:1.0:1746129811.564404:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4487 00000100:00100000:1.0:1746129811.564411:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31237:x1830949054056448:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129811.564582:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31237:x1830949054056448:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 171us (320us total) trans 8589944809 rc 0/0 00000100:00100000:1.0:1746129811.564587:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4487 00000100:00100000:0.0:1746129811.567965:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.568008:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.569100:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6520 00000100:00100000:0.0:1746129811.569107:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054056960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129811.571987:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4488 00000100:00100000:1.0:1746129811.571998:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31237:x1830949054057600:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129811.573350:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31237:x1830949054057600:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 1351us (3222us total) trans 8589944810 rc 0/0 00000100:00100000:1.0:1746129811.573359:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4488 00000100:00100000:0.0:1746129811.577514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.577553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.577735:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054057216 00000100:00100000:1.0:1746129811.577744:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054057216 00002000:00100000:1.0:1746129811.577781:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800936dd180 x1830949054057216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.577789:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830949054057216 ext(1048576->2097151) 00002000:00010000:1.0:1746129811.577794:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:1.0:1746129811.577808:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054057728 00000100:00100000:1.0:1746129811.577811:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054057728 00002000:00100000:1.0:1746129811.577820:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800936dc380 x1830949054057728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.577826:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc380 with x1830949054057728 ext(1048576->2097151) 00002000:00010000:1.0:1746129811.577829:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dc380 00000100:00100000:1.0:1746129811.577869:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6521 00000100:00100000:1.0:1746129811.577876:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054057216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.581932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.582366:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054056960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13258us (14355us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129811.582377:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6520 00002000:00100000:0.0:1746129811.582387:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800936dd880 x1830949054056960/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.582397:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830949054056960 ext(1048576->2097151) 00002000:00010000:0.0:1746129811.582403:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd880 00000100:00100000:0.0:1746129811.582432:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054057984 00000100:00100000:0.0:1746129811.582437:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054057984 00000100:00100000:0.0:1746129811.582464:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10842 00000100:00100000:0.0:1746129811.582469:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31247:x1830949054057984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.582485:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.582499:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29400/0x48868a4e43953261 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354dc3 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.582583:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582594:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582602:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582613:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582618:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582622:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582708:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582719:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582725:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129811.582732:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129811.582794:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582801:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582806:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582811:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe29a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.582815:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582820:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582829:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129811.582832:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.582835:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582839:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29a00/0x48868a4e43953268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582880:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582889:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582893:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582897:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fe28800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.582899:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582904:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582910:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b000) 00010000:00010000:0.0:1746129811.582912:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.582913:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582918:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28800/0x48868a4e4395326f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129811.582946:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29400/0x48868a4e43953261 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dc3 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.582955:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dc3 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.582961:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.582963:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129811.582964:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fe28a00, rc 0) 00000100:00100000:0.0:1746129811.582988:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31247:x1830949054057984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 518us (1062us total) trans 8589944811 rc 0/0 00000100:00100000:0.0:1746129811.582994:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10842 00000100:00100000:0.0:1746129811.600470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.600517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.600542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.600554:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.600568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.600575:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054058112 00000100:00100000:1.0:1746129811.600584:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054058112 00000100:00100000:0.0:1746129811.600585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.600601:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054058240 00000100:00100000:0.0:1746129811.600603:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054058240 00000100:00100000:1.0:1746129811.600654:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054058368 00000100:00100000:1.0:1746129811.600656:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054058368 00000100:00100000:0.0:1746129811.602403:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054058496 00000100:00100000:0.0:1746129811.602410:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054058496 00000100:00100000:0.0:1746129811.602427:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054058752 00000100:00100000:0.0:1746129811.602429:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054058752 00000100:00100000:0.0:1746129811.602450:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14721 00000100:00100000:0.0:1746129811.602454:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054058240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.602462:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.602475:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354dd1 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.602493:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.602495:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.602501:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602513:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602522:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6e00, rc 0) 00000100:00100000:0.0:1746129811.602557:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054058240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.602563:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14721 00000100:00100000:1.0:1746129811.602568:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14722 00000100:00100000:1.0:1746129811.602574:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054058368:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129811.602576:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14723 00010000:00010000:1.0:1746129811.602579:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129811.602579:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054058496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.602583:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.602585:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354dd8 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.602589:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7000/0x48868a4e43953299 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ddf expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.602594:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.602595:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.602595:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.602596:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.602599:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 24 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602599:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7000/0x48868a4e43953299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ddf expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602607:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7000/0x48868a4e43953299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ddf expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.602612:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 24 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602613:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7000, rc 0) 00010000:00010000:1.0:1746129811.602618:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68c00, rc 0) 00000100:00100000:0.0:1746129811.602644:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054058496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 63us (2088us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.602651:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14723 00000100:00100000:0.0:1746129811.602658:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14724 00000100:00100000:0.0:1746129811.602662:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949054058624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.602667:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.602673:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354de6 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.602677:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054058368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 104us (2134us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129811.602685:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.602687:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.602690:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354de6 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602698:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354de6 expref: 17 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.602704:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb7400, rc 0) 00000100:00100000:0.0:1746129811.602715:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054058624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (2146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.602719:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14724 00000100:00100000:1.0:1746129811.602787:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14722 00000100:00100000:0.0:1746129811.615944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.624029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.624070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.624103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.624605:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6525 00000100:00100000:0.0:1746129811.624611:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054059520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.655502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.658168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.659067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.659329:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.663637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.663686:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054061056 00000100:00100000:0.0:1746129811.663693:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054061056 00002000:00100000:0.0:1746129811.663726:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009fd46d80 x1830949054061056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.663740:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46d80 with x1830949054061056 ext(3145728->4194303) 00002000:00010000:0.0:1746129811.663744:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd46d80 00000100:00100000:0.0:1746129811.663760:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6530 00000100:00100000:0.0:1746129811.663765:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054061056:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129811.670837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.672166:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.675598:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054061184 00000100:00100000:1.0:1746129811.675609:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054061184 00010000:00010000:1.0:1746129811.675643:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dc3 expref: 283 pid: 14315 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.675673:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054061312 00000100:00100000:1.0:1746129811.675675:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054061312 00010000:00010000:1.0:1746129811.675686:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dbc expref: 9 pid: 14315 timeout: 857 lvb_type: 0 00000100:00100000:1.0:1746129811.675708:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7312 00000100:00100000:1.0:1746129811.675714:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949054061184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.675725:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.675730:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dc3 expref: 283 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.675740:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dc3 expref: 283 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.675757:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe28a00/0x48868a4e43953276 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dc3 expref: 283 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.675774:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.675778:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.675784:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.675788:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.675842:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1964:x1830949054061184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 128us (5013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.675862:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7312 00000100:00100000:1.0:1746129811.675874:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7313 00000100:00100000:1.0:1746129811.675878:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054061312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.675884:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.675887:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dbc expref: 9 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.675894:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dbc expref: 9 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.675903:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fe29600/0x48868a4e4395325a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dbc expref: 9 pid: 14315 timeout: 857 lvb_type: 0 00010000:00010000:1.0:1746129811.675910:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129811.675913:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.675918:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.675923:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129811.677942:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.677991:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054061312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2107us (5823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.677999:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7313 00000100:00100000:1.0:1746129811.680773:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054060800:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20615us (21442us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.680780:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6529 00002000:00100000:1.0:1746129811.680786:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88013061f100 x1830949054060800/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.680793:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061f100 with x1830949054060800 ext(2097152->3145727) 00002000:00010000:1.0:1746129811.680797:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013061f100 00000100:00100000:0.0:1746129811.681148:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.681165:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054061440 00000100:00100000:0.0:1746129811.681171:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054061440 00000100:00100000:0.0:1746129811.681195:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10844 00000100:00100000:0.0:1746129811.681200:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31247:x1830949054061440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.681214:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.681228:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354dfb expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.681263:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.681269:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.681281:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129811.681309:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.681324:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.681326:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129811.681329:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.681334:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68400, rc 0) 00000100:00100000:0.0:1746129811.681359:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31247:x1830949054061440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 159us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.681364:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10844 00000100:00100000:1.0:1746129811.681763:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054060288:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 23444us (23599us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.681769:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6527 00002000:00100000:1.0:1746129811.681775:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009fd44380 x1830949054060288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.681781:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd44380 with x1830949054060288 ext(2097152->3145727) 00002000:00010000:1.0:1746129811.681784:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd44380 00000100:00100000:1.0:1746129811.688513:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054061056:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24733us (24868us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.688523:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6530 00002000:00100000:1.0:1746129811.688534:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009fd46d80 x1830949054061056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.688543:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46d80 with x1830949054061056 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.688548:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd46d80 00000100:00100000:1.0:1746129811.688676:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.688739:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054061696 00000100:00100000:0.0:1746129811.688746:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054061696 00000100:00100000:0.0:1746129811.688772:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10845 00000100:00100000:0.0:1746129811.688777:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31251:x1830949054061696:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129811.688796:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.688812:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439532c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354e02 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.688897:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.688907:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.688915:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.688925:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.688933:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.688937:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689011:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689017:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689022:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129811.689029:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129811.689114:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689120:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689125:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689129:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.689132:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689136:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689145:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.689155:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746129811.689158:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689163:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439532d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689174:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689178:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689182:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689186:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.689187:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689191:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689195:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129811.689197:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.689199:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689202:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439532ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689207:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689210:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689215:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689218:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129811.689219:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689223:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689227:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99bf00) 00010000:00010000:0.0:1746129811.689228:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129811.689230:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689233:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68200/0x48868a4e439532d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.689256:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439532c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e02 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.689262:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439532c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e02 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.689267:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68e00, rc 0) 00000100:00100000:0.0:1746129811.689306:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31251:x1830949054061696:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 528us (630us total) trans 8589944813 rc 301/301 00000100:00100000:0.0:1746129811.689311:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10845 00000100:00100000:0.0:1746129811.690865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.690883:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054061824 00000100:00100000:0.0:1746129811.690888:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054061824 00000100:00100000:0.0:1746129811.690913:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10846 00000100:00100000:0.0:1746129811.690919:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31242:x1830949054061824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129811.690931:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.690940:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439532e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354e09 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.690975:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439532e6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e09 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.690984:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439532e6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e09 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.690993:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.690995:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129811.690998:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.691003:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130676c00, rc 0) 00000100:00100000:0.0:1746129811.691025:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31242:x1830949054061824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.691030:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10846 00000001:00080000:0.0:1746129811.708268:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944811 is committed 00000001:00080000:0.0:1746129811.708279:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944808 is committed 00000001:00080000:0.0:1746129811.708286:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944810 is committed 00000001:00080000:0.0:1746129811.708301:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944812 is committed 00000004:00080000:0.0:1746129811.708304:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2583 committed 00000004:00080000:0.0:1746129811.708310:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2569 committed 00000004:00080000:0.0:1746129811.708315:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2568 committed 00000004:00080000:0.0:1746129811.708316:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2567 committed 00000004:00080000:0.0:1746129811.708318:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2566 committed 00000004:00080000:0.0:1746129811.708319:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2582 committed 00000004:00080000:0.0:1746129811.708321:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2565 committed 00000004:00080000:0.0:1746129811.708322:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2581 committed 00000004:00080000:0.0:1746129811.708323:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2564 committed 00000004:00080000:0.0:1746129811.708324:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2580 committed 00000004:00080000:0.0:1746129811.708325:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2579 committed 00000004:00080000:0.0:1746129811.708326:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2578 committed 00000004:00080000:0.0:1746129811.708328:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2563 committed 00000004:00080000:0.0:1746129811.708330:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2562 committed 00000004:00080000:0.0:1746129811.708331:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2577 committed 00000004:00080000:0.0:1746129811.708332:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746129811.708334:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2561 committed 00000100:00100000:0.0:1746129811.708502:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053908992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708555:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708589:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053909504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708602:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708612:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708625:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708634:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708644:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708657:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129811.708662:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053909120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708673:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708684:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053909632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708695:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708705:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708716:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708726:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708737:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708752:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053909248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708767:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708776:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053909760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708797:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053910272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708807:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708816:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053910784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708837:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129811.708841:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053909376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708873:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708886:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053909888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.708898:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708905:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053910400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708916:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708922:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053910912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.708933:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129811.708952:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053908992 00000100:00100000:0.0:1746129811.708958:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053908992 00000100:00100000:0.0:1746129811.708982:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909504 00000100:00100000:0.0:1746129811.708984:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909504 00000100:00100000:0.0:1746129811.708991:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910016 00000100:00100000:0.0:1746129811.708992:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910016 00000100:00100000:0.0:1746129811.708999:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910528 00000100:00100000:0.0:1746129811.709000:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910528 00000100:00100000:0.0:1746129811.709006:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909120 00000100:00100000:0.0:1746129811.709007:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909120 00000100:00100000:0.0:1746129811.709013:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909632 00000100:00100000:0.0:1746129811.709014:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909632 00000100:00100000:0.0:1746129811.709019:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910144 00000100:00100000:0.0:1746129811.709020:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910144 00000100:00100000:0.0:1746129811.709025:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910656 00000100:00100000:0.0:1746129811.709027:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910656 00000100:00100000:0.0:1746129811.709032:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909248 00000100:00100000:0.0:1746129811.709033:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909248 00000100:00100000:0.0:1746129811.709038:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909760 00000100:00100000:0.0:1746129811.709040:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909760 00000100:00100000:0.0:1746129811.709045:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910272 00000100:00100000:0.0:1746129811.709046:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910272 00000100:00100000:0.0:1746129811.709052:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910784 00000100:00100000:0.0:1746129811.709054:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910784 00000100:00100000:0.0:1746129811.709058:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909376 00000100:00100000:0.0:1746129811.709060:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909376 00000100:00100000:0.0:1746129811.709065:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053909888 00000100:00100000:0.0:1746129811.709066:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053909888 00000100:00100000:0.0:1746129811.709071:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910400 00000100:00100000:0.0:1746129811.709072:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910400 00000100:00100000:0.0:1746129811.709077:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053910912 00000100:00100000:0.0:1746129811.709078:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053910912 00000100:00100000:0.0:1746129811.709087:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14726 00000100:00100000:0.0:1746129811.709093:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053908992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129811.709237:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129811.709240:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129811.709242:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129811.709244:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129811.709245:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129811.709272:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053908992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (717us total) trans 17179873963 rc 0/0 00000100:00100000:0.0:1746129811.709278:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14726 00000100:00100000:0.0:1746129811.709303:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14727 00000100:00100000:0.0:1746129811.709308:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053909504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.709380:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053909504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (776us total) trans 17179873964 rc 0/0 00000100:00100000:0.0:1746129811.709385:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14727 00000100:00100000:0.0:1746129811.709394:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14728 00000100:00100000:0.0:1746129811.709398:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053910016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129811.709482:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129811.709485:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129811.709487:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129809 00002000:00010000:0.0:1746129811.709488:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129811.709490:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746129811.709507:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053910016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (881us total) trans 21474841150 rc 0/0 00000100:00100000:0.0:1746129811.709511:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14728 00000100:00100000:0.0:1746129811.709521:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14729 00000100:00100000:0.0:1746129811.709525:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053910528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129811.709596:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053910528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (950us total) trans 21474841151 rc 0/0 00000100:00100000:0.0:1746129811.709601:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14729 00000100:00100000:0.0:1746129811.709611:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14730 00000100:00100000:0.0:1746129811.709614:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949053909120:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129811.712225:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d635c00/2, rc 0, transno 17179873965 00000100:00100000:1.0:1746129811.712229:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053909632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129811.712236:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4e300/2, rc 0, transno 21474841152 00000100:00100000:1.0:1746129811.712238:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910144:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129811.712244:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4d500/2, rc 0, transno 21474841153 00000100:00100000:1.0:1746129811.712246:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910656:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129811.712252:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a6300/2, rc 0, transno 17179873963 00000100:00100000:1.0:1746129811.712254:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053908992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129811.712260:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d637100/2, rc 0, transno 17179873964 00000100:00100000:1.0:1746129811.712263:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053909504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129811.712269:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4f480/2, rc 0, transno 21474841150 00000100:00100000:1.0:1746129811.712271:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129811.712277:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4fb80/2, rc 0, transno 21474841151 00000100:00100000:1.0:1746129811.712278:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053910528:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129811.712500:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129811.712503:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129812 -> 1746129812 00002000:00010000:0.0:1746129811.712505:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129808 -> 1746129808 00002000:00010000:0.0:1746129811.712507:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129812 -> 1746129812 00002000:00010000:0.0:1746129811.712508:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129811.714480:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053909120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4858us (5799us total) trans 17179873970 rc 0/0 00000100:00100000:0.0:1746129811.714490:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14730 00000100:00100000:0.0:1746129811.714570:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.714592:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:1.0:1746129811.715921:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6a4e00/2, rc 0, transno 17179873970 00000100:00100000:1.0:1746129811.715927:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053909120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129811.716985:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.725504:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054062464 00000100:00100000:1.0:1746129811.725512:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054062464 00002000:00100000:1.0:1746129811.725550:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094eb5c00 x1830949054062464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.725558:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5c00 with x1830949054062464 ext(1048576->2097151) 00002000:00010000:1.0:1746129811.725563:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5c00 00000100:00100000:1.0:1746129811.726581:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6531 00000100:00100000:1.0:1746129811.726591:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054062464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.728923:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.730760:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.733398:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.733563:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.733578:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.733603:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.743349:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054062464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16752us (17916us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129811.743361:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6531 00002000:00100000:0.0:1746129811.743370:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094eb5c00 x1830949054062464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.743378:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5c00 with x1830949054062464 ext(1048576->2097151) 00002000:00010000:0.0:1746129811.743384:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5c00 00000100:00100000:0.0:1746129811.747344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.757942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.758033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.758525:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054063872 00000100:00100000:1.0:1746129811.758529:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054063872 00002000:00100000:1.0:1746129811.758557:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009476ad80 x1830949054063872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.758566:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949054063872 ext(1048576->2097151) 00002000:00010000:1.0:1746129811.758570:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:1.0:1746129811.758584:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6532 00000100:00100000:1.0:1746129811.758589:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054063872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.763133:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064000 00000100:00100000:0.0:1746129811.763142:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064000 00000100:00100000:0.0:1746129811.763192:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14749 00000100:00100000:0.0:1746129811.763200:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31244:x1830949054064000:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129811.763214:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129811.763228:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354e48 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.763254:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.763261:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 7 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.763268:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.763275:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.763276:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.763279:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1466368->2052095] (req 1466368->2052095) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.763314:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 23 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.763326:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 23 pid: 3624 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.763337:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094769c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053911552:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.763812:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 7 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.763821:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 7 pid: 4589 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.763829:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009476a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053911680:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.764373:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129811.764382:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.764390:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094769880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053911808:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129811.764410:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.766167:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054063872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7575us (8133us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.766176:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6532 00002000:00100000:1.0:1746129811.766185:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009476ad80 x1830949054063872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.766194:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949054063872 ext(1048576->2097151) 00002000:00010000:1.0:1746129811.766198:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:0.0:1746129811.767544:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.767617:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064128 00000100:00100000:1.0:1746129811.767622:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064128 00010000:00010000:1.0:1746129811.767648:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 24 pid: 3624 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746129811.767681:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7315 00000100:00100000:1.0:1746129811.767687:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054064128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.767697:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.767714:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 24 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.767723:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 24 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.767741:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6e00/0x48868a4e43953284 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd1 expref: 24 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.767753:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.767775:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054064128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.767780:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7315 00000100:00100000:0.0:1746129811.768130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.768158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.768191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.768365:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064256 00000100:00100000:1.0:1746129811.768369:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064256 00010000:00010000:1.0:1746129811.768383:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746129811.768396:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064384 00000100:00100000:1.0:1746129811.768397:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064384 00010000:00010000:1.0:1746129811.768405:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 8 pid: 4589 timeout: 857 lvb_type: 1 00000100:00100000:1.0:1746129811.768418:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7316 00000100:00100000:1.0:1746129811.768422:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054064256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.768428:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.768435:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.768443:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.768454:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43953206 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d8b expref: 15 pid: 10930 timeout: 857 lvb_type: 1 00010000:00010000:1.0:1746129811.768463:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.768485:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054064256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.768490:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7316 00000100:00100000:0.0:1746129811.768500:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7317 00000100:00100000:0.0:1746129811.768506:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054064384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.768513:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.768521:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 8 pid: 4589 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.768533:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 8 pid: 4589 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.768543:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6600/0x48868a4e43953310 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e1e expref: 8 pid: 4589 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.768554:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.768556:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129811.768561:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.768568:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2052095) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.768590:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 14 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129811.768599:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094769f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053911936:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129811.768637:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.769393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.769439:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064768 00000100:00100000:1.0:1746129811.769443:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064768 00002000:00100000:1.0:1746129811.769460:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094768380 x1830949054064768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.769473:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949054064768 ext(2097152->3145727) 00002000:00010000:1.0:1746129811.769477:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768380 00000100:00100000:1.0:1746129811.769500:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6533 00000100:00100000:1.0:1746129811.769506:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054064768:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129811.771135:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.771201:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094769f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053911936:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129811.771215:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.771237:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054064384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2731us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.771247:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7317 00000100:00100000:1.0:1746129811.771492:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065024 00000100:00100000:1.0:1746129811.771497:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065024 00002000:00100000:1.0:1746129811.771521:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880092ad9f80 x1830949054065024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.771528:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9f80 with x1830949054065024 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.771532:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9f80 00000100:00100000:1.0:1746129811.771543:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065280 00000100:00100000:1.0:1746129811.771546:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065280 00002000:00100000:1.0:1746129811.771556:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094769500 x1830949054065280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.771562:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949054065280 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.771564:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:1.0:1746129811.771574:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6534 00000100:00100000:1.0:1746129811.771579:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054065024:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129811.784065:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.789301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.789337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.789613:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054064768:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 20106us (20223us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.789621:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6533 00002000:00100000:1.0:1746129811.789630:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094768380 x1830949054064768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.789638:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949054064768 ext(2097152->3145727) 00000100:00100000:0.0:1746129811.790372:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065792 00000100:00100000:0.0:1746129811.790376:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065792 00010000:00010000:0.0:1746129811.790398:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fee00/0x48868a4e4395333a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e41 expref: 10 pid: 15044 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746129811.790431:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7318 00000100:00100000:0.0:1746129811.790436:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054065792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.790446:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.790451:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fee00/0x48868a4e4395333a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e41 expref: 10 pid: 15044 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746129811.790460:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fee00/0x48868a4e4395333a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e41 expref: 10 pid: 15044 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746129811.790476:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fee00/0x48868a4e4395333a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e41 expref: 10 pid: 15044 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746129811.790495:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129811.790499:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffc00/0x48868a4e43953356 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.790506:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffc00/0x48868a4e43953356 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.790511:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffc00/0x48868a4e43953356 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129811.790531:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.790546:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054065792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.790551:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7318 00002000:00010000:1.0:1746129811.791238:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768380 00000100:00100000:1.0:1746129811.798295:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054065024:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 26699us (27329us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.799249:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6534 00002000:00100000:1.0:1746129811.799258:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880092ad9f80 x1830949054065024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.799266:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9f80 with x1830949054065024 ext(3145728->4194303) 00002000:00010000:1.0:1746129811.799270:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9f80 00000100:00100000:0.0:1746129811.807328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.810605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.811011:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6537 00000100:00100000:1.0:1746129811.811020:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054066176:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129811.811155:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054066176:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 136us (555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129811.811161:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6537 00002000:00100000:1.0:1746129811.811167:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f2:0x0] (2048000->2052095) req@ffff88009476b100 x1830949054066176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.811174:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b100 with x1830949054066176 ext(2048000->2052095) 00002000:00010000:1.0:1746129811.811177:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476b100 00000100:00100000:0.0:1746129811.811369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.811382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.811406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.811418:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066432 00000100:00100000:0.0:1746129811.811421:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066432 00002000:00100000:0.0:1746129811.811436:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094769880 x1830949054066432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.811443:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949054066432 ext(2097152->3145727) 00002000:00010000:0.0:1746129811.811447:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:0.0:1746129811.811460:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066560 00000100:00100000:0.0:1746129811.811462:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066560 00002000:00100000:0.0:1746129811.811470:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009476a300 x1830949054066560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.811476:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949054066560 ext(3145728->4194303) 00002000:00010000:0.0:1746129811.811478:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476a300 00000100:00100000:0.0:1746129811.811484:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066944 00000100:00100000:0.0:1746129811.811486:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066944 00002000:00100000:0.0:1746129811.811494:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094769c00 x1830949054066944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.811500:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949054066944 ext(2097152->3145727) 00002000:00010000:0.0:1746129811.811503:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:0.0:1746129811.811512:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6538 00000100:00100000:0.0:1746129811.811517:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054066432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129811.812375:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6540 00000100:00100000:1.0:1746129811.812383:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054066944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.815962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.817189:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067456 00000100:00100000:1.0:1746129811.817194:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067456 00000100:00100000:1.0:1746129811.817215:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4491 00000100:00100000:1.0:1746129811.817220:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31244:x1830949054067456:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129811.817355:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31244:x1830949054067456:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 134us (2269us total) trans 8589944815 rc 0/0 00000100:00100000:1.0:1746129811.817361:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4491 00000100:00100000:0.0:1746129811.819457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.819542:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067968 00000100:00100000:1.0:1746129811.819549:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067968 00002000:00100000:1.0:1746129811.819581:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009adadc00 x1830949054067968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.819590:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadc00 with x1830949054067968 ext(4194304->4931583) 00002000:00010000:1.0:1746129811.819595:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadc00 00000100:00100000:1.0:1746129811.820266:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6542 00000100:00100000:1.0:1746129811.820275:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054067968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129811.838595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.852966:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054066944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 40576us (41550us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129811.852975:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6540 00002000:00100000:1.0:1746129811.852983:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094769c00 x1830949054066944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.852991:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949054066944 ext(2097152->3145727) 00002000:00010000:1.0:1746129811.852996:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:0.0:1746129811.853057:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054067968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 32783us (33606us total) trans 0 rc 737280/737280 00000100:00100000:0.0:1746129811.853063:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6542 00002000:00100000:0.0:1746129811.853068:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009adadc00 x1830949054067968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:552/0 lens 488/440 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129811.853075:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadc00 with x1830949054067968 ext(4194304->4931583) 00002000:00010000:0.0:1746129811.853077:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadc00 00000100:00100000:0.0:1746129811.861944:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.862032:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054068480 00000100:00100000:1.0:1746129811.862039:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054068480 00000100:00100000:1.0:1746129811.862091:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4493 00000100:00100000:1.0:1746129811.862098:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31242:x1830949054068480:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129811.863335:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31242:x1830949054068480:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1233us (1394us total) trans 8589944817 rc 0/0 00000100:00100000:1.0:1746129811.863343:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4493 00000100:00100000:0.0:1746129811.864132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.874274:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.893326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.906392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.921080:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.921328:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069376 00000100:00100000:1.0:1746129811.921336:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069376 00000100:00100000:1.0:1746129811.921397:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4494 00000100:00100000:1.0:1746129811.921405:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31247:x1830949054069376:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129811.922658:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31247:x1830949054069376:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1251us (1583us total) trans 8589944818 rc 0/0 00000100:00100000:1.0:1746129811.922666:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4494 00000100:00100000:0.0:1746129811.925543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.937316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.937347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.937366:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069632 00000100:00100000:0.0:1746129811.937373:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069632 00010000:00010000:0.0:1746129811.937402:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354de6 expref: 19 pid: 3624 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.937441:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069760 00000100:00100000:0.0:1746129811.937443:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069760 00010000:00010000:0.0:1746129811.937451:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924f4400/0x48868a4e43953325 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e33 expref: 8 pid: 8435 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746129811.937464:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7319 00000100:00100000:0.0:1746129811.937470:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054069632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.937480:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.937495:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354de6 expref: 19 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.937504:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354de6 expref: 19 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.937690:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7400/0x48868a4e439532a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354de6 expref: 19 pid: 3624 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746129811.937707:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.938190:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054069632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 719us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.938196:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7319 00000100:00100000:1.0:1746129811.938307:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.943786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.950349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.952000:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14756 00000100:00100000:1.0:1746129811.952268:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31251:x1830949054070272:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129811.952296:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129811.952312:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354e87 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.952338:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.952346:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f4000/0x48868a4e4395332c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e3a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.952353:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e2aa200/0x48868a4e439532a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ded expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.952359:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.952361:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.952365:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4116479] (req 3145728->4116479) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.952390:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e2aa200/0x48868a4e439532a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ded expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.952400:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e2aa200/0x48868a4e439532a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ded expref: 24 pid: 8436 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129811.952410:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053913344:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129811.952495:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f4000/0x48868a4e4395332c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e3a expref: 6 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.952503:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924f4000/0x48868a4e4395332c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e3a expref: 6 pid: 8435 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129811.952509:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053913472:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129811.952530:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129811.952537:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 13 pid: 7975 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129811.952549:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053913600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129811.954360:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129811.955646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129811.963975:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053913600:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129811.964010:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4116479] (req 3145728->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129811.964026:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8f800, rc 0) 00000100:00100000:0.0:1746129811.964070:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31251:x1830949054070272:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12061us (13731us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.964077:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14756 00000100:00100000:0.0:1746129811.966177:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070912 00000100:00100000:0.0:1746129811.966181:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070912 00010000:00010000:0.0:1746129811.966195:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e2aa200/0x48868a4e439532a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ded expref: 24 pid: 8436 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129811.966208:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7322 00000100:00100000:0.0:1746129811.966218:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7323 00000100:00100000:0.0:1746129811.966223:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054070656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129811.966233:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129811.966252:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924f4000/0x48868a4e4395332c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e3a expref: 7 pid: 8435 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746129811.966261:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924f4000/0x48868a4e4395332c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e3a expref: 7 pid: 8435 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746129811.966280:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f4000/0x48868a4e4395332c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e3a expref: 7 pid: 8435 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746129811.966307:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129811.966336:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054070656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129811.966341:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7323 00000100:00100000:1.0:1746129811.966555:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054070784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129811.966562:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129811.966570:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 14 pid: 7975 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129811.966578:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 14 pid: 7975 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129811.966587:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092610200/0x48868a4e43953214 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354da7 expref: 14 pid: 7975 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129811.966598:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.966600:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129811.966605:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.966611:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129811.966633:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129811.966645:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8791880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053913728:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129811.966702:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129811.968214:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8791880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053913728:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129811.968229:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129811.968251:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054070784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2036us (4289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129811.968259:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7322 00000100:00100000:0.0:1746129811.980192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.981133:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054071168 00000100:00100000:1.0:1746129811.981144:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054071168 00002000:00100000:1.0:1746129811.981188:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (4112384->4116479) req@ffff88009adae680 x1830949054071168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/0 e 0 to 0 dl 1746129822 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.981196:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae680 with x1830949054071168 ext(4112384->4116479) 00002000:00010000:1.0:1746129811.981201:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adae680 00000100:00100000:1.0:1746129811.981344:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6545 00000100:00100000:1.0:1746129811.981353:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054071168:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129811.981726:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054071168:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 373us (1542us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129811.981732:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6545 00002000:00100000:1.0:1746129811.981738:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (4112384->4116479) req@ffff88009adae680 x1830949054071168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:552/0 lens 488/4536 e 0 to 0 dl 1746129822 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129811.981744:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae680 with x1830949054071168 ext(4112384->4116479) 00002000:00010000:1.0:1746129811.981747:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adae680 00000100:00100000:0.0:1746129811.986283:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129811.987281:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054071424 00000100:00100000:1.0:1746129811.987302:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054071424 00000100:00100000:1.0:1746129811.987422:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4495 00000100:00100000:1.0:1746129811.987430:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31251:x1830949054071424:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129811.988237:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31251:x1830949054071424:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 805us (1958us total) trans 8589944820 rc 0/0 00000100:00100000:1.0:1746129811.988244:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4495 00000100:00100000:0.0:1746129812.009509:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129812.010341:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129812.014320:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.015218:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.015302:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.015931:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7327 00000100:00100000:0.0:1746129812.015937:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054071936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.015943:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1746129812.016250:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746129812.016562:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7000/0x48868a4e43953299 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ddf expref: 17 pid: 3624 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746129812.016572:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7000/0x48868a4e43953299 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ddf expref: 17 pid: 3624 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746129812.016587:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb7000/0x48868a4e43953299 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ddf expref: 17 pid: 3624 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746129812.016600:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.016602:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.016607:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.016617:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.018639:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129812.018654:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053914240:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129812.020057:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129812.027484:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054072192 00000100:00100000:1.0:1746129812.027491:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054072192 00002000:00100000:1.0:1746129812.027523:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1392640->1396735) req@ffff880092ad9880 x1830949054072192/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.027532:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949054072192 ext(1392640->1396735) 00002000:00010000:1.0:1746129812.027536:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9880 00000100:00100000:1.0:1746129812.027551:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6546 00000100:00100000:1.0:1746129812.027557:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054072192:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129812.027692:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054072192:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 135us (1223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129812.027698:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6546 00002000:00100000:1.0:1746129812.027703:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1392640->1396735) req@ffff880092ad9880 x1830949054072192/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.027708:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949054072192 ext(1392640->1396735) 00002000:00010000:1.0:1746129812.027710:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9880 00000100:00100000:0.0:1746129812.027796:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053914240:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129812.027814:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129812.027873:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949054071936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11935us (12570us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.027880:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7327 00000100:00100000:0.0:1746129812.036462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.040992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.041023:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054072704 00000100:00100000:1.0:1746129812.041030:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054072704 00000100:00100000:1.0:1746129812.041077:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4496 00000100:00100000:1.0:1746129812.041084:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31258:x1830949054072704:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129812.041266:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31258:x1830949054072704:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 182us (281us total) trans 8589944821 rc 0/0 00000100:00100000:1.0:1746129812.041272:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4496 00000100:00100000:0.0:1746129812.066634:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129812.067776:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129812.071476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.071520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.072055:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14759 00000100:00100000:0.0:1746129812.072061:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054073088:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129812.072068:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129812.072077:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094bafe00/0x48868a4e439533f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ea3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129812.072100:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053914496:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129812.072120:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00000100:00080000:1.0:1746129812.072313:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129812.076522:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053914496:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129812.076554:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094bafe00/0x48868a4e439533f0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ea3 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.076567:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094bafe00/0x48868a4e439533f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ea3 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.076594:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094bafe00, rc 0) 00000100:00100000:1.0:1746129812.076643:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054073088:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4581us (5121us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129812.076651:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14759 00000100:00100000:0.0:1746129812.085301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.097727:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.106827:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.106901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.107083:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14761 00000100:00100000:1.0:1746129812.107091:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054073984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.107099:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.107107:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f600/0x48868a4e43953413 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ebf expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129812.107140:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053914624:192.168.204.31@tcp:106: 00000100:00080000:0.0:1746129812.107188:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129812.107278:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00002000:00010000:1.0:1746129812.113748:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129811 -> 1746129812 00000100:00100000:1.0:1746129812.113774:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053914624:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129812.113808:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f600/0x48868a4e43953413 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ebf expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.113821:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f600/0x48868a4e43953413 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ebf expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.113844:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8f600, rc 0) 00000100:00100000:1.0:1746129812.113952:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054073984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6860us (7049us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129812.113959:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14761 00000100:00100000:0.0:1746129812.114052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.114109:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054074112 00000100:00100000:1.0:1746129812.114114:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054074112 00000100:00100000:1.0:1746129812.114152:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14762 00000100:00100000:1.0:1746129812.114158:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31263:x1830949054074112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.114168:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.114178:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f400/0x48868a4e4395341a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ec6 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.114197:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2052095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.114204:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.114206:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.114209:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f400/0x48868a4e4395341a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ec6 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.114231:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2052095) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 12 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.114240:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094baf600/0x48868a4e43953348 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1466368->2052095) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e48 expref: 12 pid: 4589 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.114250:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053914880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.114300:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.120804:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.121570:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053914880:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.121597:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f400/0x48868a4e4395341a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ec6 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.121610:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8f400, rc 0) 00000100:00100000:1.0:1746129812.121656:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31263:x1830949054074112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7497us (7604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.121663:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14762 00000100:00100000:0.0:1746129812.124501:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.124567:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054074496 00000100:00100000:1.0:1746129812.124573:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054074496 00002000:00100000:1.0:1746129812.124606:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800934d4380 x1830949054074496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.124615:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4380 with x1830949054074496 ext(0->1048575) 00002000:00010000:1.0:1746129812.124619:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4380 00000100:00100000:1.0:1746129812.124636:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6549 00000100:00100000:1.0:1746129812.124643:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054074496:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.138989:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054074496:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14339us (14488us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.138998:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6549 00002000:00100000:1.0:1746129812.139007:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800934d4380 x1830949054074496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.139015:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4380 with x1830949054074496 ext(0->1048575) 00002000:00010000:1.0:1746129812.139020:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4380 00000100:00100000:0.0:1746129812.139642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.144885:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054074752 00000100:00100000:1.0:1746129812.144893:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054074752 00000100:00100000:1.0:1746129812.144929:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14763 00000100:00100000:1.0:1746129812.144936:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31266:x1830949054074752:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.144949:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.144963:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fc00/0x48868a4e43953421 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ecd expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.144982:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.146037:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.146046:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fc00/0x48868a4e43953421 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ecd expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.146060:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fc00/0x48868a4e43953421 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ecd expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.146069:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8fc00, rc 0) 00000100:00100000:1.0:1746129812.146189:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31266:x1830949054074752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1253us (1462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.146194:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14763 00000100:00100000:0.0:1746129812.151361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.151566:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054075008 00000100:00100000:1.0:1746129812.151574:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054075008 00002000:00100000:1.0:1746129812.151611:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800934d4000 x1830949054075008/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.151620:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4000 with x1830949054075008 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.151624:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4000 00000100:00100000:1.0:1746129812.152637:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6550 00000100:00100000:1.0:1746129812.152645:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054075008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.154309:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.155334:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.159165:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.159220:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054075520 00000100:00100000:1.0:1746129812.159225:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054075520 00002000:00100000:1.0:1746129812.159252:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a55a7480 x1830949054075520/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.159259:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7480 with x1830949054075520 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.159264:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a7480 00000100:00100000:1.0:1746129812.159293:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054075776 00000100:00100000:1.0:1746129812.159296:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054075776 00002000:00100000:1.0:1746129812.159307:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a55a4700 x1830949054075776/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 504/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.159313:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a4700 with x1830949054075776 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.159316:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a4700 00000100:00100000:1.0:1746129812.159326:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6552 00000100:00100000:1.0:1746129812.159332:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054075520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.172126:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054075008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19480us (20769us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.172134:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6550 00002000:00100000:1.0:1746129812.172140:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800934d4000 x1830949054075008/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.172147:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4000 with x1830949054075008 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.172150:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4000 00000100:00100000:1.0:1746129812.180640:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054075520:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21299us (25299us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.180650:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6552 00002000:00100000:1.0:1746129812.180661:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a55a7480 x1830949054075520/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.180669:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7480 with x1830949054075520 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.180674:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a7480 00010000:00010000:1.0:1746129812.186702:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129812.188517:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054075904 00000100:00100000:0.0:1746129812.188528:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054075904 00000100:00100000:1.0:1746129812.192615:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14764 00000100:00100000:1.0:1746129812.192631:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31263:x1830949054075904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.192647:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.192661:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ed4 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.192687:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.192693:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.192695:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.192699:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 17 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.192722:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.192732:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 9 pid: 8437 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.192743:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053915136:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.192833:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.197402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.197465:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.197540:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053915136:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.197563:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 17 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.197578:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc8e600, rc 0) 00000100:00100000:1.0:1746129812.197610:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31263:x1830949054075904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4986us (9379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.197618:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14764 00000100:00100000:1.0:1746129812.197645:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054076288 00000100:00100000:1.0:1746129812.197650:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054076288 00002000:00100000:1.0:1746129812.197679:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1392640->1912831) req@ffff8800a55a4e00 x1830949054076288/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.197687:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a4e00 with x1830949054076288 ext(1392640->1912831) 00010000:00010000:1.0:1746129812.197692:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 10 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.197705:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 10 pid: 8437 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.197710:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a4e00 00000100:00100000:1.0:1746129812.197720:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1775 00000100:00100000:1.0:1746129812.197724:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054076288:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129812.207522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.207542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.207558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.207585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.207598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.207623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.207647:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054076416 00000100:00100000:0.0:1746129812.207654:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054076416 00010000:00010000:0.0:1746129812.207685:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e439533db lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e9c expref: 287 pid: 15044 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.207708:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054076544 00000100:00100000:0.0:1746129812.207710:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054076544 00010000:00010000:0.0:1746129812.207718:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20a00/0x48868a4e439533b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e8e expref: 17 pid: 14314 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.207727:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077056 00000100:00100000:0.0:1746129812.207729:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077056 00010000:00010000:0.0:1746129812.207745:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffc00/0x48868a4e43953356 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e4f expref: 9 pid: 15044 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.207758:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7329 00000100:00100000:0.0:1746129812.207764:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1961:x1830949054076416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.207774:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129812.207779:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e439533db lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e9c expref: 287 pid: 15044 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.207787:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e439533db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e9c expref: 287 pid: 15044 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.207808:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129812.207811:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.207817:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.207823:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129812.207888:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1961:x1830949054076416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 124us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.207894:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7329 00000100:00100000:0.0:1746129812.207932:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7330 00000100:00100000:0.0:1746129812.207936:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054076544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.207941:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129812.207945:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20a00/0x48868a4e439533b1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e8e expref: 17 pid: 14314 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.207955:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20a00/0x48868a4e439533b1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e8e expref: 17 pid: 14314 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.207964:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129812.207967:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.207971:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.207975:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129812.207988:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054076544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.207993:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7330 00000100:00100000:0.0:1746129812.208002:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7331 00000100:00100000:0.0:1746129812.208006:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054077056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.208011:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129812.208013:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffc00/0x48868a4e43953356 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e4f expref: 9 pid: 15044 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.208021:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffc00/0x48868a4e43953356 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e4f expref: 9 pid: 15044 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.208030:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129812.208032:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.208038:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.208045:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e43953436 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.208060:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129812.208072:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054077056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.208078:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7331 00000100:00080000:0.0:1746129812.208094:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129812.217541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.217571:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077184 00000100:00100000:0.0:1746129812.217580:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077184 00000100:00100000:0.0:1746129812.217624:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14768 00000100:00100000:0.0:1746129812.217631:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31268:x1830949054077184:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129812.217648:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129812.217665:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ef7 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.217692:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.217700:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 5 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.217706:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 23 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.217712:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.217715:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.217718:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1355776->1482751] (req 1355776->1482751) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ef7 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.217747:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 23 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.217757:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 23 pid: 1877 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746129812.217768:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053916032:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129812.217865:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 5 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.217873:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 5 pid: 8435 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746129812.217882:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053916160:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129812.217916:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.217924:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 18 pid: 4589 timeout: 858 lvb_type: 1 00000100:00100000:0.0:1746129812.217932:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053916288:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129812.217949:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129812.219895:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054076288:12345-192.168.204.31@tcp:4:cat.0 Request processed in 22163us (22422us total) trans 21474841159 rc 0/0 00000100:00100000:1.0:1746129812.219905:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1775 00002000:00100000:1.0:1746129812.219913:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ef:0x0] (1392640->1912831) req@ffff8800a55a4e00 x1830949054076288/t21474841159(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/448 e 0 to 0 dl 1746129823 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.219921:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a4e00 with x1830949054076288 ext(1392640->1912831) 00010000:00010000:1.0:1746129812.219929:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 14 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.219940:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 14 pid: 8437 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.220033:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a4e00 00000100:00100000:0.0:1746129812.225271:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.225306:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.225329:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.225413:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.225801:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077440 00000100:00100000:1.0:1746129812.225805:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077440 00010000:00010000:1.0:1746129812.225822:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 6 pid: 8435 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129812.225879:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077568 00000100:00100000:1.0:1746129812.225882:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077568 00010000:00010000:1.0:1746129812.225893:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 24 pid: 1877 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129812.225905:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077696 00000100:00100000:1.0:1746129812.225907:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077696 00010000:00010000:1.0:1746129812.225915:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 16 pid: 4589 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129812.225926:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7332 00000100:00100000:1.0:1746129812.225931:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054077440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129812.225939:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129812.225962:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 6 pid: 8435 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.225970:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 6 pid: 8435 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.225985:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f4800/0x48868a4e43953317 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e25 expref: 6 pid: 8435 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226010:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129812.226028:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054077440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.226033:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7332 00000100:00100000:1.0:1746129812.226044:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7333 00000100:00100000:1.0:1746129812.226049:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054077568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129812.226055:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129812.226061:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 24 pid: 1877 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226080:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 24 pid: 1877 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226091:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e43953292 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dd8 expref: 24 pid: 1877 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226098:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129812.226114:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054077568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.226119:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7333 00000100:00100000:1.0:1746129812.226129:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7334 00000100:00100000:1.0:1746129812.226133:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054077696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129812.226139:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129812.226146:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 16 pid: 4589 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226153:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 16 pid: 4589 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226164:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d94800/0x48868a4e43953222 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d92 expref: 16 pid: 4589 timeout: 858 lvb_type: 1 00010000:00010000:1.0:1746129812.226173:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.226175:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.226180:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ef7 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.226187:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1482751) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ef7 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.226206:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1482751) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ef7 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129812.226213:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053916544:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129812.226248:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.228757:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077824 00000100:00100000:0.0:1746129812.228762:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077824 00010000:00010000:0.0:1746129812.228784:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 14 pid: 8437 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.228811:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7335 00000100:00100000:0.0:1746129812.228816:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054077824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.228825:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129812.228840:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 14 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.228865:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 14 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.228883:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e439533bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1392640->1912831) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e95 expref: 14 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.228904:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.228906:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.228912:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.228918:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.228949:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129812.228960:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053916672:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129812.229030:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.233260:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053916544:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129812.233278:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129812.233339:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054077696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7204us (7924us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.233349:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7334 00000100:00100000:0.0:1746129812.234250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.237050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.237751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.237822:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077952 00000100:00100000:1.0:1746129812.237829:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077952 00002000:00100000:1.0:1746129812.237874:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (4149248->4194303) req@ffff88009423df80 x1830949054077952/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.237883:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423df80 with x1830949054077952 ext(4149248->4194303) 00010000:00010000:1.0:1746129812.237890:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb20c00/0x48868a4e4395338e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e80 expref: 17 pid: 4589 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.237901:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb20c00/0x48868a4e4395338e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4149248->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e80 expref: 17 pid: 4589 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.237907:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009423df80 00000100:00100000:1.0:1746129812.237926:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1776 00000100:00100000:1.0:1746129812.237932:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054077952:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129812.238196:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078208 00000100:00100000:0.0:1746129812.238199:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078208 00002000:00100000:0.0:1746129812.238215:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1355776->1359871) req@ffff88009423d500 x1830949054078208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129812.238222:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d500 with x1830949054078208 ext(1355776->1359871) 00002000:00010000:0.0:1746129812.238225:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423d500 00000100:00100000:0.0:1746129812.239212:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053916672:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129812.239228:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129812.239387:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078720 00000100:00100000:1.0:1746129812.239391:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078720 00002000:00100000:1.0:1746129812.239406:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880092ad9c00 x1830949054078720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.239412:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9c00 with x1830949054078720 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.239415:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9c00 00000100:00100000:1.0:1746129812.239427:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6555 00000100:00100000:1.0:1746129812.239431:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054078720:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.240561:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054077824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11738us (12467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.240572:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7335 00000100:00100000:0.0:1746129812.243629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.257921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.259518:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054078720:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20084us (20545us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129812.259526:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6555 00002000:00100000:0.0:1746129812.259535:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880092ad9c00 x1830949054078720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129812.259543:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9c00 with x1830949054078720 ext(1048576->2097151) 00002000:00010000:0.0:1746129812.259547:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9c00 00000100:00100000:0.0:1746129812.261208:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.270987:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.272800:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.272891:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.273020:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079616 00000100:00100000:1.0:1746129812.273028:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079616 00000100:00100000:1.0:1746129812.273067:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14771 00000100:00100000:1.0:1746129812.273074:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31263:x1830949054079616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.273091:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.273108:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186ec00/0x48868a4e43953491 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f13 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.273131:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.273132:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.273139:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013186ec00/0x48868a4e43953491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f13 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.273153:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186ec00/0x48868a4e43953491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f13 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.273167:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ec00, rc 0) 00000100:00100000:1.0:1746129812.273215:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31263:x1830949054079616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 141us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.273221:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14771 00000100:00100000:1.0:1746129812.273240:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079488 00000100:00100000:1.0:1746129812.273243:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079488 00002000:00100000:1.0:1746129812.273263:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009423f480 x1830949054079488/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.273272:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f480 with x1830949054079488 ext(2097152->3145727) 00002000:00010000:1.0:1746129812.273277:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f480 00000100:00100000:1.0:1746129812.273575:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079744 00000100:00100000:1.0:1746129812.273578:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079744 00002000:00100000:1.0:1746129812.273593:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1355776->1482751) req@ffff88009423d180 x1830949054079744/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.273600:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d180 with x1830949054079744 ext(1355776->1482751) 00010000:00010000:1.0:1746129812.273605:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ef7 expref: 15 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.273615:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cab400/0x48868a4e43953459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1355776->1482751) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ef7 expref: 15 pid: 20441 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.273621:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009423d180 00000100:00100000:0.0:1746129812.289873:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.291639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.291665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.291677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.291699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.291722:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054080256 00000100:00100000:1.0:1746129812.291727:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054080256 00002000:00100000:1.0:1746129812.291749:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a8791880 x1830949054080256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.291756:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8791880 with x1830949054080256 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.291760:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8791880 00000100:00100000:1.0:1746129812.291773:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054080512 00000100:00100000:1.0:1746129812.291775:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054080512 00002000:00100000:1.0:1746129812.291784:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a8790a80 x1830949054080512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.291790:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790a80 with x1830949054080512 ext(2097152->3145727) 00002000:00010000:1.0:1746129812.291793:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790a80 00000100:00100000:1.0:1746129812.291798:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054080768 00000100:00100000:1.0:1746129812.291799:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054080768 00002000:00100000:1.0:1746129812.291805:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (4116480->4194303) req@ffff8800a8790e00 x1830949054080768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.291811:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790e00 with x1830949054080768 ext(4116480->4194303) 00002000:00010000:1.0:1746129812.291813:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790e00 00000100:00100000:1.0:1746129812.292246:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6559 00000100:00100000:1.0:1746129812.292255:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949054080256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.293717:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6560 00000100:00100000:0.0:1746129812.293725:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054080512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.295823:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6561 00000100:00100000:0.0:1746129812.295834:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054080768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.318223:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.319197:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054080256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26939us (27566us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.319206:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6559 00002000:00100000:1.0:1746129812.319214:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a8791880 x1830949054080256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.319223:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8791880 with x1830949054080256 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.319229:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8791880 00000100:00100000:1.0:1746129812.319248:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081152 00000100:00100000:1.0:1746129812.319254:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081152 00002000:00100000:1.0:1746129812.319277:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1888256->1892351) req@ffff880092ad9180 x1830949054081152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.319296:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9180 with x1830949054081152 ext(1888256->1892351) 00002000:00010000:1.0:1746129812.319299:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9180 00000100:00100000:1.0:1746129812.319314:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6562 00000100:00100000:1.0:1746129812.319320:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054081152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.319432:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054081152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 112us (2500us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129812.319438:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6562 00002000:00100000:1.0:1746129812.319442:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1888256->1892351) req@ffff880092ad9180 x1830949054081152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.319448:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9180 with x1830949054081152 ext(1888256->1892351) 00002000:00010000:1.0:1746129812.319450:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9180 00000100:00100000:0.0:1746129812.330029:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054080768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34194us (38346us total) trans 0 rc 77824/77824 00000100:00100000:0.0:1746129812.330036:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6561 00002000:00100000:0.0:1746129812.330042:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (4116480->4194303) req@ffff8800a8790e00 x1830949054080768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 77824/77824 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129812.330053:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790e00 with x1830949054080768 ext(4116480->4194303) 00010000:00010000:0.0:1746129812.330061:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 24 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.330073:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 24 pid: 8437 timeout: 858 lvb_type: 0 00002000:00010000:0.0:1746129812.332498:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8790e00 00000100:00100000:0.0:1746129812.337205:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.337253:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.337273:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081408 00000100:00100000:0.0:1746129812.337273:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081536 00000100:00100000:0.0:1746129812.337291:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081536 00000100:00100000:1.0:1746129812.337303:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081408 00002000:00100000:0.0:1746129812.337330:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4116479) req@ffff88009423c700 x1830949054081536/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129812.337334:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14773 00002000:00100000:0.0:1746129812.337340:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c700 with x1830949054081536 ext(3145728->4116479) 00000100:00100000:1.0:1746129812.337341:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31270:x1830949054081408:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129812.337348:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 24 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.337354:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129812.337362:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f800/0x48868a4e43953395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e87 expref: 24 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.337368:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186e400/0x48868a4e4395349f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f21 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129812.337368:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009423c700 00010000:00010000:1.0:1746129812.337391:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.337397:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.337399:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.337402:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013186e400/0x48868a4e4395349f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f21 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.337425:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 20 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.337432:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc8e600/0x48868a4e43953428 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ed4 expref: 20 pid: 3624 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.337443:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053917312:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.337497:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.343920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.344055:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053917312:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.344079:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186e400/0x48868a4e4395349f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->1163263] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f21 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.344094:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186e400, rc 0) 00000100:00100000:1.0:1746129812.344129:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31270:x1830949054081408:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6788us (6934us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.344136:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14773 00000100:00100000:1.0:1746129812.344157:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081664 00000100:00100000:1.0:1746129812.344163:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081664 00000100:00100000:1.0:1746129812.344187:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14774 00000100:00100000:1.0:1746129812.344192:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31263:x1830949054081664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.344205:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.344217:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186f400/0x48868a4e439534a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f28 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.344234:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.344238:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186f400/0x48868a4e439534a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f28 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.344246:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186f400/0x48868a4e439534a6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f28 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.344253:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186f400, rc 0) 00000100:00100000:1.0:1746129812.344267:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31263:x1830949054081664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.344271:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14774 00000100:00100000:0.0:1746129812.355905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.355985:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082048 00000100:00100000:1.0:1746129812.355993:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082048 00002000:00100000:1.0:1746129812.356027:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1159168->1163263) req@ffff88009423c380 x1830949054082048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.356036:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c380 with x1830949054082048 ext(1159168->1163263) 00002000:00010000:1.0:1746129812.356041:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423c380 00000100:00100000:1.0:1746129812.356534:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6563 00000100:00100000:1.0:1746129812.356541:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054082048:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.356672:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054082048:12345-192.168.204.31@tcp:3:cat.0 Request processed in 131us (776us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129812.356678:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6563 00002000:00100000:1.0:1746129812.356683:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1159168->1163263) req@ffff88009423c380 x1830949054082048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.356690:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c380 with x1830949054082048 ext(1159168->1163263) 00002000:00010000:1.0:1746129812.356692:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423c380 00000100:00100000:0.0:1746129812.368151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.368231:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082304 00000100:00100000:1.0:1746129812.368238:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082304 00000100:00100000:1.0:1746129812.368325:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4497 00000100:00100000:1.0:1746129812.368332:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31270:x1830949054082304:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129812.368698:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31270:x1830949054082304:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 365us (551us total) trans 8589944826 rc 0/0 00000100:00100000:1.0:1746129812.368704:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4497 00000100:00100000:0.0:1746129812.373831:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.383107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.383155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.392129:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.394654:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054083200 00000100:00100000:1.0:1746129812.394664:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054083200 00002000:00100000:1.0:1746129812.394701:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009b00d500 x1830949054083200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.394709:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d500 with x1830949054083200 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.394714:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00d500 00000100:00100000:0.0:1746129812.399043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.403102:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.403825:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054083712 00000100:00100000:1.0:1746129812.403832:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054083712 00002000:00100000:1.0:1746129812.403885:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009b00ce00 x1830949054083712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.403894:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ce00 with x1830949054083712 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.403899:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00ce00 00000100:00100000:1.0:1746129812.403930:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6568 00000100:00100000:1.0:1746129812.403937:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054083712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.419995:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054083712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16047us (16890us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.420008:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6568 00002000:00100000:1.0:1746129812.420019:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009b00ce00 x1830949054083712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.420027:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ce00 with x1830949054083712 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.420032:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00ce00 00000100:00100000:0.0:1746129812.421584:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.421630:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.421665:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054083968 00000100:00100000:1.0:1746129812.421668:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054083968 00000100:00100000:1.0:1746129812.421699:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14775 00000100:00100000:1.0:1746129812.421705:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054083968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.421719:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.421734:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e439534ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f36 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129812.421773:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053917952:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129812.421890:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746129812.425421:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129812 -> 1746129813 00002000:00010000:1.0:1746129812.425428:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129812 -> 1746129813 00002000:00010000:1.0:1746129812.425430:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129812 -> 1746129813 00000100:00100000:1.0:1746129812.425453:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053917952:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129812.425477:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e439534ad lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f36 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.425490:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013186fc00/0x48868a4e439534ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f36 expref: 13 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.425511:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186fc00, rc 0) 00000100:00100000:1.0:1746129812.425537:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054083968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3832us (3906us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129812.425543:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14775 00000100:00100000:0.0:1746129812.431264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.431324:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054084224 00000100:00100000:1.0:1746129812.431333:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054084224 00002000:00100000:1.0:1746129812.431372:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009b00e680 x1830949054084224/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.431381:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00e680 with x1830949054084224 ext(4194304->4931583) 00002000:00010000:1.0:1746129812.431385:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00e680 00000100:00100000:1.0:1746129812.431628:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6569 00000100:00100000:1.0:1746129812.431635:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054084224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.431916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.441662:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054084224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10016us (10395us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129812.441678:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6569 00002000:00100000:1.0:1746129812.441684:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009b00e680 x1830949054084224/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.441692:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00e680 with x1830949054084224 ext(4194304->4931583) 00002000:00010000:1.0:1746129812.441696:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00e680 00000100:00100000:0.0:1746129812.448324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.448372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.455622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.455685:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054084992 00000100:00100000:1.0:1746129812.455693:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054084992 00000100:00100000:1.0:1746129812.455742:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4498 00000100:00100000:1.0:1746129812.455748:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31263:x1830949054084992:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129812.455920:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31263:x1830949054084992:12345-192.168.204.31@tcp:35:cat.0 Request processed in 172us (306us total) trans 8589944827 rc 0/0 00000100:00100000:1.0:1746129812.455925:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4498 00000100:00100000:1.0:1746129812.463711:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14780 00000100:00100000:1.0:1746129812.463719:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054085120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.463727:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.463736:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186f200/0x48868a4e439534d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f4b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129812.463760:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053918464:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129812.463782:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129812.470056:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053918464:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129812.470074:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186f200/0x48868a4e439534d0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f4b expref: 18 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.470084:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013186f200/0x48868a4e439534d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f4b expref: 18 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.470103:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186f200, rc 0) 00000100:00100000:1.0:1746129812.470124:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054085120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6406us (6737us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129812.470129:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14780 00000100:00100000:0.0:1746129812.486954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.487654:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054085760 00000100:00100000:1.0:1746129812.487663:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054085760 00000100:00100000:1.0:1746129812.487713:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4499 00000100:00100000:1.0:1746129812.487721:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31275:x1830949054085760:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129812.487943:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31275:x1830949054085760:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 221us (994us total) trans 8589944829 rc 0/0 00000100:00100000:1.0:1746129812.487949:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4499 00000100:00100000:0.0:1746129812.490170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.490707:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054085888 00000100:00100000:1.0:1746129812.490715:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054085888 00000100:00100000:1.0:1746129812.490843:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14781 00000100:00100000:1.0:1746129812.490879:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31275:x1830949054085888:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129812.490893:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.490907:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013186ee00/0x48868a4e439534fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f60 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.490931:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a27e600/0x48868a4e43953460 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354efe expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.490939:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013186ec00/0x48868a4e43953491 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f13 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.490944:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.490946:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.490949:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013186ee00/0x48868a4e439534fa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3874816->3928063] (req 3874816->3928063) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f60 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.490972:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013186ec00/0x48868a4e43953491 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f13 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.490982:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013186ec00/0x48868a4e43953491 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f13 expref: 18 pid: 4589 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.490993:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053918592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.491899:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a27e600/0x48868a4e43953460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354efe expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.491908:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a27e600/0x48868a4e43953460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354efe expref: 13 pid: 20441 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.491916:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053918720:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.492557:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129812.493124:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053918592:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.493661:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053918720:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.493683:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013186ee00/0x48868a4e439534fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3874816->3928063] (req 3874816->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f60 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.493696:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ee00, rc 0) 00000100:00100000:1.0:1746129812.494022:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31275:x1830949054085888:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3144us (3858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.494030:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14781 00000100:00100000:0.0:1746129812.500292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.500341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.504297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.508573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.565794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.574631:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.576560:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.584465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.584495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.584517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.584528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.584545:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054087424 00000100:00100000:0.0:1746129812.584560:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054087424 00000100:00100000:1.0:1746129812.584699:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054087552 00000100:00100000:1.0:1746129812.584703:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054087552 00000100:00100000:0.0:1746129812.585062:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14782 00000100:00100000:0.0:1746129812.585070:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054087424:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129812.585115:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14783 00000100:00100000:1.0:1746129812.585120:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054087296:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129812.585133:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129812.585601:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129812.585609:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bab8000/0x48868a4e43953532 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f75 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129812.585632:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053919360:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129812.585653:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8840 going to sleep for 11 seconds 00010000:00010000:1.0:1746129812.585731:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a38a00/0x48868a4e43953539 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f6e expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.585741:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.585743:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.585748:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38a00/0x48868a4e43953539 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f6e expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.586314:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a38a00/0x48868a4e43953539 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f6e expref: 10 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.586322:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a38a00, rc 0) 00000100:00100000:1.0:1746129812.586447:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054087296:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 1326us (1951us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.586452:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14783 00000100:00100000:0.0:1746129812.592265:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053919360:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129812.592299:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bab8000/0x48868a4e43953532 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f75 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.592308:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bab8000/0x48868a4e43953532 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f75 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.592318:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bab8000, rc 0) 00000100:00100000:0.0:1746129812.592337:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054087424:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7268us (7880us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129812.592343:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14782 00000100:00100000:0.0:1746129812.597254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.604375:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.604508:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054088320 00000100:00100000:1.0:1746129812.604515:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054088320 00000100:00100000:1.0:1746129812.604556:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10859 00000100:00100000:1.0:1746129812.604563:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31280:x1830949054088320:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129812.604582:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.604595:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e4395354e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354f98 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.604679:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604690:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604699:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604710:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604715:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604720:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604810:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43953563 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604819:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43953563 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604825:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43953563 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129812.604832:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:1.0:1746129812.604920:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604927:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604932:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604940:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a38800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129812.604943:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604949:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604958:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129812.604961:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129812.604964:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604968:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38800/0x48868a4e43953555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604982:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604987:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604991:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.604995:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a38e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129812.604997:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.605001:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.605007:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bfcaa00) 00010000:00010000:1.0:1746129812.605008:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129812.605011:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.605015:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e4395355c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129812.605043:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a39c00/0x48868a4e4395354e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f98 expref: 293 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.605053:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ec00/0x48868a4e43953563 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f98 expref: 292 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.605058:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129812.605060:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129812.605062:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ec00, rc 0) 00000100:00100000:1.0:1746129812.605099:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31280:x1830949054088320:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 536us (731us total) trans 8589944831 rc 0/0 00000100:00100000:1.0:1746129812.605106:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10859 00000100:00100000:0.0:1746129812.605257:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.605272:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054088448 00000100:00100000:0.0:1746129812.605286:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054088448 00010000:00010000:0.0:1746129812.605301:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e43953516 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f67 expref: 11 pid: 14314 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.605319:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7343 00000100:00100000:0.0:1746129812.605324:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054088448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.605331:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129812.605335:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e43953516 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f67 expref: 11 pid: 14314 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.605343:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08de00/0x48868a4e43953516 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f67 expref: 11 pid: 14314 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.605354:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129812.605357:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c800/0x48868a4e43953547 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.605363:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c800/0x48868a4e43953547 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.605368:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c800/0x48868a4e43953547 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129812.605381:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129812.605399:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054088448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.605409:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7343 00000100:00100000:0.0:1746129812.615612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.620574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.626459:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.626695:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054089088 00000100:00100000:1.0:1746129812.626703:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054089088 00000100:00100000:1.0:1746129812.626748:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4501 00000100:00100000:1.0:1746129812.626755:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31278:x1830949054089088:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129812.626943:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31278:x1830949054089088:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 188us (491us total) trans 8589944833 rc 0/0 00000100:00100000:1.0:1746129812.626949:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4501 00000100:00100000:0.0:1746129812.635328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.688049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.692218:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.708589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.708668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.714510:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053919744:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129812.714543:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f57000/0x48868a4e439535d3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fbb expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.714557:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f57000/0x48868a4e439535d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fbb expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.714579:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f57000, rc 0) 00000100:00100000:0.0:1746129812.714621:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054089856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5709us (6074us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129812.714629:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14788 00000100:00100000:0.0:1746129812.722958:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.728300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.731450:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.731487:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920000:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.731510:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e439535e1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fc9 expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.731526:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08cc00, rc 0) 00000100:00100000:1.0:1746129812.731554:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31289:x1830949054090112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8010us (8602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.731562:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14790 00000100:00100000:1.0:1746129812.731593:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054090752 00000100:00100000:1.0:1746129812.731597:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054090752 00002000:00100000:1.0:1746129812.731621:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1888256->2097151) req@ffff88009be64000 x1830949054090752/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.731629:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64000 with x1830949054090752 ext(1888256->2097151) 00010000:00010000:1.0:1746129812.731635:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a27fe00/0x48868a4e4395348a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f0c expref: 28 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.731645:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a27fe00/0x48868a4e4395348a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f0c expref: 28 pid: 20441 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.731651:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be64000 00000100:00100000:1.0:1746129812.731669:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1780 00000100:00100000:1.0:1746129812.731676:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054090752:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129812.739950:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.740010:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054090880 00000100:00100000:1.0:1746129812.740018:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054090880 00000100:00100000:1.0:1746129812.740070:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14791 00000100:00100000:1.0:1746129812.740078:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31280:x1830949054090880:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129812.740093:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.740106:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354fd0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.740130:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.740137:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f57400/0x48868a4e43953524 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f8a expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.740143:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013186f400/0x48868a4e439534a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f28 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.740148:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.740150:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129812.740152:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.740177:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013186f400/0x48868a4e439534a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f28 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.740186:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013186f400/0x48868a4e439534a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f28 expref: 31 pid: 10930 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.740197:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920128:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.740304:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091f57400/0x48868a4e43953524 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f8a expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129812.740312:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091f57400/0x48868a4e43953524 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f8a expref: 6 pid: 3623 timeout: 858 lvb_type: 1 00000100:00100000:1.0:1746129812.740320:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.740342:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.740349:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 17 pid: 20441 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.740356:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920384:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.740372:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.747762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.748865:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920128:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129812.748876:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920256:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129812.748885:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920384:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129812.748913:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3796992->4194303] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.748927:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186ec00, rc 0) 00000100:00100000:0.0:1746129812.748956:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31280:x1830949054090880:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8879us (9012us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129812.748965:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14791 00000100:00100000:1.0:1746129812.750514:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054090752:12345-192.168.204.31@tcp:4:cat.0 Request processed in 18834us (19066us total) trans 17179873974 rc 0/0 00000100:00100000:1.0:1746129812.750523:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1780 00002000:00100000:1.0:1746129812.750530:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1888256->2097151) req@ffff88009be64000 x1830949054090752/t17179873974(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/448 e 0 to 0 dl 1746129823 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.750538:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64000 with x1830949054090752 ext(1888256->2097151) 00010000:00010000:1.0:1746129812.750544:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a27fe00/0x48868a4e4395348a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f0c expref: 28 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.750554:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a27fe00/0x48868a4e4395348a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f0c expref: 28 pid: 20441 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.750560:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be64000 00000100:00100000:0.0:1746129812.752528:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054091264 00000100:00100000:0.0:1746129812.752532:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054091264 00010000:00010000:0.0:1746129812.752546:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 18 pid: 20441 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.752656:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7346 00000100:00100000:0.0:1746129812.752661:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054091264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129812.752667:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129812.752675:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 18 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.752683:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 18 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.752693:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a27f000/0x48868a4e43953498 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f1a expref: 18 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.752707:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.752709:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129812.752714:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.752721:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.752743:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129812.752754:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053920512:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129812.752801:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.761666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.761703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.761733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.761762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.761815:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054091904 00000100:00100000:1.0:1746129812.761819:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054091904 00002000:00100000:1.0:1746129812.761973:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3796992->3801087) req@ffff88009be65180 x1830949054091904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.761981:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65180 with x1830949054091904 ext(3796992->3801087) 00002000:00010000:1.0:1746129812.761985:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65180 00000100:00100000:1.0:1746129812.762002:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6574 00000100:00100000:1.0:1746129812.762007:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054091904:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129812.762868:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054091904:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 859us (1104us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129812.762875:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6574 00002000:00100000:1.0:1746129812.762880:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3796992->3801087) req@ffff88009be65180 x1830949054091904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.762887:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65180 with x1830949054091904 ext(3796992->3801087) 00002000:00010000:1.0:1746129812.762890:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65180 00010000:00010000:0.0:1746129812.777870:0:3623:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff8800a8fd3b80 x1830949053920768) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88009a27fe00/0x48868a4e4395348a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f0c expref: 30 pid: 20441 timeout: 858 lvb_type: 0 00010000:00010000:0.0:1746129812.777907:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a27fe00/0x48868a4e4395348a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f0c expref: 30 pid: 20441 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.777928:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053920768:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129812.777955:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f7c00/0x48868a4e439535ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd7 expref: 29 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.777967:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f7c00/0x48868a4e439535ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd7 expref: 29 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129812.777975:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f7c00, rc 0) 00000100:00100000:0.0:1746129812.778031:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054091392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 16148us (16372us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129812.778039:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14792 00000100:00100000:0.0:1746129812.778063:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054092032 00000100:00100000:0.0:1746129812.778067:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054092032 00000100:00100000:0.0:1746129812.778100:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14794 00000100:00100000:0.0:1746129812.778106:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31280:x1830949054092032:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129812.778118:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129812.778129:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d95a00/0x48868a4e439535fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354fe5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.778150:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013186ee00/0x48868a4e439534fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f60 expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.778157:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129812.778159:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129812.778162:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d95a00/0x48868a4e439535fd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4509695] (req 4194304->4509695) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fe5 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.778185:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013186ee00/0x48868a4e439534fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3928063) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f60 expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129812.778196:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013186ee00/0x48868a4e439534fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3874816->3928063) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f60 expref: 11 pid: 10930 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746129812.778205:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053921024:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129812.778243:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129812.779326:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054092288 00000100:00100000:1.0:1746129812.779331:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054092288 00002000:00100000:1.0:1746129812.779363:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094d8f100 x1830949054092288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.779371:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f100 with x1830949054092288 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.779375:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f100 00000100:00100000:1.0:1746129812.779387:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6575 00000100:00100000:1.0:1746129812.779392:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054092288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.784422:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053921024:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.784449:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092d95a00/0x48868a4e439535fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4509695] (req 4194304->4509695) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fe5 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.784464:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d95a00, rc 0) 00000100:00100000:1.0:1746129812.784516:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31280:x1830949054092032:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6409us (6886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.784524:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14794 00000100:00100000:0.0:1746129812.785348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.785384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.785391:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054092544 00000100:00100000:1.0:1746129812.785397:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054092544 00000100:00100000:1.0:1746129812.785900:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14795 00000100:00100000:1.0:1746129812.785908:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31286:x1830949054092544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.785976:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.785989:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4afe00/0x48868a4e43953604 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354fec expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.786009:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.786011:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.786015:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4afe00/0x48868a4e43953604 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fec expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.786025:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4afe00/0x48868a4e43953604 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fec expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.786033:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4afe00, rc 0) 00000100:00100000:1.0:1746129812.786056:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31286:x1830949054092544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 150us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.786061:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14795 00000100:00100000:1.0:1746129812.800932:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054092288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21532us (23207us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.800941:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6575 00002000:00100000:1.0:1746129812.800949:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094d8f100 x1830949054092288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.800957:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f100 with x1830949054092288 ext(1048576->2097151) 00002000:00010000:1.0:1746129812.800962:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f100 00000100:00100000:0.0:1746129812.806137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.816009:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.816207:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054092928 00000100:00100000:1.0:1746129812.816215:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054092928 00002000:00100000:1.0:1746129812.816252:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4505600->4509695) req@ffff88009be64380 x1830949054092928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.816261:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64380 with x1830949054092928 ext(4505600->4509695) 00002000:00010000:1.0:1746129812.816266:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64380 00000100:00100000:1.0:1746129812.816752:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6576 00000100:00100000:1.0:1746129812.816761:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054092928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.817196:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.817233:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054092928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 472us (1228us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129812.817240:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6576 00002000:00100000:1.0:1746129812.817246:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4505600->4509695) req@ffff88009be64380 x1830949054092928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.817254:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64380 with x1830949054092928 ext(4505600->4509695) 00002000:00010000:1.0:1746129812.817257:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64380 00000100:00100000:1.0:1746129812.817449:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054093056 00000100:00100000:1.0:1746129812.817454:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054093056 00000100:00100000:1.0:1746129812.817487:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14796 00000100:00100000:1.0:1746129812.817493:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31289:x1830949054093056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.817507:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.817522:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0x48868a4e4395360b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ff3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.817545:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013186e400/0x48868a4e4395349f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f21 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.817552:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.817554:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.817556:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0x48868a4e4395360b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ff3 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.817580:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013186e400/0x48868a4e4395349f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f21 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.817590:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013186e400/0x48868a4e4395349f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1163263) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f21 expref: 19 pid: 10930 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.817600:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053921408:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.817657:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.818605:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.818885:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053921408:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.818903:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0x48868a4e4395360b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ff3 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.818912:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4aec00, rc 0) 00000100:00100000:1.0:1746129812.819226:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31289:x1830949054093056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1731us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.819233:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14796 00000100:00100000:0.0:1746129812.821140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.821179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.821188:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054093440 00000100:00100000:1.0:1746129812.821193:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054093440 00000100:00100000:1.0:1746129812.821392:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14797 00000100:00100000:1.0:1746129812.821398:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31282:x1830949054093440:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129812.821406:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.821416:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf354ffa expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.821434:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.821439:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.821441:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.821444:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2834432->3145727] (req 2834432->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.821463:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.821472:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013186ec00/0x48868a4e439535e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3796992->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fd0 expref: 26 pid: 3623 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.821481:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053921536:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.821522:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.828379:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6577 00000100:00100000:0.0:1746129812.828387:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054093824:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.830301:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053921536:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129812.830328:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2834432->3145727] (req 2834432->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.830341:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d94400, rc 0) 00000100:00100000:1.0:1746129812.830372:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31282:x1830949054093440:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8974us (9236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129812.830379:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14797 00000100:00100000:0.0:1746129812.843602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.858143:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054093824:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29748us (30643us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.858154:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6577 00002000:00100000:1.0:1746129812.858164:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094d8f480 x1830949054093824/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.858174:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949054093824 ext(2097152->3145727) 00002000:00010000:1.0:1746129812.858179:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8f480 00000100:00100000:0.0:1746129812.859466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.864421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.867588:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.868185:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054095360 00000100:00100000:1.0:1746129812.868191:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054095360 00000100:00100000:1.0:1746129812.868217:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14798 00000100:00100000:1.0:1746129812.868223:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31286:x1830949054095360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129812.868234:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129812.868247:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d95200/0x48868a4e43953619 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355001 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.868279:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.868286:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.868289:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129812.868292:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d95200/0x48868a4e43953619 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355001 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.868316:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129812.868327:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 17 pid: 8437 timeout: 858 lvb_type: 0 00000100:00100000:1.0:1746129812.868337:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053921920:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129812.868382:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129812.873175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.874501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.878598:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.878642:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.878653:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054096000 00000100:00100000:1.0:1746129812.878661:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054096000 00002000:00100000:1.0:1746129812.878699:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2834432->3145727) req@ffff8800a8fd0700 x1830949054096000/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.878708:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0700 with x1830949054096000 ext(2834432->3145727) 00010000:00010000:1.0:1746129812.878716:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 18 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.878728:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 18 pid: 8437 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.878734:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8fd0700 00000100:00100000:1.0:1746129812.878780:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1787 00000100:00100000:1.0:1746129812.878785:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054096000:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129812.880919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.880970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.886016:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054096000:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7226us (7421us total) trans 17179873976 rc 0/0 00000100:00100000:1.0:1746129812.886027:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1787 00002000:00100000:1.0:1746129812.886035:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2834432->3145727) req@ffff8800a8fd0700 x1830949054096000/t17179873976(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/448 e 0 to 0 dl 1746129823 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.886043:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd0700 with x1830949054096000 ext(2834432->3145727) 00010000:00010000:1.0:1746129812.886051:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 20 pid: 8437 timeout: 858 lvb_type: 0 00010000:00010000:1.0:1746129812.886062:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092d94400/0x48868a4e43953612 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2834432->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ffa expref: 20 pid: 8437 timeout: 858 lvb_type: 0 00002000:00010000:1.0:1746129812.886068:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8fd0700 00000100:00100000:0.0:1746129812.895229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.895263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.899395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.901673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.902314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.902366:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054097408 00000100:00100000:1.0:1746129812.902376:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054097408 00002000:00100000:1.0:1746129812.902410:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3670016->3674111) req@ffff88009206dc00 x1830949054097408/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.902418:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206dc00 with x1830949054097408 ext(3670016->3674111) 00002000:00010000:1.0:1746129812.902422:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206dc00 00000100:00100000:1.0:1746129812.902443:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6582 00000100:00100000:1.0:1746129812.902447:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054097408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.902551:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054097408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 103us (238us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129812.902556:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6582 00002000:00100000:1.0:1746129812.902561:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3670016->3674111) req@ffff88009206dc00 x1830949054097408/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/4536 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.902573:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206dc00 with x1830949054097408 ext(3670016->3674111) 00002000:00010000:1.0:1746129812.902580:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206dc00 00000100:00100000:0.0:1746129812.909773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.910354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.921894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.925456:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.925704:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.930977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.931024:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.931581:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054098816 00000100:00100000:1.0:1746129812.931605:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054098816 00002000:00100000:1.0:1746129812.931643:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012b024700 x1830949054098816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.931663:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024700 with x1830949054098816 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.931667:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024700 00000100:00100000:1.0:1746129812.931700:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6584 00000100:00100000:1.0:1746129812.931707:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054098816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129812.939903:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054098816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8194us (8876us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.939910:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6584 00002000:00100000:1.0:1746129812.939915:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012b024700 x1830949054098816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.939923:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024700 with x1830949054098816 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.939927:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024700 00000100:00100000:0.0:1746129812.942002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.948226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.948259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.948505:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054099712 00000100:00100000:1.0:1746129812.948507:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054099712 00002000:00100000:1.0:1746129812.948537:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012b024e00 x1830949054099712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/0 e 0 to 0 dl 1746129823 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.948546:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024e00 with x1830949054099712 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.948550:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024e00 00000100:00100000:1.0:1746129812.948900:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6586 00000100:00100000:1.0:1746129812.948907:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054099712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129812.949681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129812.960501:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054099712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11593us (12240us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129812.960508:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6586 00002000:00100000:1.0:1746129812.960513:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012b024e00 x1830949054099712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:553/0 lens 488/440 e 0 to 0 dl 1746129823 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129812.960519:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024e00 with x1830949054099712 ext(3145728->4194303) 00002000:00010000:1.0:1746129812.960522:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024e00 00000100:00100000:0.0:1746129812.965301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.967625:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.967661:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.972948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129812.984614:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054100736 00000100:00100000:0.0:1746129812.984656:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054100736 00000100:00100000:0.0:1746129812.984890:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4504 00000100:00100000:0.0:1746129812.984897:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31286:x1830949054100736:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129812.985093:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31286:x1830949054100736:12345-192.168.204.31@tcp:35:cat.0 Request processed in 196us (558us total) trans 8589944838 rc 0/0 00000100:00100000:0.0:1746129812.985099:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4504 00000100:00100000:0.0:1746129813.055782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.058553:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.060253:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129813.061139:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129813.074966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.075105:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054101376 00000100:00100000:1.0:1746129813.075114:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054101376 00000100:00100000:1.0:1746129813.075168:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14806 00000100:00100000:1.0:1746129813.075175:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31296:x1830949054101376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129813.075191:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.075208:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6800/0x48868a4e43953666 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355040 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.075234:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0x48868a4e4395360b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ff3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.075242:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4395364a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355032 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.075247:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.075250:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.075253:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6800/0x48868a4e43953666 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1105920->1351679] (req 1105920->1351679) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355040 expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.075289:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4395364a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355032 expref: 25 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.075299:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbb6200/0x48868a4e4395364a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355032 expref: 25 pid: 8437 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746129813.075309:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053923072:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.075393:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0x48868a4e4395360b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ff3 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.075400:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4aec00/0x48868a4e4395360b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ff3 expref: 17 pid: 8437 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.075408:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053923200:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.075425:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129813.079144:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053923072:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.079155:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053923200:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.079180:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6800/0x48868a4e43953666 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1105920->1351679] (req 1105920->1351679) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355040 expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.079194:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b6b6800, rc 0) 00000100:00100000:1.0:1746129813.079240:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31296:x1830949054101376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4065us (4281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.079248:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14806 00000100:00100000:0.0:1746129813.081140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.081185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.085273:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.090988:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.091097:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054102144 00000100:00100000:1.0:1746129813.091105:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054102144 00002000:00100000:1.0:1746129813.091142:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1347584->1351679) req@ffff8800a645f480 x1830949054102144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.091151:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949054102144 ext(1347584->1351679) 00002000:00010000:1.0:1746129813.091155:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f480 00000100:00100000:1.0:1746129813.091186:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6591 00000100:00100000:1.0:1746129813.091194:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054102144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129813.091357:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054102144:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 163us (376us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129813.091363:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6591 00002000:00100000:1.0:1746129813.091369:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1347584->1351679) req@ffff8800a645f480 x1830949054102144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.091374:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f480 with x1830949054102144 ext(1347584->1351679) 00002000:00010000:1.0:1746129813.091378:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645f480 00000100:00100000:0.0:1746129813.157348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.161239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.164180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.165142:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054102784 00000100:00100000:1.0:1746129813.165148:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054102784 00000100:00100000:1.0:1746129813.165426:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4505 00000100:00100000:1.0:1746129813.165434:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:27192:x1830949054102784:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129813.165877:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:27192:x1830949054102784:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 443us (1703us total) trans 8589944840 rc 0/0 00000100:00100000:1.0:1746129813.165884:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4505 00000100:00100000:0.0:1746129813.169399:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054102912 00000100:00100000:0.0:1746129813.169407:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054102912 00010000:00010000:0.0:1746129813.169439:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0x48868a4e43953658 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355039 expref: 297 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.171004:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7358 00000100:00100000:0.0:1746129813.171017:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949054102912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.171032:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.171039:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0x48868a4e43953658 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355039 expref: 297 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.171053:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0x48868a4e43953658 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355039 expref: 297 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.171071:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f000/0x48868a4e43953658 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355039 expref: 297 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.171819:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129813.171825:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210400000020 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.171834:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.171840:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.171863:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129813.171868:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129813.171898:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.171953:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949054102912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 939us (2792us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.171959:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7358 00000100:00100000:0.0:1746129813.177927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.177978:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.178086:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054103168 00000100:00100000:1.0:1746129813.178094:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054103168 00010000:00010000:1.0:1746129813.178123:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355047 expref: 11 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.178158:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7359 00000100:00100000:1.0:1746129813.178165:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054103168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.178177:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.178182:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355047 expref: 11 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.178192:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355047 expref: 11 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.178209:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e43953682 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355047 expref: 11 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.178226:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.178230:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129813.178238:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129813.178244:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129813.178272:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.178307:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054103168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 142us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.178317:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7359 00010000:00010000:0.0:1746129813.178491:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129813.178500:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129813.178515:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129813.178644:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb7000/0x48868a4e43953689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35504e expref: 24 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.178709:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35504e expref: 23 pid: 14315 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.178716:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6400/0x48868a4e43953690 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35504e expref: 23 pid: 14315 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.178721:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6400, rc 0) 00000100:00100000:0.0:1746129813.178745:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31300:x1830949054102528:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 17231us (17514us total) trans 8589944841 rc 0/0 00000100:00100000:0.0:1746129813.178750:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10865 00000100:00100000:0.0:1746129813.182468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129813.193561:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129813.203682:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.203726:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.203753:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.203766:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.203786:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054103808 00000100:00100000:0.0:1746129813.204537:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054103808 00000100:00100000:0.0:1746129813.204565:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14811 00000100:00100000:0.0:1746129813.204570:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054103808:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129813.204577:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.204584:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920fda00/0x48868a4e439536c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355071 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.204594:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.204595:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.204600:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fda00/0x48868a4e439536c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355071 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.204609:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920fda00/0x48868a4e439536c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355071 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.204616:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fda00, rc 0) 00000100:00100000:1.0:1746129813.204659:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054104064 00000100:00100000:1.0:1746129813.204662:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054104064 00010000:00010000:1.0:1746129813.204805:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8fc00/0x48868a4e43953421 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ecd expref: 21 pid: 3624 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.205204:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054103808:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 632us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.205210:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14811 00000100:00100000:1.0:1746129813.205225:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054104192 00000100:00100000:1.0:1746129813.205229:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054104192 00010000:00010000:1.0:1746129813.205240:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38a00/0x48868a4e43953539 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f6e expref: 8 pid: 4589 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746129813.205271:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7362 00000100:00100000:1.0:1746129813.205360:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054104192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129813.205371:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054104320 00000100:00100000:1.0:1746129813.205373:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054104320 00010000:00010000:1.0:1746129813.205383:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc8f400/0x48868a4e4395341a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354ec6 expref: 30 pid: 3624 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.207749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.213994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.215081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.215688:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054104832 00000100:00100000:1.0:1746129813.215693:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054104832 00000100:00100000:1.0:1746129813.215720:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14813 00000100:00100000:1.0:1746129813.215726:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054104832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129813.215737:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.215750:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6a00/0x48868a4e439536f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35508d expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129813.215783:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053924352:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129813.215818:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129813.219748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.223900:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053924352:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129813.223931:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6a00/0x48868a4e439536f9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35508d expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.223943:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6a00/0x48868a4e439536f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35508d expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.223955:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b6b6a00, rc 0) 00000100:00100000:0.0:1746129813.223994:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054104832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8267us (8913us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129813.224000:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14813 00000100:00100000:0.0:1746129813.227663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.229118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.234393:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054105856 00000100:00100000:0.0:1746129813.234400:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054105856 00010000:00010000:0.0:1746129813.234428:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43953715 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355094 expref: 13 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.234465:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7364 00000100:00100000:0.0:1746129813.234472:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054105856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.234484:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.234489:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43953715 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355094 expref: 13 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.234500:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43953715 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355094 expref: 13 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.234518:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129813.234523:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.234531:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.234535:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.234584:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054105856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.234590:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7364 00000100:00100000:0.0:1746129813.235049:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054106112 00000100:00100000:0.0:1746129813.235053:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054106112 00000100:00100000:0.0:1746129813.235081:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14815 00000100:00100000:0.0:1746129813.235086:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054106112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129813.235098:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.235108:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920fce00/0x48868a4e43953738 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3550b0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.235143:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053924992:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129813.235719:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129813.235843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129813.235981:0:14314:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@ffff880094eb7100 x1830949053924608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43953715 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355094 expref: 12 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.235993:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43953715 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355094 expref: 12 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.236005:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053924608:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.236015:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053924736:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.236023:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949053924864:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129813.236037:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129813.236041:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.236047:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129813.236053:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129813.237251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.237284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.237299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.237365:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949053924992:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129813.237381:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920fce00/0x48868a4e43953738 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550b0 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.237390:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920fce00/0x48868a4e43953738 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550b0 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.237399:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fce00, rc 0) 00000100:00100000:0.0:1746129813.237417:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054106112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2330us (2732us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129813.237422:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14815 00000100:00100000:0.0:1746129813.244633:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.251047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.251087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.251145:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107008 00000100:00100000:1.0:1746129813.251151:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107008 00010000:00010000:1.0:1746129813.251254:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7800/0x48868a4e43953643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35502b expref: 29 pid: 8437 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746129813.251337:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7367 00000100:00100000:1.0:1746129813.251344:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054107008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.251356:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.251367:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7800/0x48868a4e43953643 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35502b expref: 29 pid: 8437 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.251375:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7800/0x48868a4e43953643 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35502b expref: 29 pid: 8437 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.251391:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb7800/0x48868a4e43953643 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35502b expref: 29 pid: 8437 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.251407:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.251845:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054107008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 500us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.251874:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7367 00000100:00100000:0.0:1746129813.256591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.256666:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.257048:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107264 00000100:00100000:1.0:1746129813.257052:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107264 00010000:00010000:1.0:1746129813.257070:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0x48868a4e439536ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35505c expref: 7 pid: 8437 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746129813.257088:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7368 00000100:00100000:1.0:1746129813.257093:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054107264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.257100:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.257117:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0x48868a4e439536ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35505c expref: 7 pid: 8437 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.257126:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f96f000/0x48868a4e439536ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35505c expref: 7 pid: 8437 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.257141:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.257161:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054107264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.257167:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7368 00000100:00100000:0.0:1746129813.258765:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.265297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.265581:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107776 00000100:00100000:1.0:1746129813.265591:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107776 00000100:00100000:1.0:1746129813.265645:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10871 00000100:00100000:1.0:1746129813.265652:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31299:x1830949054107776:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129813.265668:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.265683:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f400/0x48868a4e43953769 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3550d3 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.265762:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.265774:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 298 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.265784:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.265809:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 298 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.265817:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 298 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.265827:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053926144:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.265929:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.267148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.267184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.267211:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.267234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.267273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.269246:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053926144:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.269276:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129813.270698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.270746:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108416 00000100:00100000:1.0:1746129813.270752:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108416 00010000:00010000:1.0:1746129813.270778:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 299 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.270815:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7373 00000100:00100000:1.0:1746129813.270822:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1962:x1830949054108416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.270833:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.270837:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 299 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.270845:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 299 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.270894:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbb6200/0x48868a4e43953731 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550a2 expref: 299 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.270910:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.270914:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270922:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270928:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270943:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129813.270956:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270962:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270977:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270983:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270988:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.270993:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a38a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129813.270996:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.271005:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.271012:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.271014:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129813.271017:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.271020:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38a00/0x48868a4e43953770 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.271046:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f400/0x48868a4e43953769 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550d3 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.271052:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f400/0x48868a4e43953769 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550d3 expref: 13 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.271058:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009330f400, rc 0) 00000100:00100000:1.0:1746129813.271090:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31299:x1830949054107776:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5438us (5804us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129813.271097:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10871 00000100:00100000:1.0:1746129813.271123:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054108416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 302us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.271128:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7373 00000100:00100000:1.0:1746129813.273635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.273661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.273674:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108928 00000100:00100000:1.0:1746129813.273679:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108928 00002000:00100000:1.0:1746129813.273740:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1064960->1069055) req@ffff88009adace00 x1830949054108928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.273748:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949054108928 ext(1064960->1069055) 00002000:00010000:1.0:1746129813.273751:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:1.0:1746129813.273776:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6595 00000100:00100000:1.0:1746129813.273781:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054108928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129813.273871:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054108928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 89us (236us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129813.273877:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6595 00002000:00100000:1.0:1746129813.273882:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1064960->1069055) req@ffff88009adace00 x1830949054108928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.273888:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949054108928 ext(1064960->1069055) 00002000:00010000:1.0:1746129813.273890:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:0.0:1746129813.280484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.281290:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109184 00000100:00100000:1.0:1746129813.281298:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109184 00000100:00100000:1.0:1746129813.281334:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4506 00000100:00100000:1.0:1746129813.281340:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31299:x1830949054109184:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129813.281546:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31299:x1830949054109184:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 205us (1068us total) trans 8589944845 rc 0/0 00000100:00100000:1.0:1746129813.281551:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4506 00000100:00100000:0.0:1746129813.281767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.281787:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109440 00000100:00100000:0.0:1746129813.281789:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109440 00002000:00100000:0.0:1746129813.281809:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4005888->4009983) req@ffff88009468fb80 x1830949054109440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.281816:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468fb80 with x1830949054109440 ext(4005888->4009983) 00002000:00010000:0.0:1746129813.281820:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468fb80 00000100:00100000:0.0:1746129813.281828:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6596 00000100:00100000:0.0:1746129813.281831:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054109440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.281955:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054109440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 122us (188us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129813.281960:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6596 00002000:00100000:0.0:1746129813.281964:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4005888->4009983) req@ffff88009468fb80 x1830949054109440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.281970:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468fb80 with x1830949054109440 ext(4005888->4009983) 00002000:00010000:0.0:1746129813.281973:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468fb80 00000100:00100000:0.0:1746129813.283464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.283731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.284271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.285234:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109952 00000100:00100000:1.0:1746129813.285245:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109952 00002000:00100000:1.0:1746129813.285295:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1069056->2097151) req@ffff88009468d880 x1830949054109952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.285305:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d880 with x1830949054109952 ext(1069056->2097151) 00002000:00010000:1.0:1746129813.285310:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d880 00000100:00100000:1.0:1746129813.285338:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6597 00000100:00100000:1.0:1746129813.285346:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054109952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129813.294646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.297642:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054109952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12294us (13908us total) trans 0 rc 1028096/1028096 00000100:00100000:1.0:1746129813.297651:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6597 00002000:00100000:1.0:1746129813.297657:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1069056->2097151) req@ffff88009468d880 x1830949054109952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1028096/1028096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.297665:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468d880 with x1830949054109952 ext(1069056->2097151) 00002000:00010000:1.0:1746129813.297670:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468d880 00000100:00100000:0.0:1746129813.310487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.310533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.310558:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110848 00000100:00100000:0.0:1746129813.310564:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110848 00002000:00100000:0.0:1746129813.310603:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009468c000 x1830949054110848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.310612:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c000 with x1830949054110848 ext(1048576->2097151) 00002000:00010000:0.0:1746129813.310617:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468c000 00000100:00100000:0.0:1746129813.310635:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6598 00000100:00100000:0.0:1746129813.310642:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054110848:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.316297:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.322725:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054110848:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12076us (12184us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129813.322736:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6598 00002000:00100000:1.0:1746129813.322746:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009468c000 x1830949054110848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.322754:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c000 with x1830949054110848 ext(1048576->2097151) 00002000:00010000:1.0:1746129813.322759:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468c000 00000100:00100000:1.0:1746129813.334974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.335686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.340033:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.349728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.349784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.362608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.362673:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112000 00000100:00100000:1.0:1746129813.362680:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112000 00002000:00100000:1.0:1746129813.362716:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009468df80 x1830949054112000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.362731:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468df80 with x1830949054112000 ext(1048576->2097151) 00002000:00010000:1.0:1746129813.362736:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468df80 00000100:00100000:1.0:1746129813.362755:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6600 00000100:00100000:1.0:1746129813.362761:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054112000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.376345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.380191:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054112000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17421us (17582us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129813.380200:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6600 00002000:00100000:1.0:1746129813.380210:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009468df80 x1830949054112000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.380218:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468df80 with x1830949054112000 ext(1048576->2097151) 00002000:00010000:1.0:1746129813.380224:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468df80 00000100:00100000:0.0:1746129813.381393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.381609:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112256 00000100:00100000:1.0:1746129813.381615:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112256 00002000:00100000:1.0:1746129813.381644:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3944448->4009983) req@ffff88009468ca80 x1830949054112256/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.381652:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ca80 with x1830949054112256 ext(3944448->4009983) 00010000:00010000:1.0:1746129813.381659:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095347800/0x48868a4e43953754 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3944448->18446744073709551615] (req 3944448->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550be expref: 25 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.381671:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095347800/0x48868a4e43953754 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3944448->18446744073709551615] (req 3944448->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550be expref: 25 pid: 8437 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746129813.381677:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468ca80 00000100:00100000:1.0:1746129813.382139:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1794 00000100:00100000:1.0:1746129813.382146:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054112256:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129813.383574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.386932:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054112256:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4785us (5541us total) trans 21474841166 rc 0/0 00000100:00100000:0.0:1746129813.386940:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1794 00002000:00100000:0.0:1746129813.386947:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3944448->4009983) req@ffff88009468ca80 x1830949054112256/t21474841166(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/448 e 0 to 0 dl 1746129824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.386956:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ca80 with x1830949054112256 ext(3944448->4009983) 00010000:00010000:0.0:1746129813.386963:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095347800/0x48868a4e43953754 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3944448->18446744073709551615] (req 3944448->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550be expref: 28 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.386973:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095347800/0x48868a4e43953754 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3944448->18446744073709551615] (req 3944448->4009983) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550be expref: 28 pid: 8437 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746129813.386979:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009468ca80 00000100:00100000:0.0:1746129813.392535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.392637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.392948:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112768 00000100:00100000:1.0:1746129813.392955:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112768 00002000:00100000:1.0:1746129813.392993:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009423ca80 x1830949054112768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.393001:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ca80 with x1830949054112768 ext(1048576->2097151) 00002000:00010000:1.0:1746129813.393006:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ca80 00000100:00100000:1.0:1746129813.393038:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6601 00000100:00100000:1.0:1746129813.393045:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054112768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.401292:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054112768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8239us (8647us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129813.401302:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6601 00002000:00100000:0.0:1746129813.401312:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009423ca80 x1830949054112768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.401321:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ca80 with x1830949054112768 ext(1048576->2097151) 00002000:00010000:0.0:1746129813.401326:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423ca80 00000100:00100000:0.0:1746129813.401602:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113024 00000100:00100000:0.0:1746129813.401609:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113024 00002000:00100000:0.0:1746129813.401636:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faf4000 x1830949054113024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.401643:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf4000 with x1830949054113024 ext(3145728->4194303) 00002000:00010000:0.0:1746129813.401646:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf4000 00000100:00100000:0.0:1746129813.401726:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6602 00000100:00100000:0.0:1746129813.401734:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054113024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.415894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.420249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.421965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.424358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.424405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.427269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.432214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.432298:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.436293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.436532:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054114688 00000100:00100000:1.0:1746129813.436537:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054114688 00002000:00100000:1.0:1746129813.436565:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009b00ea00 x1830949054114688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.436573:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ea00 with x1830949054114688 ext(4194304->4931583) 00002000:00010000:1.0:1746129813.436578:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ea00 00000100:00100000:1.0:1746129813.436590:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6604 00000100:00100000:1.0:1746129813.436596:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054114688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.445636:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.445680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.445750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.445897:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054115072 00000100:00100000:0.0:1746129813.445901:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054115072 00010000:00010000:0.0:1746129813.445915:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d95200/0x48868a4e43953619 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355001 expref: 31 pid: 8437 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.445931:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7379 00000100:00100000:0.0:1746129813.445936:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054114944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.445942:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.445997:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009536fa00/0x48868a4e4395362e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355016 expref: 24 pid: 8435 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.446005:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009536fa00/0x48868a4e4395362e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355016 expref: 24 pid: 8435 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.446020:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009536fa00/0x48868a4e4395362e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355016 expref: 24 pid: 8435 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.446032:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.446054:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054114944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 118us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.446059:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7379 00000100:00100000:1.0:1746129813.450008:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054114688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13404us (13710us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129813.450017:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6604 00002000:00100000:1.0:1746129813.450026:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009b00ea00 x1830949054114688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.450035:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ea00 with x1830949054114688 ext(4194304->4931583) 00002000:00010000:1.0:1746129813.450041:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ea00 00000100:00100000:1.0:1746129813.451311:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054115328 00000100:00100000:1.0:1746129813.451318:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054115328 00002000:00100000:1.0:1746129813.451354:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3809280->3813375) req@ffff88009faf7480 x1830949054115328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.451362:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf7480 with x1830949054115328 ext(3809280->3813375) 00002000:00010000:1.0:1746129813.451365:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf7480 00000100:00100000:1.0:1746129813.451392:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6605 00000100:00100000:1.0:1746129813.451399:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949054115328:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129813.451522:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054115328:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 118us (511us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129813.451528:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6605 00002000:00100000:1.0:1746129813.451532:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3809280->3813375) req@ffff88009faf7480 x1830949054115328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.451539:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf7480 with x1830949054115328 ext(3809280->3813375) 00002000:00010000:1.0:1746129813.451541:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faf7480 00000100:00100000:0.0:1746129813.457666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.458998:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.473171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.477184:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053928064:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129813.477209:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801318ebc00/0x48868a4e439537ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355127 expref: 24 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.477221:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801318ebc00/0x48868a4e439537ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355127 expref: 24 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.477530:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318ebc00, rc 0) 00000100:00100000:0.0:1746129813.477845:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054115840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4061us (4680us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129813.477867:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14829 00000100:00100000:0.0:1746129813.482546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.482618:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054116096 00000100:00100000:1.0:1746129813.482626:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054116096 00000100:00100000:1.0:1746129813.484741:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4509 00000100:00100000:1.0:1746129813.484755:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31315:x1830949054116096:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129813.486963:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:31315:x1830949054116096:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 2205us (4416us total) trans 8589944850 rc 0/0 00000100:00100000:1.0:1746129813.486974:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4509 00000100:00100000:0.0:1746129813.499448:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.499529:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054116480 00000100:00100000:1.0:1746129813.499537:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054116480 00000100:00100000:1.0:1746129813.499579:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14830 00000100:00100000:1.0:1746129813.499586:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31314:x1830949054116480:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129813.499601:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.499615:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35512e expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.499638:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.499644:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129813.499646:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129813.499649:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3469312->3977215] (req 3469312->3977215) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.499672:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.499683:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 29 pid: 3623 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.499693:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053928192:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.499764:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.500772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.501769:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054116608 00000100:00100000:1.0:1746129813.501774:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054116608 00000100:00100000:1.0:1746129813.503032:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10874 00000100:00100000:1.0:1746129813.503042:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31318:x1830949054116608:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129813.503061:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.503076:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fca00/0x48868a4e439537fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355135 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.503120:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd400/0x48868a4e43953803 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503131:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd400/0x48868a4e43953803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503140:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd400/0x48868a4e43953803 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503150:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd800/0x48868a4e4395380a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503155:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd800/0x48868a4e4395380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503160:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd800/0x48868a4e4395380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503240:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fcc00/0x48868a4e43953811 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503250:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff98a00/0x48868a4e439537a1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35510b expref: 24 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.503268:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fcc00/0x48868a4e43953811 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.503294:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff98a00/0x48868a4e439537a1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35510b expref: 24 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.503308:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff98a00/0x48868a4e439537a1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35510b expref: 24 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.503318:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053928320:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.503379:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.506540:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.508949:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053928192:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.508975:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3469312->3977215] (req 3469312->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.508989:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fce00, rc 0) 00000100:00100000:1.0:1746129813.509036:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31314:x1830949054116480:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9450us (9595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.509043:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14830 00000100:00100000:1.0:1746129813.510078:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053928320:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.510092:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fcc00/0x48868a4e43953811 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129813.511203:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.511266:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.511323:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054116992 00000100:00100000:1.0:1746129813.511329:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054116992 00000100:00100000:1.0:1746129813.511354:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14831 00000100:00100000:1.0:1746129813.511360:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054116992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129813.511376:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.511389:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fc800/0x48868a4e43953818 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35513c expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129813.511429:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053928448:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129813.511475:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.514646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.514662:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054117120 00000100:00100000:0.0:1746129813.514666:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054117120 00010000:00010000:0.0:1746129813.514683:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 32 pid: 3623 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.514698:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7382 00000100:00100000:0.0:1746129813.514703:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054117120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.514712:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.514719:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 32 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.514727:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 32 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.514742:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e439537e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3809280->3907583) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355119 expref: 32 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.514755:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.514757:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.514763:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.514769:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.514793:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.514802:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053928576:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129813.514838:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.517985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.518682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.518698:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054117248 00000100:00100000:0.0:1746129813.518702:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054117248 00000100:00100000:0.0:1746129813.518738:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054117376 00000100:00100000:0.0:1746129813.518740:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054117376 00000100:00100000:0.0:1746129813.518764:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14832 00000100:00100000:0.0:1746129813.518769:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054117248:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129813.518783:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.518795:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4395381f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355143 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.518830:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053928704:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129813.518931:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.519470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.519505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.519588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.519602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.519622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.520915:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054117888 00000100:00100000:0.0:1746129813.520919:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054117888 00002000:00100000:0.0:1746129813.520940:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3469312->3473407) req@ffff88009207f800 x1830949054117888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.520949:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f800 with x1830949054117888 ext(3469312->3473407) 00002000:00010000:0.0:1746129813.520952:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f800 00000100:00100000:0.0:1746129813.520963:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6608 00000100:00100000:0.0:1746129813.520968:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054117888:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129813.521070:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054117888:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 101us (1482us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129813.521076:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6608 00002000:00100000:0.0:1746129813.521080:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3469312->3473407) req@ffff88009207f800 x1830949054117888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.521087:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f800 with x1830949054117888 ext(3469312->3473407) 00002000:00010000:0.0:1746129813.521089:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f800 00000100:00100000:1.0:1746129813.522008:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053928704:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129813.522028:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4395381f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355143 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.522037:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08cc00/0x48868a4e4395381f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355143 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.522059:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08cc00, rc 0) 00000100:00100000:1.0:1746129813.522080:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054117248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3311us (4100us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129813.522086:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14832 00000100:00100000:0.0:1746129813.526884:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.526915:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.526934:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054118656 00000100:00100000:0.0:1746129813.526940:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054118656 00002000:00100000:0.0:1746129813.526969:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3973120->3977215) req@ffff88009c1c5180 x1830949054118656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.526977:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5180 with x1830949054118656 ext(3973120->3977215) 00002000:00010000:0.0:1746129813.526982:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c5180 00000100:00100000:0.0:1746129813.526997:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6609 00000100:00100000:0.0:1746129813.527003:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054118656:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129813.527133:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054118656:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (217us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129813.527138:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6609 00002000:00100000:0.0:1746129813.527143:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3973120->3977215) req@ffff88009c1c5180 x1830949054118656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.527149:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5180 with x1830949054118656 ext(3973120->3977215) 00002000:00010000:0.0:1746129813.527152:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c1c5180 00000100:00100000:1.0:1746129813.527396:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054118528 00000100:00100000:1.0:1746129813.527400:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054118528 00000100:00100000:1.0:1746129813.527421:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4510 00000100:00100000:1.0:1746129813.527426:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:31305:x1830949054118528:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129813.527550:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:31305:x1830949054118528:12345-192.168.204.31@tcp:35:cat.0 Request processed in 124us (704us total) trans 8589944851 rc 0/0 00000100:00100000:1.0:1746129813.527556:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4510 00000100:00100000:0.0:1746129813.531534:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.531619:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.534633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.536915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.538640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.538665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.538874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.539032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.539320:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14840 00000100:00100000:1.0:1746129813.539327:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054120192:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129813.539341:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539350:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318eac00/0x48868a4e43953785 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e8 expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539357:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318ebc00/0x48868a4e4395383b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35515f expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.539363:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318eb000/0x48868a4e43953793 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550f6 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539369:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4afe00/0x48868a4e43953604 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fec expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539374:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539379:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129813.539380:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129813.539381:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 8/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539394:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.539400:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 17 pid: 8435 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.539411:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053929472:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.541213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.541237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.541248:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054120064 00000100:00100000:0.0:1746129813.541252:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054120064 00000100:00100000:0.0:1746129813.541285:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054120320 00000100:00100000:0.0:1746129813.541288:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054120320 00000100:00100000:0.0:1746129813.541298:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14842 00000100:00100000:0.0:1746129813.541304:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054120064:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129813.541322:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.541337:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.541344:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.541351:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.541356:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.541357:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.541359:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.541373:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.541380:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 27 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.541389:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053930368:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129813.541424:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.541432:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 10 pid: 8435 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.541444:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053930496:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129813.541464:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.541471:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 17 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.541477:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053930624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.541488:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129813.541708:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14843 00000100:00100000:1.0:1746129813.541716:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054120320:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129813.541732:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd400/0x48868a4e43953896 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541741:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541746:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129813.541748:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129813.541750:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd400/0x48868a4e43953896 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541763:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 23 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541770:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 23 pid: 3623 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.541777:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053930752:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.541796:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746129813.541811:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4afe00/0x48868a4e43953604 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fec expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541822:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4afe00/0x48868a4e43953604 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354fec expref: 27 pid: 8437 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.541829:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053930880:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.541845:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801318eb000/0x48868a4e43953793 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550f6 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541871:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801318eb000/0x48868a4e43953793 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550f6 expref: 27 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.541878:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053931008:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.541905:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801318ebc00/0x48868a4e4395383b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35515f expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.541912:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801318ebc00/0x48868a4e4395383b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35515f expref: 10 pid: 3623 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746129813.541919:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053931136:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.541935:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801318eac00/0x48868a4e43953785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e8 expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.541942:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801318eac00/0x48868a4e43953785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e8 expref: 17 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.541953:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053931264:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.541964:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129813.548902:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053929088:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.551481:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053929856:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.551492:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053929984:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.551508:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053930368:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.551515:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053930496:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.551523:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053930624:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129813.551548:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.551567:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053930112:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129813.551578:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fa32800/0x48868a4e43953888 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.551597:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053929344:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.551603:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053930240:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129813.551616:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129813.551683:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053930752:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.551695:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800920fd400/0x48868a4e43953896 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129813.551712:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053929472:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.551718:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053930880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.551724:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053931008:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.551730:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053931136:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129813.551735:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053931264:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129813.551752:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.553057:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054120704 00000100:00100000:0.0:1746129813.553060:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054120704 00010000:00010000:0.0:1746129813.553075:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e4395328b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dca expref: 28 pid: 8436 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553096:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054120960 00000100:00100000:0.0:1746129813.553098:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054120960 00010000:00010000:0.0:1746129813.553106:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801318eb800/0x48868a4e43953826 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35514a expref: 10 pid: 20441 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553117:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054121216 00000100:00100000:0.0:1746129813.553119:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054121216 00010000:00010000:0.0:1746129813.553126:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880134ca6e00/0x48868a4e43953842 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355151 expref: 11 pid: 20441 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553133:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054121600 00000100:00100000:0.0:1746129813.553134:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054121600 00010000:00010000:0.0:1746129813.553140:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095119600/0x48868a4e4395377e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e1 expref: 31 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.553147:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054121856 00000100:00100000:0.0:1746129813.553150:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054121856 00010000:00010000:0.0:1746129813.553157:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 11 pid: 8435 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553164:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054120576 00000100:00100000:0.0:1746129813.553165:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054120576 00010000:00010000:0.0:1746129813.553171:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6400/0x48868a4e43953309 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e17 expref: 12 pid: 4589 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553179:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054120832 00000100:00100000:0.0:1746129813.553181:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054120832 00010000:00010000:0.0:1746129813.553187:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801318eb400/0x48868a4e439537d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550fd expref: 23 pid: 10930 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553193:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054121344 00000100:00100000:0.0:1746129813.553194:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054121344 00010000:00010000:0.0:1746129813.553200:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 18 pid: 8435 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.553207:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054121728 00000100:00100000:0.0:1746129813.553208:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054121728 00010000:00010000:0.0:1746129813.553215:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091c69400/0x48868a4e4395321b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d84 expref: 19 pid: 1140 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.553221:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054122240 00000100:00100000:0.0:1746129813.553223:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054122240 00010000:00010000:0.0:1746129813.553229:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 20 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.553241:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054122496 00000100:00100000:0.0:1746129813.553243:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054122496 00010000:00010000:0.0:1746129813.553270:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 29 pid: 10930 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.553280:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7385 00000100:00100000:0.0:1746129813.553285:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054120704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.553293:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.553306:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e4395328b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dca expref: 29 pid: 8436 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553312:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e4395328b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dca expref: 29 pid: 8436 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553323:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e4395328b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dca expref: 29 pid: 8436 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553333:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.553350:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054120704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.553355:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7385 00000100:00100000:0.0:1746129813.553365:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7386 00000100:00100000:0.0:1746129813.553369:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054120960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.553375:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.553384:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801318eb800/0x48868a4e43953826 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35514a expref: 11 pid: 20441 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553391:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801318eb800/0x48868a4e43953826 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35514a expref: 11 pid: 20441 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553401:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801318eb800/0x48868a4e43953826 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35514a expref: 11 pid: 20441 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553409:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.553421:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054120960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.553426:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7386 00000100:00100000:0.0:1746129813.553434:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7387 00000100:00100000:0.0:1746129813.553438:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054121216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.553443:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.553450:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880134ca6e00/0x48868a4e43953842 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355151 expref: 9 pid: 20441 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553456:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880134ca6e00/0x48868a4e43953842 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355151 expref: 9 pid: 20441 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.553465:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ca6e00/0x48868a4e43953842 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355151 expref: 9 pid: 20441 timeout: 859 lvb_type: 1 00000100:00100000:1.0:1746129813.553865:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7388 00000100:00100000:1.0:1746129813.553872:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054121600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.553878:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.553886:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095119600/0x48868a4e4395377e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e1 expref: 31 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.553893:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095119600/0x48868a4e4395377e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e1 expref: 31 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.553906:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095119600/0x48868a4e4395377e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550e1 expref: 31 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.553919:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.553921:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.553925:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.553933:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.553948:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.553966:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054121600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.553971:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7388 00000100:00100000:1.0:1746129813.553981:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7389 00000100:00100000:1.0:1746129813.553986:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054121856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.553991:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554000:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 12 pid: 8435 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554007:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 12 pid: 8435 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554017:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801318ea200/0x48868a4e4395382d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355158 expref: 12 pid: 8435 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554030:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554043:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054121856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554048:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7389 00000100:00100000:1.0:1746129813.554056:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7390 00000100:00100000:1.0:1746129813.554060:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054120576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.554065:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554071:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6400/0x48868a4e43953309 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e17 expref: 10 pid: 4589 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554078:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b6b6400/0x48868a4e43953309 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354e17 expref: 10 pid: 4589 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554087:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554098:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054120576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 38us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554102:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7390 00000100:00100000:1.0:1746129813.554110:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7391 00000100:00100000:1.0:1746129813.554113:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054120832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.554118:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554125:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801318eb400/0x48868a4e439537d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550fd expref: 23 pid: 10930 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554131:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801318eb400/0x48868a4e439537d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550fd expref: 23 pid: 10930 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554140:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801318eb400/0x48868a4e439537d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550fd expref: 23 pid: 10930 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554148:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554160:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054120832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554164:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7391 00000100:00100000:1.0:1746129813.554175:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7392 00000100:00100000:1.0:1746129813.554179:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054121344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.554184:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554192:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 20 pid: 8435 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554199:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 20 pid: 8435 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554208:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fe29400/0x48868a4e43953620 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355008 expref: 20 pid: 8435 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554214:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554226:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054121344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554231:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7392 00000100:00100000:1.0:1746129813.554240:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7393 00000100:00100000:1.0:1746129813.554244:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054121728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.554250:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554267:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091c69400/0x48868a4e4395321b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d84 expref: 18 pid: 1140 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554274:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091c69400/0x48868a4e4395321b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354d84 expref: 18 pid: 1140 timeout: 859 lvb_type: 1 00010000:00010000:1.0:1746129813.554283:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.554284:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.554286:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801318eb200/0x48868a4e43953873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554292:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801318eb200/0x48868a4e43953873 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554301:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554314:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054121728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554319:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7393 00000100:00100000:1.0:1746129813.554329:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7394 00000100:00100000:1.0:1746129813.554333:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054122240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.554338:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554344:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 17 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554351:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 17 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554364:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009536f200/0x48868a4e43953777 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550da expref: 17 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554371:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554381:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054122240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554384:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7394 00000100:00100000:1.0:1746129813.554393:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7395 00000100:00100000:1.0:1746129813.554397:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054122496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.554403:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.554409:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 27 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554416:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 27 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554424:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801318eae00/0x48868a4e4395378c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3550ef expref: 27 pid: 10930 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.554431:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.554433:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.554435:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554441:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554454:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.554464:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054122496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554468:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7395 00010000:00010000:1.0:1746129813.554490:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554497:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554514:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554520:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554525:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554530:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130a38a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129813.554533:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554539:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554550:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.554555:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a38a00/0x48868a4e4395388f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129813.554584:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054120064:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 13281us (13372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.554590:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14842 00010000:00010000:0.0:1746129813.554643:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.554654:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054121216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1216us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.554658:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7387 00010000:00010000:0.0:1746129813.554689:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554698:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554709:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554715:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554719:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554723:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880134ca7200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129813.554725:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554729:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554736:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.554741:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880134ca7200/0x48868a4e4395387a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129813.554764:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054119936:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 15642us (16098us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.554770:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14839 00000100:00100000:0.0:1746129813.554787:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054121088 00000100:00100000:0.0:1746129813.554791:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054121088 00002000:00100000:0.0:1746129813.554814:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3469312->3977215) req@ffff88009faf5f80 x1830949054121088/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.554822:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf5f80 with x1830949054121088 ext(3469312->3977215) 00010000:00010000:0.0:1746129813.554827:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 22 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.554835:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 22 pid: 3623 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746129813.554840:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf5f80 00000100:00100000:0.0:1746129813.554869:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1796 00000100:00100000:0.0:1746129813.554874:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054121088:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129813.555588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.555623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.556390:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129813.559331:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559339:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559355:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559361:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559367:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559372:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800920fc400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129813.559375:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559381:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559389:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.559394:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920fc400/0x48868a4e43953881 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129813.559450:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054120192:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 20122us (20574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.559457:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14840 00000100:00100000:0.0:1746129813.564794:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054121088:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9911us (11634us total) trans 17179873980 rc 0/0 00000100:00100000:0.0:1746129813.564805:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1796 00002000:00100000:0.0:1746129813.564815:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3469312->3977215) req@ffff88009faf5f80 x1830949054121088/t17179873980(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/448 e 0 to 0 dl 1746129824 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.564824:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf5f80 with x1830949054121088 ext(3469312->3977215) 00010000:00010000:0.0:1746129813.564834:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.564860:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746129813.564866:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faf5f80 00000100:00100000:1.0:1746129813.568776:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054122752 00000100:00100000:1.0:1746129813.568785:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054122752 00010000:00010000:1.0:1746129813.568813:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.568836:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7401 00000100:00100000:1.0:1746129813.568842:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054122752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.568918:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.568938:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.568950:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.568972:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e439537f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3469312->3977215) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35512e expref: 24 pid: 3623 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.568983:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.568984:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.568987:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd400/0x48868a4e43953896 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.568992:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd400/0x48868a4e43953896 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.569014:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.569475:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054122752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 632us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.569481:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7401 00000100:00100000:0.0:1746129813.575843:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.575883:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.575914:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.576320:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054123648 00000100:00100000:1.0:1746129813.576324:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054123648 00000100:00100000:1.0:1746129813.576345:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4512 00000100:00100000:1.0:1746129813.576350:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:23993:x1830949054123648:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129813.576489:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:23993:x1830949054123648:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 138us (574us total) trans 8589944855 rc 0/0 00000100:00100000:1.0:1746129813.576494:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4512 00000100:00100000:1.0:1746129813.576958:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054123264 00000100:00100000:1.0:1746129813.576962:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054123264 00010000:00010000:1.0:1746129813.576973:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35c00/0x48868a4e439534ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f59 expref: 25 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.576996:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7404 00000100:00100000:1.0:1746129813.577001:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054123264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129813.577448:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.577460:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054123776 00000100:00100000:0.0:1746129813.577463:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054123776 00010000:00010000:0.0:1746129813.577544:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 301 pid: 14315 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746129813.577567:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7405 00000100:00100000:0.0:1746129813.577572:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1961:x1830949054123776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.577578:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.577582:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 301 pid: 14315 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.577588:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 301 pid: 14315 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.577600:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439532bc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354dfb expref: 301 pid: 14315 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.577750:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129813.577756:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa32400/0x48868a4e4395389d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129813.577762:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.577785:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949054123776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.577790:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7405 00010000:00010000:1.0:1746129813.577803:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.577810:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35c00/0x48868a4e439534ec lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f59 expref: 25 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.577818:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35c00/0x48868a4e439534ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f59 expref: 25 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.577833:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c35c00/0x48868a4e439534ec lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354f59 expref: 25 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.577841:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.577844:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa32400/0x48868a4e4395389d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.577865:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.577880:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054123264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 880us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.577885:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7404 00000100:00100000:0.0:1746129813.577912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.577920:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054123904 00000100:00100000:1.0:1746129813.577922:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054123904 00010000:00010000:1.0:1746129813.577930:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354df4 expref: 24 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.577947:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7406 00000100:00100000:1.0:1746129813.577951:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054123904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.577957:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.577960:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354df4 expref: 24 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.577966:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354df4 expref: 24 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.577975:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e2aa800/0x48868a4e439532b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354df4 expref: 24 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.577981:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.577984:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa32400/0x48868a4e4395389d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.577988:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.578002:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054123904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.578006:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7406 00000100:00100000:0.0:1746129813.578693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.579195:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054124032 00000100:00100000:1.0:1746129813.579202:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054124032 00010000:00010000:1.0:1746129813.579221:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e439533fe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354eb1 expref: 23 pid: 14314 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.579253:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7407 00000100:00100000:1.0:1746129813.579269:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054124032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.579279:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.579283:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e439533fe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354eb1 expref: 23 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.579296:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e439533fe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354eb1 expref: 23 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.579310:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e439533fe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf354eb1 expref: 23 pid: 14314 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.579320:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.579324:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa32400/0x48868a4e4395389d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.579331:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa32400/0x48868a4e4395389d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.579337:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa32400/0x48868a4e4395389d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.579363:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.579401:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054124032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.579407:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7407 00000001:00080000:0.0:1746129813.607535:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944841 is committed 00000001:00080000:0.0:1746129813.607543:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944838 is committed 00000001:00080000:0.0:1746129813.607548:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944855 is committed 00000001:00080000:0.0:1746129813.607553:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944851 is committed 00000001:00080000:0.0:1746129813.607558:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944845 is committed 00000001:00080000:0.0:1746129813.607596:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944856 is committed 00000004:00080000:0.0:1746129813.607599:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2591 committed 00000004:00080000:0.0:1746129813.607605:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2578 committed 00000004:00080000:0.0:1746129813.607622:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2577 committed 00000004:00080000:0.0:1746129813.607624:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2576 committed 00000004:00080000:0.0:1746129813.607625:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2575 committed 00000004:00080000:0.0:1746129813.607627:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2590 committed 00000004:00080000:0.0:1746129813.607628:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2574 committed 00000004:00080000:0.0:1746129813.607629:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2589 committed 00000004:00080000:0.0:1746129813.607631:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2573 committed 00000004:00080000:0.0:1746129813.607632:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2588 committed 00000004:00080000:0.0:1746129813.607633:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2587 committed 00000004:00080000:0.0:1746129813.607635:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2586 committed 00000004:00080000:0.0:1746129813.607636:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2572 committed 00000004:00080000:0.0:1746129813.607638:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2571 committed 00000004:00080000:0.0:1746129813.607639:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2585 committed 00000004:00080000:0.0:1746129813.607641:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2584 committed 00000004:00080000:0.0:1746129813.607642:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2570 committed 00000100:00100000:0.0:1746129813.607691:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053932416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129813.607782:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053932544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.607921:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.607951:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053932928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.607965:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.607976:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.607988:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.607997:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.608008:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.608018:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129813.608022:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.608033:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.608042:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.608052:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1746129813.608067:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129813.608069:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129813.608349:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608361:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129813.608375:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608381:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129813.608391:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608396:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053934080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129813.608407:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608413:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129813.608416:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053932160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129813.608426:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608430:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053932672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129813.608439:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608444:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129813.608453:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608457:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129813.608466:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.608477:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053932544 00000100:00100000:1.0:1746129813.608479:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053932544 00000100:00100000:0.0:1746129813.608668:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14845 00000100:00100000:0.0:1746129813.608673:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949053932288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.608753:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949053932288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (810us total) trans 21474841168 rc 0/0 00000100:00100000:0.0:1746129813.608758:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14845 00000100:00100000:0.0:1746129813.608767:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053933568 00000100:00100000:0.0:1746129813.608769:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053933568 00000100:00100000:0.0:1746129813.608776:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053934080 00000100:00100000:0.0:1746129813.608777:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053934080 00000100:00100000:0.0:1746129813.608781:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053932160 00000100:00100000:0.0:1746129813.608782:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053932160 00000100:00100000:0.0:1746129813.608787:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053932672 00000100:00100000:0.0:1746129813.608788:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053932672 00000100:00100000:0.0:1746129813.608792:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053933184 00000100:00100000:0.0:1746129813.608793:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053933184 00000100:00100000:0.0:1746129813.608796:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053933696 00000100:00100000:0.0:1746129813.608797:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053933696 00000100:00100000:0.0:1746129813.608802:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14846 00000100:00100000:0.0:1746129813.608805:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053932928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129813.608872:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129813.608875:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129813.608876:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129813.608878:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129813.608879:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129813.608897:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053932928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (930us total) trans 21474841169 rc 0/0 00000100:00100000:0.0:1746129813.608901:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14846 00000100:00100000:0.0:1746129813.608910:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14847 00000100:00100000:0.0:1746129813.608915:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053933440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.609010:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053933440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (1019us total) trans 17179873981 rc 0/0 00000100:00100000:0.0:1746129813.609014:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14847 00000100:00100000:0.0:1746129813.609024:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14848 00000100:00100000:0.0:1746129813.609028:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053933952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.609094:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053933952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (1085us total) trans 17179873982 rc 0/0 00000100:00100000:0.0:1746129813.609099:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14848 00000100:00100000:0.0:1746129813.609107:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14849 00000100:00100000:0.0:1746129813.609111:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053933312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.609182:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053933312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1148us total) trans 17179873983 rc 0/0 00000100:00100000:0.0:1746129813.609187:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14849 00000100:00100000:0.0:1746129813.609195:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14850 00000100:00100000:0.0:1746129813.609199:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949053933824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.609277:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949053933824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1222us total) trans 17179873984 rc 0/0 00000100:00100000:0.0:1746129813.609281:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14850 00000100:00100000:0.0:1746129813.609292:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14851 00000100:00100000:0.0:1746129813.609296:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053933568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.609367:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053933568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (974us total) trans 17179873985 rc 0/0 00000100:00100000:0.0:1746129813.609372:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14851 00000100:00100000:0.0:1746129813.609381:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14853 00000100:00100000:0.0:1746129813.609384:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053932160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.609456:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949053932160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1029us total) trans 21474841170 rc 0/0 00000100:00100000:0.0:1746129813.609461:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14853 00000100:00100000:0.0:1746129813.609469:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14855 00000100:00100000:0.0:1746129813.609473:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3298:x1830949053933184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.609543:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3298:x1830949053933184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (1089us total) trans 17179873987 rc 0/0 00000100:00100000:0.0:1746129813.609548:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14855 00000004:00080000:0.0:1746129813.609578:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adb800/2, rc 0, transno 17179873983 00000100:00100000:0.0:1746129813.609583:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.609590:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd3b80/2, rc 0, transno 17179873984 00000100:00100000:0.0:1746129813.609592:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.609599:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4e00/2, rc 0, transno 21474841169 00000100:00100000:0.0:1746129813.609604:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053932928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.609610:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adb480/2, rc 0, transno 17179873981 00000100:00100000:0.0:1746129813.609612:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.609617:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423e680/2, rc 0, transno 17179873982 00000100:00100000:0.0:1746129813.609619:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053933952:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.609624:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4700/2, rc 0, transno 21474841167 00000100:00100000:0.0:1746129813.609626:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053932416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.609656:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053934208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.609674:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129813.610729:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14859 00000100:00100000:1.0:1746129813.610737:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949053932544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129813.610841:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3298:x1830949053932544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (2492us total) trans 21474841174 rc 0/0 00000100:00100000:1.0:1746129813.610863:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14859 00000004:00080000:1.0:1746129813.610966:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6d80/2, rc 0, transno 21474841170 00000100:00100000:1.0:1746129813.610970:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053932160:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129813.610978:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5880/2, rc 0, transno 21474841171 00000100:00100000:1.0:1746129813.610981:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053932672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129813.610987:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad8a80/2, rc 0, transno 17179873987 00000100:00100000:1.0:1746129813.610989:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129813.610995:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd3100/2, rc 0, transno 17179873988 00000100:00100000:1.0:1746129813.610998:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933696:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129813.611004:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6300/2, rc 0, transno 21474841174 00000100:00100000:1.0:1746129813.611006:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053932544:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129813.611012:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adad80/2, rc 0, transno 17179873985 00000100:00100000:1.0:1746129813.611014:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933568:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129813.611020:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423c000/2, rc 0, transno 17179873986 00000100:00100000:1.0:1746129813.611022:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053934080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129813.611527:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4000/2, rc 0, transno 21474841175 00000100:00100000:1.0:1746129813.611531:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053933056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.611875:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3100/2, rc 0, transno 21474841173 00000100:00100000:0.0:1746129813.611879:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053934208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.614383:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.615040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.616884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.618698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.618774:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.619063:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054124672 00000100:00100000:1.0:1746129813.619067:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054124672 00000100:00100000:1.0:1746129813.619090:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14861 00000100:00100000:1.0:1746129813.619429:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054124672:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129813.619439:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.619450:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355190 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129813.619467:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d393, atime: 0x6813d391, ctime: 0x6813d393, blocks: 0x7e7 00010000:00010000:1.0:1746129813.619478:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.619480:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.619486:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355190 expref: 6 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.619501:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355190 expref: 6 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.619513:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4ce00, rc 0) 00000100:00100000:1.0:1746129813.620451:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054124672:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 1352us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.620458:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14861 00000100:00100000:0.0:1746129813.620608:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.620732:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054124928 00000100:00100000:1.0:1746129813.620737:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054124928 00000100:00100000:1.0:1746129813.620757:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14862 00000100:00100000:1.0:1746129813.620763:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054124928:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129813.620772:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.620783:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4d800/0x48868a4e439538f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35519e expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129813.620798:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d395, atime: 0x6813d395, ctime: 0x6813d395, blocks: 0x821 00010000:00010000:1.0:1746129813.620808:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.620809:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.620815:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4d800/0x48868a4e439538f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35519e expref: 6 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.620826:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4d800/0x48868a4e439538f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35519e expref: 6 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.620832:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4d800, rc 0) 00000100:00100000:1.0:1746129813.620874:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054124928:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 111us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.620880:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14862 00000100:00100000:0.0:1746129813.621605:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.621632:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.621696:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.621733:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.622166:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14864 00000100:00100000:1.0:1746129813.622173:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054125312:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129813.622181:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.622192:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4c400/0x48868a4e439538ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3551b3 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129813.622206:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d395, atime: 0x6813d395, ctime: 0x6813d395, blocks: 0x15e9 00010000:00010000:1.0:1746129813.622215:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.622216:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.622221:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4c400/0x48868a4e439538ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551b3 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.622231:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4c400/0x48868a4e439538ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551b3 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.622238:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4c400, rc 0) 00000100:00100000:1.0:1746129813.622267:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054125312:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 83us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.622273:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14864 00000100:00100000:1.0:1746129813.622285:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14866 00000100:00100000:1.0:1746129813.622290:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054125440:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129813.622296:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.622303:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc800/0x48868a4e4395390d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3551ba expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129813.622313:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d396, atime: 0x6813d396, ctime: 0x6813d396, blocks: 0x102b 00010000:00010000:1.0:1746129813.622322:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.622324:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129813.622327:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc800/0x48868a4e4395390d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ba expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.622335:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc800/0x48868a4e4395390d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ba expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129813.622341:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbc800, rc 0) 00000100:00100000:1.0:1746129813.622356:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054125440:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 66us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.622361:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14866 00000100:00100000:0.0:1746129813.623350:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14870 00000100:00100000:0.0:1746129813.623357:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054125952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129813.623363:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.623369:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3551d6 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.623379:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.623381:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.623385:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551d6 expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.623394:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551d6 expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.623400:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca7e00, rc 0) 00000100:00100000:0.0:1746129813.623414:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054125952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.623420:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14870 00000100:00100000:0.0:1746129813.623510:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14871 00000100:00100000:0.0:1746129813.623515:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054126080:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129813.623521:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.623527:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca7c00/0x48868a4e43953929 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3551dd expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.623537:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.623538:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.623541:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca7c00/0x48868a4e43953929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551dd expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.623548:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eca7c00/0x48868a4e43953929 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551dd expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.623555:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca7c00, rc 0) 00000100:00100000:0.0:1746129813.623572:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054126080:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.623577:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14871 00000100:00100000:0.0:1746129813.623585:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14872 00000100:00100000:0.0:1746129813.623590:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054126208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129813.623594:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.623600:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3551e4 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.623609:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.623615:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.623618:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551e4 expref: 26 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.623626:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551e4 expref: 26 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.623637:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca7200, rc 0) 00000100:00100000:0.0:1746129813.623656:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054126208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 66us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.623660:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14872 00000100:00100000:0.0:1746129813.636881:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.636979:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.636991:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.637013:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.671843:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.676651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.677196:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054127616 00000100:00100000:1.0:1746129813.677202:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054127616 00010000:00010000:1.0:1746129813.677228:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953865 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355174 expref: 9 pid: 15044 timeout: 859 lvb_type: 0 00000100:00100000:1.0:1746129813.677271:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7408 00000100:00100000:1.0:1746129813.677278:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054127616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129813.677287:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129813.677291:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953865 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355174 expref: 9 pid: 15044 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.677300:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953865 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355174 expref: 9 pid: 15044 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.677317:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953865 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355174 expref: 9 pid: 15044 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.677349:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129813.677353:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd800/0x48868a4e43953953 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.677361:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd800/0x48868a4e43953953 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.677366:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fd800/0x48868a4e43953953 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.677393:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129813.677425:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054127616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 148us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.677431:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7408 00000100:00100000:0.0:1746129813.686626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.687280:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.687409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.689897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.691059:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6617 00000100:00100000:0.0:1746129813.691065:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054128384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.721393:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054128384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30315us (31487us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129813.721404:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6617 00002000:00100000:0.0:1746129813.721414:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095243480 x1830949054128384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.721423:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243480 with x1830949054128384 ext(2097152->3145727) 00002000:00010000:0.0:1746129813.721427:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243480 00000100:00100000:0.0:1746129813.725554:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.731237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.754931:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.755021:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.755118:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054129536 00000100:00100000:1.0:1746129813.755126:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054129536 00000100:00100000:0.0:1746129813.765350:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.766430:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.770128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.770156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.770210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.771160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.771312:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054130560 00000100:00100000:1.0:1746129813.771316:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054130560 00000100:00100000:1.0:1746129813.771338:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10887 00000100:00100000:1.0:1746129813.771498:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31330:x1830949054130560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129813.771516:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129813.771526:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba5a200/0x48868a4e439539bc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35520e expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129813.771585:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba5a000/0x48868a4e439539c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.772305:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129813.772313:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba5a000/0x48868a4e439539c3 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129813.772324:0:15044:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 5/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129813.772331:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba5a000/0x48868a4e439539c3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129813.800194:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054130688 00000100:00100000:0.0:1746129813.800201:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054130688 00000100:00100000:0.0:1746129813.800234:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10888 00000100:00100000:0.0:1746129813.800241:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31325:x1830949054130688:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129813.800270:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.800286:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355215 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.800333:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355215 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.800343:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355215 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.800353:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129813.800356:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129813.800358:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355215 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.800368:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009510dc00, rc 0) 00000100:00100000:0.0:1746129813.800402:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31325:x1830949054130688:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 162us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.800407:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10888 00000001:00080000:0.0:1746129813.802118:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944861 is committed 00000001:00080000:0.0:1746129813.802132:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944857 is committed 00000001:00080000:0.0:1746129813.802138:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944862 is committed 00000004:00080000:0.0:1746129813.802141:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2599 committed 00000004:00080000:0.0:1746129813.802148:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2587 committed 00000004:00080000:0.0:1746129813.802152:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2586 committed 00000004:00080000:0.0:1746129813.802153:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2585 committed 00000004:00080000:0.0:1746129813.802155:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2584 committed 00000004:00080000:0.0:1746129813.802156:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2598 committed 00000004:00080000:0.0:1746129813.802157:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2583 committed 00000004:00080000:0.0:1746129813.802159:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2597 committed 00000004:00080000:0.0:1746129813.802160:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2582 committed 00000004:00080000:0.0:1746129813.802161:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2596 committed 00000004:00080000:0.0:1746129813.802163:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2595 committed 00000004:00080000:0.0:1746129813.802164:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2594 committed 00000004:00080000:0.0:1746129813.802166:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2581 committed 00000004:00080000:0.0:1746129813.802167:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2580 committed 00000004:00080000:0.0:1746129813.802169:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2593 committed 00000004:00080000:0.0:1746129813.802170:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2592 committed 00000004:00080000:0.0:1746129813.802172:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2579 committed 00000001:00080000:0.0:1746129813.802174:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944860 is committed 00000100:00100000:0.0:1746129813.802366:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053934976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802417:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802441:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053935488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802456:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802466:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802480:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802490:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802502:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802517:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746129813.802522:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053934848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802536:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802547:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053935360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802559:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802569:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053935872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802588:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802597:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802610:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802626:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935104:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802642:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802652:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802665:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802674:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802687:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802696:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802707:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802718:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746129813.802722:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802735:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802741:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.802753:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802759:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802770:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802776:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.802789:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.802807:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053934976 00000100:00100000:0.0:1746129813.802812:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053934976 00000100:00100000:0.0:1746129813.802834:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935488 00000100:00100000:0.0:1746129813.802835:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935488 00000100:00100000:0.0:1746129813.802842:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936000 00000100:00100000:0.0:1746129813.802843:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936000 00000100:00100000:0.0:1746129813.802868:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936512 00000100:00100000:0.0:1746129813.802870:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936512 00000100:00100000:0.0:1746129813.802874:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053934848 00000100:00100000:0.0:1746129813.802875:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053934848 00000100:00100000:0.0:1746129813.802879:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935360 00000100:00100000:0.0:1746129813.802881:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935360 00000100:00100000:0.0:1746129813.802885:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935872 00000100:00100000:0.0:1746129813.802887:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935872 00000100:00100000:0.0:1746129813.802891:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936384 00000100:00100000:0.0:1746129813.802892:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936384 00000100:00100000:0.0:1746129813.802896:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935104 00000100:00100000:0.0:1746129813.802897:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935104 00000100:00100000:0.0:1746129813.802902:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935616 00000100:00100000:0.0:1746129813.802902:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935616 00000100:00100000:0.0:1746129813.802907:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936128 00000100:00100000:0.0:1746129813.802908:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936128 00000100:00100000:0.0:1746129813.802911:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936640 00000100:00100000:0.0:1746129813.802913:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936640 00000100:00100000:0.0:1746129813.802917:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935232 00000100:00100000:0.0:1746129813.802918:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935232 00000100:00100000:0.0:1746129813.802921:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053935744 00000100:00100000:0.0:1746129813.802922:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053935744 00000100:00100000:0.0:1746129813.802925:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936256 00000100:00100000:0.0:1746129813.802926:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936256 00000100:00100000:0.0:1746129813.802929:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936768 00000100:00100000:0.0:1746129813.802930:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936768 00000100:00100000:0.0:1746129813.802937:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14873 00000100:00100000:0.0:1746129813.802943:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053934976:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129813.803080:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129813.803083:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803084:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803086:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803087:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129813.803110:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053934976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (694us total) trans 17179873989 rc 0/0 00000100:00100000:0.0:1746129813.803115:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14873 00000100:00100000:0.0:1746129813.803126:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14874 00000100:00100000:0.0:1746129813.803129:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053935488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.803188:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053935488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (732us total) trans 17179873990 rc 0/0 00000100:00100000:0.0:1746129813.803193:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14874 00000100:00100000:0.0:1746129813.803199:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14875 00000100:00100000:0.0:1746129813.803202:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053936000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129813.803308:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129813.803310:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803312:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803314:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803315:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746129813.803332:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053936000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (851us total) trans 21474841176 rc 0/0 00000100:00100000:0.0:1746129813.803336:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14875 00000100:00100000:0.0:1746129813.803343:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14876 00000100:00100000:0.0:1746129813.803346:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053936512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.803405:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053936512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (902us total) trans 21474841177 rc 0/0 00000100:00100000:0.0:1746129813.803409:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14876 00000100:00100000:0.0:1746129813.803415:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14877 00000100:00100000:0.0:1746129813.803418:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053934848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129813.803469:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129813.803471:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803472:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803474:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.803476:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129813.803488:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053934848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (951us total) trans 17179873991 rc 0/0 00000100:00100000:0.0:1746129813.803492:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14877 00000100:00100000:0.0:1746129813.803498:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14878 00000100:00100000:0.0:1746129813.803502:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3297:x1830949053935360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.803553:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053935360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (993us total) trans 17179873992 rc 0/0 00000100:00100000:0.0:1746129813.803560:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14878 00000100:00100000:0.0:1746129813.803566:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14879 00000100:00100000:0.0:1746129813.803569:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053935872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129813.803615:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129813.803617:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129813.803619:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129809 00002000:00010000:0.0:1746129813.803620:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129813.803622:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746129813.803634:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053935872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1046us total) trans 21474841178 rc 0/0 00000100:00100000:0.0:1746129813.803638:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14879 00000100:00100000:0.0:1746129813.803741:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14880 00000100:00100000:0.0:1746129813.803744:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053936384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.803803:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053936384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1191us total) trans 21474841179 rc 0/0 00000100:00100000:0.0:1746129813.803807:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14880 00000100:00100000:0.0:1746129813.803815:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14881 00000100:00100000:0.0:1746129813.803819:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053935104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129813.803898:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129813.803900:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129814 -> 1746129814 00002000:00010000:0.0:1746129813.803902:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129814 -> 1746129814 00002000:00010000:0.0:1746129813.803903:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129814 -> 1746129814 00002000:00010000:0.0:1746129813.803905:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746129813.803924:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053935104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (1281us total) trans 17179873993 rc 0/0 00000100:00100000:0.0:1746129813.803928:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14881 00000100:00100000:0.0:1746129813.803936:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14882 00000100:00100000:0.0:1746129813.803940:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053935616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.804005:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053935616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1339us total) trans 17179873994 rc 0/0 00000100:00100000:0.0:1746129813.804009:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14882 00000100:00100000:0.0:1746129813.804016:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14883 00000100:00100000:0.0:1746129813.804020:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053936128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129813.804068:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:0.0:1746129813.804070:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.804071:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.804073:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129813.804074:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:0.0:1746129813.804089:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053936128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (1400us total) trans 21474841180 rc 0/0 00000100:00100000:0.0:1746129813.804093:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14883 00000100:00100000:0.0:1746129813.804099:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14884 00000100:00100000:0.0:1746129813.804102:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053936640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129813.804153:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129813.804155:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129813.804157:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129813.804159:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129813.804160:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129813.804175:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053936640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1467us total) trans 21474841181 rc 0/0 00000100:00100000:0.0:1746129813.804180:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14884 00000100:00100000:0.0:1746129813.804187:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14885 00000100:00100000:0.0:1746129813.804190:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053935232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.804246:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053935232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (1510us total) trans 17179873995 rc 0/0 00000100:00100000:0.0:1746129813.804260:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14885 00000100:00100000:0.0:1746129813.804268:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14886 00000100:00100000:0.0:1746129813.804271:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053935744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129813.804325:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3298:x1830949053935744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1571us total) trans 17179873996 rc 0/0 00000100:00100000:0.0:1746129813.804329:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14886 00000100:00100000:0.0:1746129813.804335:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14887 00000100:00100000:0.0:1746129813.804338:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053936256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.804395:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053936256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1623us total) trans 21474841182 rc 0/0 00000100:00100000:0.0:1746129813.804399:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14887 00000100:00100000:0.0:1746129813.804407:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14888 00000100:00100000:0.0:1746129813.804411:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053936768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.804470:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053936768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (1680us total) trans 21474841183 rc 0/0 00000100:00100000:0.0:1746129813.804475:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14888 00000004:00080000:0.0:1746129813.804632:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e4380/2, rc 0, transno 17179873995 00000100:00100000:0.0:1746129813.804638:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804646:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e5880/2, rc 0, transno 17179873996 00000100:00100000:0.0:1746129813.804650:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804656:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7b80/2, rc 0, transno 21474841182 00000100:00100000:0.0:1746129813.804665:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804671:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e6680/2, rc 0, transno 21474841183 00000100:00100000:0.0:1746129813.804674:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936768:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804679:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242680/2, rc 0, transno 17179873993 00000100:00100000:0.0:1746129813.804681:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935104:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804687:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e4e00/2, rc 0, transno 17179873994 00000100:00100000:0.0:1746129813.804690:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053935616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804695:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e4700/2, rc 0, transno 21474841180 00000100:00100000:0.0:1746129813.804697:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936128:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804701:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e5f80/2, rc 0, transno 21474841181 00000100:00100000:0.0:1746129813.804703:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053936640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804772:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242300/2, rc 0, transno 17179873991 00000100:00100000:0.0:1746129813.804775:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053934848:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804782:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e5180/2, rc 0, transno 17179873992 00000100:00100000:0.0:1746129813.804784:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053935360:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804791:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e6300/2, rc 0, transno 21474841178 00000100:00100000:0.0:1746129813.804793:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053935872:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804799:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e6d80/2, rc 0, transno 21474841179 00000100:00100000:0.0:1746129813.804801:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804808:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242d80/2, rc 0, transno 17179873989 00000100:00100000:0.0:1746129813.804811:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053934976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804818:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e4a80/2, rc 0, transno 17179873990 00000100:00100000:0.0:1746129813.804820:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053935488:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129813.804827:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7480/2, rc 0, transno 21474841176 00000100:00100000:0.0:1746129813.804829:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936000:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129813.804835:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7100/2, rc 0, transno 21474841177 00000100:00100000:0.0:1746129813.804838:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.804843:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129813.804871:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.804896:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129813.804932:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053936896 00000100:00100000:0.0:1746129813.804937:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053936896 00000100:00100000:0.0:1746129813.804953:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14889 00000100:00100000:0.0:1746129813.804958:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053936896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129813.805038:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053936896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (141us total) trans 21474841184 rc 0/0 00000100:00100000:0.0:1746129813.805042:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14889 00000004:00080000:0.0:1746129813.805060:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5880/2, rc 0, transno 21474841184 00000100:00100000:0.0:1746129813.805064:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053936896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129813.813780:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054130944 00000100:00100000:1.0:1746129813.813791:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054130944 00000100:00100000:1.0:1746129813.813942:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4514 00000100:00100000:1.0:1746129813.813949:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31325:x1830949054130944:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:1.0:1746129813.814054:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba7dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31325:x1830949054130944:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 105us (3877us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129813.814060:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4514 00000100:00100000:0.0:1746129813.819180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.822077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.822874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.826419:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.828430:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.830879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.830910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.830939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.830952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.831294:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6621 00000100:00100000:1.0:1746129813.831302:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054133120:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129813.831366:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6622 00000100:00100000:1.0:1746129813.831370:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054133376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.834120:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.834136:0:21604:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054133888 00000100:00100000:0.0:1746129813.834140:0:21604:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054133888 00002000:00100000:0.0:1746129813.834166:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3686400->3690495) req@ffff8800a55a5c00 x1830949054133888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.834175:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5c00 with x1830949054133888 ext(3686400->3690495) 00010000:00010000:0.0:1746129813.834182:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 31 pid: 7976 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.834194:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 31 pid: 7976 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746129813.834200:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a5c00 00000100:00100000:0.0:1746129813.834222:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1797 00000100:00100000:0.0:1746129813.834228:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054133888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129813.834331:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054133888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 102us (214us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129813.834336:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1797 00002000:00100000:0.0:1746129813.834341:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3f0:0x0] (3686400->3690495) req@ffff8800a55a5c00 x1830949054133888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129813.834346:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5c00 with x1830949054133888 ext(3686400->3690495) 00010000:00010000:0.0:1746129813.834350:0:21604:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 31 pid: 7976 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746129813.834359:0:21604:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 31 pid: 7976 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746129813.834364:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a55a5c00 00000100:00100000:1.0:1746129813.843178:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054133120:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11868us (12258us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129813.843189:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6621 00002000:00100000:1.0:1746129813.843199:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a55a7100 x1830949054133120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.843214:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a7100 with x1830949054133120 ext(1048576->2097151) 00002000:00010000:1.0:1746129813.843220:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a7100 00000100:00100000:1.0:1746129813.850864:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054133376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19476us (19908us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129813.850870:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6622 00002000:00100000:1.0:1746129813.850875:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a55a6d80 x1830949054133376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.850882:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a6d80 with x1830949054133376 ext(1048576->2097151) 00002000:00010000:1.0:1746129813.850885:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a55a6d80 00000100:00100000:0.0:1746129813.854190:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.854286:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.854910:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054132864:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23793us (24064us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129813.854919:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6620 00002000:00100000:1.0:1746129813.854929:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a55a6680 x1830949054132864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.854937:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a6680 with x1830949054132864 ext(0->1048575) 00002000:00010000:1.0:1746129813.854942:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a6680 00000100:00100000:1.0:1746129813.854960:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054134400 00000100:00100000:1.0:1746129813.854965:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054134400 00002000:00100000:1.0:1746129813.854989:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3461120->3690495) req@ffff88013061ca80 x1830949054134400/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.854996:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061ca80 with x1830949054134400 ext(3461120->3690495) 00010000:00010000:1.0:1746129813.855002:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 27 pid: 7976 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.855563:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 27 pid: 7976 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746129813.855570:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013061ca80 00000100:00100000:1.0:1746129813.855621:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1798 00000100:00100000:1.0:1746129813.855628:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054134400:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129813.859429:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054134400:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3792us (5133us total) trans 21474841185 rc 0/0 00000100:00100000:1.0:1746129813.859440:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1798 00002000:00100000:1.0:1746129813.859449:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3461120->3690495) req@ffff88013061ca80 x1830949054134400/t21474841185(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/448 e 0 to 0 dl 1746129824 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.859457:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013061ca80 with x1830949054134400 ext(3461120->3690495) 00010000:00010000:1.0:1746129813.859465:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 29 pid: 7976 timeout: 859 lvb_type: 0 00010000:00010000:1.0:1746129813.859478:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa33600/0x48868a4e439539fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3461120->3690495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355223 expref: 29 pid: 7976 timeout: 859 lvb_type: 0 00002000:00010000:1.0:1746129813.859484:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013061ca80 00000100:00100000:0.0:1746129813.863720:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.867529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.868427:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054134784 00000100:00100000:1.0:1746129813.868436:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054134784 00002000:00100000:1.0:1746129813.868476:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2830336->2834431) req@ffff880094a4e680 x1830949054134784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.868486:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e680 with x1830949054134784 ext(2830336->2834431) 00002000:00010000:1.0:1746129813.868491:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e680 00000100:00100000:1.0:1746129813.868872:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6624 00000100:00100000:1.0:1746129813.868881:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054134784:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129813.869037:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054134784:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 157us (1513us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129813.869044:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6624 00002000:00100000:1.0:1746129813.869049:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2830336->2834431) req@ffff880094a4e680 x1830949054134784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.869056:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e680 with x1830949054134784 ext(2830336->2834431) 00002000:00010000:1.0:1746129813.869059:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e680 00000100:00100000:0.0:1746129813.877517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.878562:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.878586:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054135040 00000100:00100000:0.0:1746129813.878588:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054135040 00000100:00100000:0.0:1746129813.878604:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14899 00000100:00100000:0.0:1746129813.878609:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31325:x1830949054135040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129813.878616:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129813.878624:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9400/0x48868a4e43953a17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355262 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.878639:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc800/0x48868a4e4395390d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ba expref: 7 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.878645:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba79200/0x48868a4e43953a02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35524d expref: 31 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.878651:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551e4 expref: 27 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.878660:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.878661:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129813.878663:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00a9400/0x48868a4e43953a17 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355262 expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129813.878676:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551e4 expref: 27 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129813.878684:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551e4 expref: 27 pid: 1140 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.878691:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053938048:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129813.885142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.885627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.885638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.885650:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054135296 00000100:00100000:0.0:1746129813.885653:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054135296 00010000:00010000:0.0:1746129813.886073:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008eca7200/0x48868a4e43953930 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551e4 expref: 28 pid: 1140 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746129813.886090:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7417 00000100:00100000:0.0:1746129813.886095:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054135552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129813.886102:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129813.886110:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc800/0x48868a4e4395390d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ba expref: 8 pid: 1877 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.886123:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ffbc800/0x48868a4e4395390d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ba expref: 8 pid: 1877 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746129813.886135:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129813.886148:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054135552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129813.886154:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7417 00000100:00100000:0.0:1746129813.893394:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.893803:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054135808 00000100:00100000:1.0:1746129813.893809:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054135808 00002000:00100000:1.0:1746129813.893844:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2523136->2527231) req@ffff880094a4c380 x1830949054135808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.893871:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949054135808 ext(2523136->2527231) 00002000:00010000:1.0:1746129813.893875:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:1.0:1746129813.893902:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6625 00000100:00100000:1.0:1746129813.893908:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054135808:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129813.894024:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054135808:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 116us (638us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129813.894030:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6625 00002000:00100000:1.0:1746129813.894036:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2523136->2527231) req@ffff880094a4c380 x1830949054135808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:554/0 lens 488/4536 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.894047:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949054135808 ext(2523136->2527231) 00002000:00010000:1.0:1746129813.894049:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:0.0:1746129813.897099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.897392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.904768:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.918066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.922887:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.936046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.945052:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.945569:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.947074:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129813.947107:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137472 00000100:00100000:1.0:1746129813.947112:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137472 00002000:00100000:1.0:1746129813.947129:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dfb80 x1830949054137472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/0 e 0 to 0 dl 1746129824 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.947137:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949054137472 ext(3145728->4194303) 00002000:00010000:1.0:1746129813.947140:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:1.0:1746129813.947151:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6628 00000100:00100000:1.0:1746129813.947156:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054137472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129813.963370:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054137472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16204us (16288us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129813.963380:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6628 00002000:00100000:1.0:1746129813.963389:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dfb80 x1830949054137472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:554/0 lens 488/440 e 0 to 0 dl 1746129824 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129813.963397:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949054137472 ext(3145728->4194303) 00002000:00010000:1.0:1746129813.963403:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746129813.976517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.982679:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.982720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.990636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.996274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.997283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129813.997455:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.006684:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.006717:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.006736:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.006814:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129814.006826:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129814.006984:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6631 00000100:00100000:0.0:1746129814.006992:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054139264:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129814.007686:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129814.024276:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.025103:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054139264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18106us (18422us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129814.025114:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6631 00002000:00100000:1.0:1746129814.025127:0:21604:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009f6ef800 x1830949054139264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.025135:0:21604:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ef800 with x1830949054139264 ext(0->1048575) 00002000:00010000:1.0:1746129814.025142:0:21604:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ef800 00000100:00100000:0.0:1746129814.061127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.061154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.061301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.061382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.061413:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140800 00000100:00100000:0.0:1746129814.061416:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140800 00002000:00100000:0.0:1746129814.061428:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f6ef480 x1830949054140800/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129814.061434:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ef480 with x1830949054140800 ext(3145728->4194303) 00002000:00010000:0.0:1746129814.061436:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ef480 00000100:00100000:0.0:1746129814.061442:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141056 00000100:00100000:0.0:1746129814.061444:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141056 00002000:00100000:0.0:1746129814.061451:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6ec000 x1830949054141056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129814.061457:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ec000 with x1830949054141056 ext(2097152->3145727) 00002000:00010000:0.0:1746129814.061459:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ec000 00000100:00100000:0.0:1746129814.061467:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6636 00000100:00100000:0.0:1746129814.061470:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054140800:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129814.061541:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6637 00000100:00100000:0.0:1746129814.061547:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054141184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129814.079003:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.079406:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054140800:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17932us (18247us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129814.079415:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6636 00002000:00100000:0.0:1746129814.079425:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f6ef480 x1830949054140800/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129814.079434:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ef480 with x1830949054140800 ext(3145728->4194303) 00002000:00010000:0.0:1746129814.079439:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ef480 00000100:00100000:1.0:1746129814.079804:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054141184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18255us (18502us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129814.079810:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6637 00002000:00100000:1.0:1746129814.079815:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ed500 x1830949054141184/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.079822:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ed500 with x1830949054141184 ext(3145728->4194303) 00002000:00010000:1.0:1746129814.079825:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ed500 00000100:00080000:1.0:1746129814.079937:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129814.089743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.090121:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.090751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.093258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129814.098627:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129814.103754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.104128:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.104644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.104659:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054142848 00000100:00100000:1.0:1746129814.104662:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054142848 00000100:00100000:1.0:1746129814.104685:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14906 00000100:00100000:1.0:1746129814.104692:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31341:x1830949054142848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129814.104704:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.104717:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953abf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3552af expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.104738:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4d800/0x48868a4e439538f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35519e expref: 6 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.104744:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa32800/0x48868a4e439539e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355231 expref: 33 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.104754:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc600/0x48868a4e43953937 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c8 expref: 30 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.105295:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.105299:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.105303:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953abf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1388544->2060287] (req 1388544->2060287) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552af expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.105329:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fc600/0x48868a4e43953937 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c8 expref: 30 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.105339:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fc600/0x48868a4e43953937 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c8 expref: 30 pid: 7976 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.105349:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053939712:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.105411:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa32800/0x48868a4e439539e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355231 expref: 33 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.105418:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa32800/0x48868a4e439539e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355231 expref: 33 pid: 7976 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.105426:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053939840:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.105450:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4d800/0x48868a4e439538f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35519e expref: 6 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.105461:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e4d800/0x48868a4e439538f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35519e expref: 6 pid: 1877 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.105469:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053939968:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.105485:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.113432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.113465:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.113484:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.113579:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053939712:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.113588:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053939840:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.113594:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053939968:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.113618:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953abf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1388544->2060287] (req 1388544->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552af expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.113631:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683ec00, rc 0) 00000100:00100000:1.0:1746129814.113663:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31341:x1830949054142848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8972us (9019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.113670:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14906 00000100:00100000:0.0:1746129814.114163:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.114831:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129814.115032:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129814.116903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.119284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.120052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.123694:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.123724:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.123784:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.123840:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054144640 00000100:00100000:1.0:1746129814.123863:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054144640 00000100:00100000:1.0:1746129814.123892:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054144512 00000100:00100000:1.0:1746129814.123894:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054144512 00000100:00100000:1.0:1746129814.123909:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14907 00000100:00100000:1.0:1746129814.123915:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054144640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.123928:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.123944:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ca6000/0x48868a4e43953ae9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3552c4 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.123963:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.123965:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.123972:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ca6000/0x48868a4e43953ae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552c4 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.123986:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ca6000/0x48868a4e43953ae9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552c4 expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.123995:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ca6000, rc 0) 00000100:00100000:1.0:1746129814.124023:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054144640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.124029:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14907 00000100:00100000:1.0:1746129814.124041:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14908 00000100:00100000:1.0:1746129814.124044:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054144512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.124049:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.124057:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3552bd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129814.124090:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053940480:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129814.124133:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00002000:00010000:1.0:1746129814.126533:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129813 -> 1746129814 00002000:00010000:1.0:1746129814.126542:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129813 -> 1746129814 00002000:00010000:1.0:1746129814.126544:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129813 -> 1746129814 00000100:00100000:1.0:1746129814.126561:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053940480:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129814.126586:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552bd expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.126600:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552bd expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.126626:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b6b6400, rc 0) 00000100:00100000:1.0:1746129814.126646:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054144512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2600us (2920us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129814.126652:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14908 00000100:00100000:0.0:1746129814.129959:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.132387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.132478:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054145280 00000100:00100000:1.0:1746129814.132485:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054145280 00000100:00100000:1.0:1746129814.132517:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14909 00000100:00100000:1.0:1746129814.132524:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31338:x1830949054145280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.132536:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.132551:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3552cb expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.132574:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b78600/0x48868a4e43953ab8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552a8 expref: 30 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.132580:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129814.132581:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129814.132584:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552cb expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.132608:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b78600/0x48868a4e43953ab8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552a8 expref: 30 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.132619:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b78600/0x48868a4e43953ab8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3436543) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552a8 expref: 30 pid: 1877 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746129814.132630:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053940608:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.132704:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.133344:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054145408 00000100:00100000:0.0:1746129814.133351:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054145408 00000100:00100000:0.0:1746129814.133379:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14910 00000100:00100000:0.0:1746129814.133388:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31344:x1830949054145408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129814.133395:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129814.133402:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba79a00/0x48868a4e43953afe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3552d2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.133416:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953abf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2060287) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552af expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.133422:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129814.133424:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129814.133426:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba79a00/0x48868a4e43953afe lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552d2 expref: 32 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.133440:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953abf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2060287) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552af expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.133447:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953abf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2060287) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552af expref: 28 pid: 8437 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.133454:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053940736:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129814.133494:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.133762:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.134314:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053940608:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.134331:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552cb expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.134340:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b6b6400, rc 0) 00000100:00100000:1.0:1746129814.134357:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31338:x1830949054145280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1834us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.134362:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14909 00000100:00100000:0.0:1746129814.135026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.148034:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.153697:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053940992:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129814.153712:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129814.154370:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054146176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5605us (5709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.154379:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7430 00000100:00100000:1.0:1746129814.172990:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.179075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.179233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.196716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.196781:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054147456 00000100:00100000:1.0:1746129814.196789:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054147456 00000100:00100000:1.0:1746129814.196839:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14912 00000100:00100000:1.0:1746129814.196845:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31344:x1830949054147456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.196886:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.196900:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3552e0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.196920:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.196922:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.196929:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552e0 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.196941:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552e0 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.196949:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3be00, rc 0) 00000100:00100000:1.0:1746129814.196991:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31344:x1830949054147456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 146us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.196997:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14912 00000100:00100000:0.0:1746129814.203150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.203259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.203294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.203313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.203363:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054147968 00000100:00100000:1.0:1746129814.203370:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054147968 00002000:00100000:1.0:1746129814.203402:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009ba87100 x1830949054147968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.203408:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba87100 with x1830949054147968 ext(2097152->3145727) 00002000:00010000:1.0:1746129814.203412:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ba87100 00000100:00100000:1.0:1746129814.203422:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054148480 00000100:00100000:1.0:1746129814.203423:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054148480 00002000:00100000:1.0:1746129814.203430:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009ba85f80 x1830949054148480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.203435:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ba85f80 with x1830949054148480 ext(3145728->4194303) 00002000:00010000:1.0:1746129814.203437:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ba85f80 00000100:00100000:1.0:1746129814.203450:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6648 00000100:00100000:1.0:1746129814.203454:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054148224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129814.224942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.242587:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.250615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.285623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.293552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.293715:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054149504 00000100:00100000:1.0:1746129814.293721:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054149504 00010000:00010000:1.0:1746129814.293751:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552cb expref: 30 pid: 8437 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746129814.294363:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7431 00000100:00100000:1.0:1746129814.294370:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054149504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.294381:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.294397:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552cb expref: 30 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.294406:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552cb expref: 30 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.294424:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953af7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552cb expref: 30 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.294448:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.294476:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054149504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.294482:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7431 00000100:00100000:0.0:1746129814.301757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.301876:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054149632 00000100:00100000:1.0:1746129814.301885:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054149632 00010000:00010000:1.0:1746129814.301914:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552e0 expref: 35 pid: 8437 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746129814.302016:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7432 00000100:00100000:1.0:1746129814.302023:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054149632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.302035:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.302054:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552e0 expref: 35 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.302064:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552e0 expref: 35 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.302082:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953b0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552e0 expref: 35 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.302112:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.302114:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.302120:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0220600/0x48868a4e43953b36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552ee expref: 34 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.302127:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0220600/0x48868a4e43953b36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3743743) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552ee expref: 34 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.302155:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0220600/0x48868a4e43953b36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3743743) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552ee expref: 34 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129814.302166:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053941376:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129814.303228:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129814.305577:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053941376:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129814.305593:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.305625:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054149632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3602us (3876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.305633:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7432 00000100:00100000:0.0:1746129814.306900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.319328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.322572:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.358572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.369718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.372746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.372834:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054150912 00000100:00100000:1.0:1746129814.372839:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054150912 00010000:00010000:1.0:1746129814.372880:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0220000/0x48868a4e43953b05 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552d9 expref: 31 pid: 10930 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.372914:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7433 00000100:00100000:1.0:1746129814.372920:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054150912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.372930:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.372946:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0220000/0x48868a4e43953b05 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552d9 expref: 31 pid: 10930 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.372955:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0220000/0x48868a4e43953b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552d9 expref: 31 pid: 10930 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.372975:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.373001:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054150912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.373007:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7433 00000100:00100000:0.0:1746129814.380618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.385137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.391095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.397551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.397598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.397977:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7435 00000100:00100000:1.0:1746129814.397986:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054151552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.397997:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.398016:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fde00/0x48868a4e4395391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551cf expref: 31 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.398026:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fde00/0x48868a4e4395391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551cf expref: 31 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.398125:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fde00/0x48868a4e4395391b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551cf expref: 31 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.398142:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.398175:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054151552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 190us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.398180:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7435 00000100:00100000:0.0:1746129814.399658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.406819:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.411536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.434438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.437733:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.452334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.452384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.452627:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6656 00000100:00100000:1.0:1746129814.452637:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054153216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129814.475668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.481060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.482573:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054153728 00000100:00100000:0.0:1746129814.482582:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054153728 00000100:00100000:0.0:1746129814.482630:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10898 00000100:00100000:0.0:1746129814.482638:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31361:x1830949054153728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129814.482658:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129814.482673:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb600/0x48868a4e43953b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355318 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.482767:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482777:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482786:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482798:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482803:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482812:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482925:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482932:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.482938:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129814.482945:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129814.483006:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483012:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483017:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483022:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318ea200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129814.483026:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483031:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483039:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129814.483042:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129814.483045:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483053:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318ea200/0x48868a4e43953bad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483077:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483082:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483086:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483089:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318eaa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129814.483091:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483096:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483101:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129814.483103:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129814.483105:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483109:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eaa00/0x48868a4e43953b9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483115:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483119:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483123:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483127:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801318eb000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129814.483129:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483133:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483138:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49600) 00010000:00010000:0.0:1746129814.483139:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129814.483141:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483145:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb000/0x48868a4e43953ba6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129814.483172:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb600/0x48868a4e43953b98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355318 expref: 294 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.483180:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801318eb600/0x48868a4e43953b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355318 expref: 294 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.483186:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318eb600, rc 0) 00000100:00100000:0.0:1746129814.483223:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31361:x1830949054153728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 586us (2171us total) trans 8589944879 rc 301/301 00000100:00100000:0.0:1746129814.483229:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10898 00000100:00100000:0.0:1746129814.486764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.489717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.491146:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054153984 00000100:00100000:1.0:1746129814.491155:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054153984 00000100:00100000:0.0:1746129814.491223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.491588:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14919 00000100:00100000:1.0:1746129814.491593:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054153984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.491599:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.491605:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e10600/0x48868a4e43953bc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355326 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129814.491627:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053942784:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129814.491647:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2cc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746129814.493695:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129813 -> 1746129815 00002000:00010000:1.0:1746129814.493698:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129813 -> 1746129815 00002000:00010000:1.0:1746129814.493700:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129813 -> 1746129815 00000100:00100000:1.0:1746129814.493713:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053942784:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129814.493729:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e10600/0x48868a4e43953bc9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355326 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.493738:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e10600/0x48868a4e43953bc9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355326 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129814.493750:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e10600, rc 0) 00000100:00100000:1.0:1746129814.493766:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054153984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2173us (4052us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129814.493770:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14919 00000100:00100000:0.0:1746129814.499770:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054154368 00000100:00100000:0.0:1746129814.499778:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054154368 00000100:00100000:0.0:1746129814.499821:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14920 00000100:00100000:0.0:1746129814.499828:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31361:x1830949054154368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129814.499838:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129814.499871:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801318ea200/0x48868a4e43953bd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355334 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.499894:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.499900:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129814.499901:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129814.499904:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801318ea200/0x48868a4e43953bd0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355334 expref: 34 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.499927:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.499935:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 29 pid: 10930 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.499944:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053942912:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129814.500001:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.501912:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053942912:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129814.501931:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801318ea200/0x48868a4e43953bd0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355334 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.501951:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801318ea200, rc 0) 00000100:00100000:0.0:1746129814.501982:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31361:x1830949054154368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2154us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.501989:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14920 00000100:00100000:0.0:1746129814.502190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.512934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.512988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.513071:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054154624 00000100:00100000:1.0:1746129814.513079:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054154624 00010000:00010000:1.0:1746129814.513109:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 32 pid: 10930 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746129814.513129:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054154752 00000100:00100000:1.0:1746129814.513130:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054154752 00010000:00010000:1.0:1746129814.513138:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0220600/0x48868a4e43953b36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3252224->3743743) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552ee expref: 35 pid: 10930 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746129814.513150:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7438 00000100:00100000:1.0:1746129814.513155:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1963:x1830949054154624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.513167:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.513185:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 32 pid: 10930 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.513194:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 32 pid: 10930 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.513214:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0221000/0x48868a4e43953b60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1945600->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552fc expref: 32 pid: 10930 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.513232:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.513234:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.513251:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801318ea200/0x48868a4e43953bd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355334 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.513259:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801318ea200/0x48868a4e43953bd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355334 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.513286:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801318ea200/0x48868a4e43953bd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355334 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129814.513296:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053943040:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129814.513367:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129814.516112:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053943040:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129814.516129:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.516957:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054154624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3798us (4026us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.516967:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7438 00000100:00100000:0.0:1746129814.523402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.523474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.523505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.523957:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6659 00000100:00100000:1.0:1746129814.523966:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1964:x1830949054155008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129814.549466:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054155008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25493us (25982us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129814.549478:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6659 00002000:00100000:1.0:1746129814.549488:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009328ad80 x1830949054155008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.549496:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949054155008 ext(2097152->3145727) 00002000:00010000:1.0:1746129814.549501:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328ad80 00000100:00100000:0.0:1746129814.551227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.555140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.566602:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.566696:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054156032 00000100:00100000:1.0:1746129814.566703:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054156032 00000100:00100000:1.0:1746129814.566750:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14922 00000100:00100000:1.0:1746129814.566756:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31361:x1830949054156032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.566771:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.566785:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e10200/0x48868a4e43953c01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355349 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.566809:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.566816:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129814.566817:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129814.566820:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e10200/0x48868a4e43953c01 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355349 expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.566842:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.566880:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 31 pid: 10930 timeout: 860 lvb_type: 0 00000100:00100000:1.0:1746129814.566896:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053943296:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.566970:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.571066:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.571117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.571703:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054156544 00000100:00100000:1.0:1746129814.571710:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054156544 00000100:00100000:1.0:1746129814.571749:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10900 00000100:00100000:1.0:1746129814.571756:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31365:x1830949054156544:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129814.571776:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.571790:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10a00/0x48868a4e43953c08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355350 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.571916:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.571927:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.571936:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.571948:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.571953:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.571958:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572040:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572048:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572054:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:1.0:1746129814.572061:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:1.0:1746129814.572127:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572133:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572138:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572143:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e11000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129814.572146:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572151:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572159:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129814.572162:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129814.572165:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572169:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e11000/0x48868a4e43953c1d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572191:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572199:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572204:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572208:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e10c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129814.572210:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572215:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572221:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129814.572223:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129814.572225:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572229:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10c00/0x48868a4e43953c0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572235:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572250:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572254:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572259:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e10e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129814.572261:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572267:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572272:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880094266800) 00010000:00010000:1.0:1746129814.572274:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129814.572275:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572279:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10e00/0x48868a4e43953c16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129814.572307:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10a00/0x48868a4e43953c08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355350 expref: 295 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.572313:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e10a00/0x48868a4e43953c08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355350 expref: 295 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.572319:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e10a00, rc 0) 00000100:00100000:1.0:1746129814.572356:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31365:x1830949054156544:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 600us (1238us total) trans 8589944881 rc 301/301 00000100:00100000:1.0:1746129814.572362:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10900 00000100:00100000:1.0:1746129814.572395:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053943296:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.572411:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e10200/0x48868a4e43953c01 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355349 expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.572422:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e10200, rc 0) 00000100:00100000:1.0:1746129814.572439:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31361:x1830949054156032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5684us (5846us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.572448:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14922 00000100:00100000:0.0:1746129814.572674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.573013:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054156672 00000100:00100000:1.0:1746129814.573016:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054156672 00002000:00100000:1.0:1746129814.573037:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1146879) req@ffff880093288000 x1830949054156672/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.573046:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949054156672 ext(1048576->1146879) 00010000:00010000:1.0:1746129814.573052:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 32 pid: 10930 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.573062:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 32 pid: 10930 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746129814.573068:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093288000 00000100:00100000:1.0:1746129814.573080:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1807 00000100:00100000:1.0:1746129814.573085:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054156672:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129814.579980:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1961:x1830949054156672:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6883us (7294us total) trans 17179874002 rc 0/0 00000100:00100000:1.0:1746129814.579991:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1807 00002000:00100000:1.0:1746129814.580001:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1146879) req@ffff880093288000 x1830949054156672/t17179874002(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/448 e 0 to 0 dl 1746129825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.580010:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949054156672 ext(1048576->1146879) 00010000:00010000:1.0:1746129814.580019:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 34 pid: 10930 timeout: 860 lvb_type: 0 00010000:00010000:1.0:1746129814.580037:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0221800/0x48868a4e43953b67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1146879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355303 expref: 34 pid: 10930 timeout: 860 lvb_type: 0 00002000:00010000:1.0:1746129814.580042:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093288000 00000100:00100000:0.0:1746129814.589191:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.599392:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.604596:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054157056 00000100:00100000:1.0:1746129814.604607:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054157056 00002000:00100000:1.0:1746129814.604649:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009328aa00 x1830949054157056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.604659:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328aa00 with x1830949054157056 ext(1048576->2097151) 00002000:00010000:1.0:1746129814.604663:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328aa00 00000100:00100000:1.0:1746129814.604695:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6661 00000100:00100000:1.0:1746129814.604701:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054157056:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129814.614118:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054157056:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9408us (14724us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129814.614129:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6661 00002000:00100000:1.0:1746129814.614138:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009328aa00 x1830949054157056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.614147:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328aa00 with x1830949054157056 ext(1048576->2097151) 00002000:00010000:1.0:1746129814.614152:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328aa00 00000100:00100000:0.0:1746129814.629088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.629742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.630677:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054157184 00000100:00100000:1.0:1746129814.630686:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054157184 00000100:00100000:1.0:1746129814.630724:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14923 00000100:00100000:1.0:1746129814.630731:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31361:x1830949054157184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129814.630747:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.630761:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0220200/0x48868a4e43953c2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355357 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.630877:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.630879:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.630886:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0220200/0x48868a4e43953c2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355357 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.630899:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0220200/0x48868a4e43953c2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355357 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.630908:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0220200, rc 0) 00000100:00100000:1.0:1746129814.630950:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31361:x1830949054157184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 219us (1873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.630955:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14923 00000100:00080000:1.0:1746129814.633411:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129814.648367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.653506:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.653555:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.653623:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054157952 00000100:00100000:1.0:1746129814.653630:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054157952 00002000:00100000:1.0:1746129814.653667:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009328b800 x1830949054157952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.653675:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949054157952 ext(2097152->3145727) 00002000:00010000:1.0:1746129814.653680:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b800 00000100:00100000:1.0:1746129814.653705:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054158208 00000100:00100000:1.0:1746129814.653708:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054158208 00002000:00100000:1.0:1746129814.653718:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880093288700 x1830949054158208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.653730:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949054158208 ext(3145728->4194303) 00002000:00010000:1.0:1746129814.653732:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288700 00000100:00100000:1.0:1746129814.653743:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6662 00000100:00100000:1.0:1746129814.653749:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054157952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129814.668840:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.673588:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054157952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19828us (20078us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129814.673599:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6662 00002000:00100000:1.0:1746129814.673609:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009328b800 x1830949054157952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.673618:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949054157952 ext(2097152->3145727) 00002000:00010000:1.0:1746129814.673622:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b800 00000100:00100000:0.0:1746129814.677032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.677666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.682493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.684255:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.684307:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054158976 00000100:00100000:1.0:1746129814.684312:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054158976 00002000:00100000:1.0:1746129814.684347:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1073152->1077247) req@ffff880093288e00 x1830949054158976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.684356:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949054158976 ext(1073152->1077247) 00002000:00010000:1.0:1746129814.684360:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:1.0:1746129814.684377:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6664 00000100:00100000:1.0:1746129814.684383:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054158976:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129814.684517:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054158976:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 135us (268us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129814.684523:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6664 00002000:00100000:1.0:1746129814.684529:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1073152->1077247) req@ffff880093288e00 x1830949054158976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/4536 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.684535:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949054158976 ext(1073152->1077247) 00002000:00010000:1.0:1746129814.684538:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:0.0:1746129814.691823:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.694334:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.694396:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054159360 00000100:00100000:1.0:1746129814.694404:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054159360 00002000:00100000:1.0:1746129814.694452:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1757184->1761279) req@ffff88009fbeca80 x1830949054159360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.694461:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeca80 with x1830949054159360 ext(1757184->1761279) 00002000:00010000:1.0:1746129814.694466:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbeca80 00000100:00100000:1.0:1746129814.694483:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6665 00000100:00100000:1.0:1746129814.694490:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054159360:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129814.694623:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054159360:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 133us (296us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129814.694630:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6665 00002000:00100000:1.0:1746129814.694635:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1757184->1761279) req@ffff88009fbeca80 x1830949054159360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/4536 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.694642:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeca80 with x1830949054159360 ext(1757184->1761279) 00002000:00010000:1.0:1746129814.694644:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbeca80 00000100:00100000:0.0:1746129814.697275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.702166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.703294:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.703670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.703735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.717485:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.727980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.730312:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.730402:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054160768 00000100:00100000:1.0:1746129814.730411:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054160768 00002000:00100000:1.0:1746129814.730450:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009fbeea00 x1830949054160768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 504/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.730459:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949054160768 ext(1048576->2097151) 00002000:00010000:1.0:1746129814.730464:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:1.0:1746129814.730491:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054161024 00000100:00100000:1.0:1746129814.730494:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054161024 00002000:00100000:1.0:1746129814.730504:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009fbef480 x1830949054161024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.730511:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef480 with x1830949054161024 ext(1048576->2097151) 00002000:00010000:1.0:1746129814.730514:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef480 00000100:00100000:1.0:1746129814.730528:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6666 00000100:00100000:1.0:1746129814.730534:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1962:x1830949054160768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129814.745595:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1962:x1830949054160768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15053us (17616us total) trans 0 rc 360448/360448 00000100:00100000:1.0:1746129814.745605:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6666 00002000:00100000:1.0:1746129814.745615:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009fbeea00 x1830949054160768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 504/440 e 0 to 0 dl 1746129825 ref 1 fl Complete:/200/0 rc 360448/360448 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129814.745623:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949054160768 ext(1048576->2097151) 00002000:00010000:1.0:1746129814.745627:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:1.0:1746129814.757384:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944320 00000100:00100000:1.0:1746129814.757390:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944320 00000100:00100000:1.0:1746129814.757422:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1746129814.757427:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053944320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746129814.757446:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 500498432 pending 23855104 free 3852468224 avail 3850371072 00000100:00100000:1.0:1746129814.757478:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053944320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.757483:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1746129814.769735:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.805954:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949053944576:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806013:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129814.806065:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129814.806071:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ea7f7eb-2f74-477e-bfed-16dc08365411:3299:1830949053944448:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129814.806119:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053944960:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806134:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129814.806157:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944576 00000100:00100000:1.0:1746129814.806162:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944576 00000100:00100000:1.0:1746129814.806193:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944960 00000100:00100000:1.0:1746129814.806195:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944960 00000100:00100000:1.0:1746129814.806206:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1746129814.806212:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830949053944576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806278:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830949053944576:12345-0@lo:400:kworker.0 Request processed in 65us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.806283:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1746129814.806295:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1746129814.806299:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830949053944960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806318:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1830949053944960:12345-0@lo:400:kworker.0 Request processed in 19us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.806323:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1746129814.806333:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129814.806354:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3299:1830949053944960:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806364:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949053944576:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806396:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944448 00000100:00100000:1.0:1746129814.806398:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944448 00000100:00100000:1.0:1746129814.806413:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1746129814.806417:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3299:x1830949053944448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806453:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d496450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3299:x1830949053944448:12345-0@lo:400:kworker.0 Request processed in 35us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.806458:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1746129814.806480:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ea7f7eb-2f74-477e-bfed-16dc08365411:3299:1830949053944448:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806500:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053944832:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806517:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129814.806529:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746129814.806533:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949053944704:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806546:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129814.806561:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944704 00000100:00100000:1.0:1746129814.806563:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944704 00000100:00100000:1.0:1746129814.806581:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1746129814.806585:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949053944704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806605:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949053944704:12345-0@lo:400:kworker.0 Request processed in 20us (58us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.806610:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1746129814.806619:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129814.806630:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949053944704:0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806646:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053944832 00000100:00100000:1.0:1746129814.806648:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053944832 00000100:00100000:1.0:1746129814.806664:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1746129814.806667:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053944832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129814.806691:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3297:x1830949053944832:12345-0@lo:400:kworker.0 Request processed in 24us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.806696:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1746129814.806714:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053944832:0@lo:400:kworker.0 00000100:00100000:0.0:1746129814.806884:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129814.806892:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053945088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129814.806915:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129814.810913:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053945088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129814.819841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.823031:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054161408 00000100:00100000:1.0:1746129814.823040:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054161408 00000100:00100000:0.0:1746129814.823147:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14929 00000100:00100000:0.0:1746129814.823156:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31365:x1830949054161408:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129814.823170:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129814.823184:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953c78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355388 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.823206:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba79800/0x48868a4e43953bc2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35532d expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.823214:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0220200/0x48868a4e43953c2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355357 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.823220:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129814.823223:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129814.823226:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953c78 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3215360->4194303] (req 3215360->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355388 expref: 36 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.823261:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0220200/0x48868a4e43953c2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355357 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.823271:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0220200/0x48868a4e43953c2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355357 expref: 36 pid: 8437 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.823280:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053945216:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129814.824789:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba79800/0x48868a4e43953bc2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35532d expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.824801:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba79800/0x48868a4e43953bc2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35532d expref: 33 pid: 10930 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.824810:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053945344:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129814.828166:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.828755:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbedc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053945216:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129814.829795:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.832533:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053945344:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129814.832945:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953c78 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3215360->4194303] (req 3215360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355388 expref: 35 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.832961:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b6b6400, rc 0) 00000100:00100000:0.0:1746129814.833008:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31365:x1830949054161408:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9854us (13173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.833014:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14929 00000100:00100000:0.0:1746129814.837999:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.842472:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.852656:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.868436:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.870878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.870896:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054162304 00000100:00100000:0.0:1746129814.870900:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054162304 00010000:00010000:0.0:1746129814.870912:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b78200/0x48868a4e43953ab1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3552a1 expref: 19 pid: 1877 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.877731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.883369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.895295:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.896053:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054162944 00000100:00100000:1.0:1746129814.896063:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054162944 00000100:00100000:1.0:1746129814.896116:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10902 00000100:00100000:1.0:1746129814.896125:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31376:x1830949054162944:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129814.896147:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129814.896163:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953c86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355396 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.896226:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896247:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896256:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896266:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896272:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896281:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896384:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896392:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896397:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129814.896422:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:1.0:1746129814.896425:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129814.896438:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896446:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896452:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896457:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896461:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896465:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ac00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129814.896468:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896472:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896481:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129814.896484:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129814.896486:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896490:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896508:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896512:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896517:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896520:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3aa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129814.896523:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896527:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896532:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012db30100) 00010000:00010000:1.0:1746129814.896534:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129814.896535:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896539:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x48868a4e43953c94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.896561:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953c86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355396 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.896571:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355396 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.896577:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129814.896579:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129814.896581:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3a800, rc 0) 00000100:00100000:1.0:1746129814.896620:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31376:x1830949054162944:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 497us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.896626:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10902 00000100:00100000:1.0:1746129814.900956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.900983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.901007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.901044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:1.0:1746129814.901629:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129814.911010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.922021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.922054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.922079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.922097:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054163840 00000100:00100000:0.0:1746129814.922101:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054163840 00010000:00010000:0.0:1746129814.922126:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355396 expref: 11 pid: 15044 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.922143:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054163968 00000100:00100000:0.0:1746129814.922144:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054163968 00010000:00010000:0.0:1746129814.922151:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb600/0x48868a4e43953a72 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35527e expref: 21 pid: 14314 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.922165:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7447 00000100:00100000:0.0:1746129814.922170:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054163840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129814.922179:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129814.922183:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355396 expref: 11 pid: 15044 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746129814.922191:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355396 expref: 11 pid: 15044 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746129814.922207:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43953c9b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355396 expref: 11 pid: 15044 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746129814.922219:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129814.922223:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6c00/0x48868a4e43953cc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129814.922243:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6c00/0x48868a4e43953cc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129814.922249:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129814.922278:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054163840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.922283:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7447 00000100:00100000:0.0:1746129814.922294:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054164096 00000100:00100000:0.0:1746129814.922296:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054164096 00010000:00010000:0.0:1746129814.922303:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba5a000/0x48868a4e439539c3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35520e expref: 296 pid: 15044 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746129814.922316:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7448 00000100:00100000:0.0:1746129814.922320:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054163968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129814.922324:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129814.922327:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb600/0x48868a4e43953a72 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35527e expref: 21 pid: 14314 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746129814.922333:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb600/0x48868a4e43953a72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35527e expref: 21 pid: 14314 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746129814.922341:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129814.922343:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6c00/0x48868a4e43953cc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129814.922347:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6c00/0x48868a4e43953cc5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129814.922350:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129814.922360:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054163968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.922364:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7448 00000100:00100000:0.0:1746129814.927404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.934403:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054164480 00000100:00100000:0.0:1746129814.934411:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054164480 00000100:00100000:0.0:1746129814.934457:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10905 00000100:00100000:0.0:1746129814.934464:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31376:x1830949054164480:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129814.934482:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129814.934499:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683f600/0x48868a4e43953ce8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3553c7 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.934548:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683f600/0x48868a4e43953ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553c7 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.934559:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683f600/0x48868a4e43953ce8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553c7 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.934574:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129814.934576:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129814.934579:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683f600, rc 0) 00000100:00100000:0.0:1746129814.934626:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31376:x1830949054164480:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 163us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.934631:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10905 00000100:00100000:0.0:1746129814.938222:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.942716:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.942754:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.943953:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14940 00000100:00100000:0.0:1746129814.943958:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054165248:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129814.943971:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.943979:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953c78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355388 expref: 34 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.943984:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129814.943985:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129814.943988:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.943999:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953c78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355388 expref: 34 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.944008:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b6b6400/0x48868a4e43953c78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355388 expref: 34 pid: 7975 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746129814.944015:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053947904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129814.944047:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.946178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.946204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.946247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.946271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.946283:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054165632 00000100:00100000:0.0:1746129814.946287:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054165632 00002000:00100000:0.0:1746129814.946314:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1073152->1761279) req@ffff880131460a80 x1830949054165632/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129814.946322:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460a80 with x1830949054165632 ext(1073152->1761279) 00010000:00010000:0.0:1746129814.946328:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba79a00/0x48868a4e43953c32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35535e expref: 33 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746129814.946336:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba79a00/0x48868a4e43953c32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35535e expref: 33 pid: 8437 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746129814.946341:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131460a80 00000100:00100000:0.0:1746129814.946351:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054165760 00000100:00100000:0.0:1746129814.946353:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054165760 00002000:00100000:0.0:1746129814.946361:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4227071) req@ffff88009fbeed80 x1830949054165760/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:555/0 lens 488/0 e 0 to 0 dl 1746129825 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129814.946367:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeed80 with x1830949054165760 ext(4194304->4227071) 00010000:00010000:0.0:1746129814.946371:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6a00/0x48868a4e43953c7f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35538f expref: 31 pid: 7975 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129814.946377:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eca6a00/0x48868a4e43953c7f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35538f expref: 31 pid: 7975 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746129814.946381:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fbeed80 00000100:00100000:0.0:1746129814.946394:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1808 00000100:00100000:0.0:1746129814.946399:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054165632:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129814.946867:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054165504 00000100:00100000:1.0:1746129814.946871:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054165504 00010000:00010000:1.0:1746129814.946886:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355190 expref: 10 pid: 1877 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.946899:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054165376 00000100:00100000:1.0:1746129814.946901:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054165376 00010000:00010000:1.0:1746129814.946908:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fdc00/0x48868a4e43953914 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c1 expref: 18 pid: 7976 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.946919:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7450 00000100:00100000:0.0:1746129814.946920:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053947904:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.946924:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054165504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.946931:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129814.946934:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.946944:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355190 expref: 10 pid: 1877 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746129814.946947:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7451 00010000:00010000:1.0:1746129814.946952:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355190 expref: 10 pid: 1877 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746129814.946953:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054165376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129814.946958:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.946974:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e439538ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355190 expref: 10 pid: 1877 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.947590:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129814.947591:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800920fdc00/0x48868a4e43953914 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c1 expref: 18 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746129814.947603:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920fdc00/0x48868a4e43953914 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c1 expref: 18 pid: 7976 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.947611:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054165504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 685us (1434us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129814.947614:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920fdc00/0x48868a4e43953914 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551c1 expref: 18 pid: 7976 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.947617:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7450 00010000:00010000:0.0:1746129814.947636:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129814.947654:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054165376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 701us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.947659:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7451 00000100:00100000:0.0:1746129814.952135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.952788:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.952809:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.952827:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166272 00000100:00100000:1.0:1746129814.952834:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166272 00010000:00010000:1.0:1746129814.952886:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551d6 expref: 17 pid: 1140 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129814.952907:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166400 00000100:00100000:1.0:1746129814.952909:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166400 00010000:00010000:1.0:1746129814.952917:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fd600/0x48868a4e43953906 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ac expref: 9 pid: 3624 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129814.952929:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7452 00000100:00100000:1.0:1746129814.952935:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054166272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.952945:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.952963:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551d6 expref: 17 pid: 1140 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.952972:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551d6 expref: 17 pid: 1140 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.952989:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca7e00/0x48868a4e43953922 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551d6 expref: 17 pid: 1140 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953005:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953036:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054166272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953041:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7452 00000100:00100000:1.0:1746129814.953073:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7453 00000100:00100000:1.0:1746129814.953077:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054166400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.953082:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.953087:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800920fd600/0x48868a4e43953906 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ac expref: 9 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953094:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920fd600/0x48868a4e43953906 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3551ac expref: 9 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953103:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953115:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054166400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953122:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7453 00000100:00100000:1.0:1746129814.953151:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.953187:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.953198:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166656 00000100:00100000:1.0:1746129814.953201:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166656 00010000:00010000:1.0:1746129814.953211:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e10200/0x48868a4e43953c01 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355349 expref: 35 pid: 8437 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129814.953223:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054165888 00000100:00100000:1.0:1746129814.953225:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054165888 00010000:00010000:1.0:1746129814.953245:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cb000/0x48868a4e43953c71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355381 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129814.953256:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7454 00000100:00100000:1.0:1746129814.953260:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054166656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.953267:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.953277:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e10200/0x48868a4e43953c01 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355349 expref: 35 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129814.953284:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e10200/0x48868a4e43953c01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355349 expref: 35 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129814.953296:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953308:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054166656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953312:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7454 00000100:00100000:1.0:1746129814.953320:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7455 00000100:00100000:1.0:1746129814.953324:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1964:x1830949054165888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.953330:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.953335:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a00cb000/0x48868a4e43953c71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355381 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953341:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a00cb000/0x48868a4e43953c71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355381 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953349:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cb000/0x48868a4e43953c71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355381 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953356:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953366:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1964:x1830949054165888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953370:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7455 00000100:00100000:1.0:1746129814.953400:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.953417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.953426:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166528 00000100:00100000:1.0:1746129814.953428:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166528 00010000:00010000:1.0:1746129814.953437:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa33a00/0x48868a4e439539ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35523f expref: 33 pid: 7976 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129814.953447:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166784 00000100:00100000:1.0:1746129814.953449:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166784 00010000:00010000:1.0:1746129814.953454:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa33000/0x48868a4e439539d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35522a expref: 34 pid: 7976 timeout: 860 lvb_type: 1 00000100:00100000:1.0:1746129814.953467:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7456 00000100:00100000:1.0:1746129814.953471:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054166528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.953477:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.953537:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa33a00/0x48868a4e439539ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35523f expref: 34 pid: 7976 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953545:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa33a00/0x48868a4e439539ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35523f expref: 34 pid: 7976 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953555:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.953557:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.953561:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189e400/0x48868a4e43953d0b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.953567:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189e400/0x48868a4e43953d0b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.953582:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953617:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054166528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 144us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953621:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7456 00000100:00100000:1.0:1746129814.953630:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7457 00000100:00100000:1.0:1746129814.953635:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054166784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.953640:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.953649:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009fa33000/0x48868a4e439539d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35522a expref: 33 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.953656:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa33000/0x48868a4e439539d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35522a expref: 33 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.953665:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa33000/0x48868a4e439539d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35522a expref: 33 pid: 7976 timeout: 860 lvb_type: 1 00010000:00010000:1.0:1746129814.953672:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.953674:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.953676:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920fca00/0x48868a4e43953cef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.953682:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fca00/0x48868a4e43953cef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.953693:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953705:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054166784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953709:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7457 00000100:00100000:1.0:1746129814.953753:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.953813:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166016 00000100:00100000:1.0:1746129814.953816:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166016 00010000:00010000:1.0:1746129814.953826:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fc200/0x48868a4e43953cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553a4 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129814.953838:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7458 00000100:00100000:1.0:1746129814.953842:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054166016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.953870:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.953877:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fc200/0x48868a4e43953cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553a4 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953885:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fc200/0x48868a4e43953cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553a4 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953895:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc200/0x48868a4e43953cb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553a4 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746129814.953902:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.953903:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129814.953906:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a00cba00/0x48868a4e43953cfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.953911:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a00cba00/0x48868a4e43953cfd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.953920:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.953934:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054166016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.953938:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7458 00000100:00100000:1.0:1746129814.962115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.963540:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1962:x1830949054165632:12345-192.168.204.31@tcp:4:cat.0 Request processed in 17136us (17288us total) trans 17179874003 rc 0/0 00000100:00100000:0.0:1746129814.963549:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1808 00002000:00100000:0.0:1746129814.963558:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1073152->1761279) req@ffff880131460a80 x1830949054165632/t17179874003(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:555/0 lens 488/448 e 0 to 0 dl 1746129825 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129814.963566:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460a80 with x1830949054165632 ext(1073152->1761279) 00010000:00010000:0.0:1746129814.963574:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba79a00/0x48868a4e43953c32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35535e expref: 34 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129814.963584:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba79a00/0x48868a4e43953c32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1073152->1761279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35535e expref: 34 pid: 8437 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746129814.963590:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131460a80 00000100:00100000:0.0:1746129814.963623:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054166912 00000100:00100000:0.0:1746129814.963627:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054166912 00010000:00010000:0.0:1746129814.963644:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6a00/0x48868a4e43953c7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35538f expref: 31 pid: 7975 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746129814.963675:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7459 00000100:00100000:0.0:1746129814.963680:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054166912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129814.963690:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129814.963703:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eca6a00/0x48868a4e43953c7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35538f expref: 31 pid: 7975 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129814.963710:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eca6a00/0x48868a4e43953c7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35538f expref: 31 pid: 7975 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129814.963726:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6a00/0x48868a4e43953c7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35538f expref: 31 pid: 7975 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129814.963739:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129814.963741:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129814.963744:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa32800/0x48868a4e43953d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.963755:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa32800/0x48868a4e43953d04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129814.963770:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129814.963782:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054166912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129814.963787:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7459 00000100:00100000:1.0:1746129814.967133:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129814.978322:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978331:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978353:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978360:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978366:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978372:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ec00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129814.978375:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978380:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978389:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.978394:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683ec00/0x48868a4e43953d12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129814.978437:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054165248:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 34478us (34692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.978443:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14940 00000100:00100000:0.0:1746129814.982358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.982445:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054167424 00000100:00100000:1.0:1746129814.982453:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054167424 00000100:00100000:1.0:1746129814.982488:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10906 00000100:00100000:1.0:1746129814.982494:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31376:x1830949054167424:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:1.0:1746129814.982530:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.982551:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683f600/0x48868a4e43953ce8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553c7 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982564:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129814.982568:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129814.982588:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.982596:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 294 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982602:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355215 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982606:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439539d1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35521c expref: 294 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982611:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.982635:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439539d1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35521c expref: 294 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982645:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439539d1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35521c expref: 294 pid: 14313 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129814.982659:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053948288:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.982744:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355215 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982751:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009510dc00/0x48868a4e439539ca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355215 expref: 19 pid: 14315 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129814.982759:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053948416:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.982781:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 294 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129814.982788:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 294 pid: 14313 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129814.982794:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053948544:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.982809:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129814.984676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.984777:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053948288:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.984787:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053948416:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129814.984793:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053948544:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129814.984817:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129814.985090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129814.985154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129814.985221:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054167808 00000100:00100000:1.0:1746129814.985224:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054167808 00010000:00010000:1.0:1746129814.985245:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 296 pid: 14313 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129814.985276:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7464 00000100:00100000:1.0:1746129814.985281:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1964:x1830949054167808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129814.985288:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129814.985291:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 296 pid: 14313 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129814.985420:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 295 pid: 14313 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129814.985430:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e439539b5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355207 expref: 295 pid: 14313 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129814.985439:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129814.985441:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.985447:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.985452:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.985463:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129814.985479:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1964:x1830949054167808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 198us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129814.985484:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7464 00010000:00010000:1.0:1746129814.985500:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129814.985505:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e43953d19 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000040:00080000:1.0:1746129814.986159:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3415, 88 off287248 00000004:00080000:1.0:1746129814.986166:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044317640ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986340:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3432, 88 off288656 00000004:00080000:1.0:1746129814.986346:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044497927ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986402:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3433, 88 off288744 00000004:00080000:1.0:1746129814.986406:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044558303ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986414:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3416, 88 off287336 00000004:00080000:1.0:1746129814.986416:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044568480ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986434:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3417, 88 off287424 00000004:00080000:1.0:1746129814.986437:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044589090ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986444:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3434, 88 off288832 00000004:00080000:1.0:1746129814.986447:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044598630ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986453:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3435, 88 off288920 00000004:00080000:1.0:1746129814.986455:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044607045ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986461:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3436, 88 off289008 00000004:00080000:1.0:1746129814.986463:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044615092ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986469:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3418, 88 off287512 00000004:00080000:1.0:1746129814.986471:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044623117ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986479:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3437, 88 off289096 00000004:00080000:1.0:1746129814.986481:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044633430ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986487:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3419, 88 off287600 00000004:00080000:1.0:1746129814.986489:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044640912ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986495:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3438, 88 off289184 00000004:00080000:1.0:1746129814.986498:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044649722ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129814.986503:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3420, 88 off287688 00000004:00080000:1.0:1746129814.986504:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044656692ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986510:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3421, 88 off287776 00000004:00080000:1.0:1746129814.986512:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044664650ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986518:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3422, 88 off287864 00000004:00080000:1.0:1746129814.986520:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044672605ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986526:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3423, 88 off287952 00000004:00080000:1.0:1746129814.986528:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761044680655ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129814.986534:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3439, 88 off289272 00000004:00080000:1.0:1746129814.986536:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761044688420ns, next at 716792379979ns, rc = 0 00000001:00080000:0.0:1746129815.021512:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944879 is committed 00000001:00080000:0.0:1746129815.021523:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944892 is committed 00000004:00080000:0.0:1746129815.021526:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2607 committed 00000004:00080000:0.0:1746129815.021532:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2596 committed 00000004:00080000:0.0:1746129815.021537:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2595 committed 00000004:00080000:0.0:1746129815.021538:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2594 committed 00000004:00080000:0.0:1746129815.021539:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2593 committed 00000004:00080000:0.0:1746129815.021541:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2606 committed 00000004:00080000:0.0:1746129815.021542:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2592 committed 00000004:00080000:0.0:1746129815.021543:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2605 committed 00000004:00080000:0.0:1746129815.021545:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2591 committed 00000004:00080000:0.0:1746129815.021546:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2604 committed 00000004:00080000:0.0:1746129815.021547:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2603 committed 00000004:00080000:0.0:1746129815.021548:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2602 committed 00000004:00080000:0.0:1746129815.021550:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2590 committed 00000004:00080000:0.0:1746129815.021551:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2589 committed 00000004:00080000:0.0:1746129815.021552:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2601 committed 00000004:00080000:0.0:1746129815.021554:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2600 committed 00000004:00080000:0.0:1746129815.021555:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2588 committed 00000001:00080000:0.0:1746129815.021563:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944881 is committed 00000001:00080000:0.0:1746129815.021571:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944889 is committed 00000001:00080000:0.0:1746129815.021573:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944888 is committed 00000100:00100000:1.0:1746129815.021680:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053948672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.021731:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.021778:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053948928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.021797:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.021816:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053948672 00000100:00100000:0.0:1746129815.021821:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053948672 00000100:00100000:1.0:1746129815.021902:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.021951:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053948928 00000100:00100000:0.0:1746129815.021954:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053948928 00000100:00100000:0.0:1746129815.021969:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14941 00000100:00100000:0.0:1746129815.021975:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053948672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.022012:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022030:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.022046:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022055:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053950208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.022066:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022077:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746129815.022081:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053948800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.022092:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022102:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.022111:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.022117:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3296:x1830949053948672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (386us total) trans 17179874005 rc 0/0 00000100:00100000:1.0:1746129815.022119:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.022123:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14941 00000100:00100000:1.0:1746129815.022129:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.022134:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949184 00000100:00100000:0.0:1746129815.022136:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949184 00000100:00100000:1.0:1746129815.022137:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053950336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.022145:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949696 00000100:00100000:0.0:1746129815.022147:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949696 00000100:00100000:1.0:1746129815.022148:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.022156:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053950208 00000100:00100000:0.0:1746129815.022158:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053950208 00000100:00100000:0.0:1746129815.022162:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053948800 00000100:00100000:0.0:1746129815.022163:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053948800 00000100:00100000:0.0:1746129815.022168:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949312 00000004:00080000:1.0:1746129815.022169:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c7b80/2, rc 0, transno 17179874005 00000100:00100000:0.0:1746129815.022169:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949312 00000100:00100000:1.0:1746129815.022173:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053948672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.022174:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949824 00000100:00100000:0.0:1746129815.022175:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949824 00000100:00100000:0.0:1746129815.022180:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053950336 00000100:00100000:0.0:1746129815.022181:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053950336 00000100:00100000:1.0:1746129815.022186:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053949056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.022187:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14942 00000100:00100000:0.0:1746129815.022191:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3298:x1830949053948928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.022199:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022206:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053949568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.022240:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022249:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053950080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.022262:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.022268:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053950592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.022278:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.022280:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3298:x1830949053948928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (483us total) trans 17179874006 rc 0/0 00000100:00100000:0.0:1746129815.022285:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14942 00000100:00100000:0.0:1746129815.022292:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949056 00000100:00100000:1.0:1746129815.022293:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949568 00000100:00100000:0.0:1746129815.022294:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949056 00000100:00100000:1.0:1746129815.022295:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949568 00000100:00100000:0.0:1746129815.022301:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053950080 00000100:00100000:0.0:1746129815.022302:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053950080 00000100:00100000:1.0:1746129815.022304:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053950592 00000100:00100000:1.0:1746129815.022305:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053950592 00000100:00100000:0.0:1746129815.022308:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14943 00000100:00100000:1.0:1746129815.022312:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14944 00000100:00100000:0.0:1746129815.022312:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3296:x1830949053949184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.022315:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053949696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.022386:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053949184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (466us total) trans 17179874007 rc 0/0 00000100:00100000:0.0:1746129815.022391:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14943 00000100:00100000:0.0:1746129815.022400:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14945 00000100:00100000:1.0:1746129815.022402:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053949696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (355us total) trans 21474841189 rc 0/0 00000100:00100000:0.0:1746129815.022404:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053950208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.022406:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14944 00000100:00100000:1.0:1746129815.022414:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14946 00000100:00100000:1.0:1746129815.022417:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+43:3296:x1830949053948800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.022471:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053950208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (403us total) trans 21474841190 rc 0/0 00000100:00100000:0.0:1746129815.022475:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14945 00000100:00100000:1.0:1746129815.022477:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053948800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (384us total) trans 17179874008 rc 0/0 00000100:00100000:1.0:1746129815.022482:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14946 00000100:00100000:0.0:1746129815.022488:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14947 00000100:00100000:0.0:1746129815.022492:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3296:x1830949053949312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.022560:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053949312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (448us total) trans 17179874009 rc 0/0 00000100:00100000:1.0:1746129815.023533:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14948 00000100:00100000:1.0:1746129815.023541:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053949824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.023631:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053949824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (1500us total) trans 21474841191 rc 0/0 00000100:00100000:1.0:1746129815.023636:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14948 00000100:00100000:1.0:1746129815.023645:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14949 00000100:00100000:1.0:1746129815.023648:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949053950336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.023712:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053950336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (1562us total) trans 21474841192 rc 0/0 00000100:00100000:1.0:1746129815.023717:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14949 00000100:00100000:1.0:1746129815.023725:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14950 00000100:00100000:1.0:1746129815.023729:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053949056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.023803:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053949056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (1603us total) trans 17179874010 rc 0/0 00000100:00100000:1.0:1746129815.023808:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14950 00000100:00100000:1.0:1746129815.023818:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14951 00000100:00100000:1.0:1746129815.023822:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053949568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.023957:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053949568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (1727us total) trans 17179874011 rc 0/0 00000100:00100000:1.0:1746129815.023962:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14951 00000100:00100000:1.0:1746129815.023971:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14952 00000100:00100000:1.0:1746129815.023974:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053950080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.024040:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3299:x1830949053950080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1777us total) trans 21474841193 rc 0/0 00000100:00100000:1.0:1746129815.024044:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14952 00000100:00100000:1.0:1746129815.024052:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14953 00000100:00100000:1.0:1746129815.024056:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3299:x1830949053950592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.024118:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+47:3299:x1830949053950592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (1839us total) trans 21474841194 rc 0/0 00000100:00100000:1.0:1746129815.024123:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14953 00000004:00080000:1.0:1746129815.024155:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460e00/2, rc 0, transno 17179874010 00000100:00100000:1.0:1746129815.024160:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053949056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.024166:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461180/2, rc 0, transno 17179874011 00000100:00100000:1.0:1746129815.024169:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053949568:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.024175:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6300/2, rc 0, transno 21474841193 00000100:00100000:1.0:1746129815.024182:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053950080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.024187:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a6a00/2, rc 0, transno 21474841194 00000100:00100000:1.0:1746129815.024189:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053950592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.024224:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746129815.024239:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053950720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.024261:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.024284:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053950720 00000100:00100000:1.0:1746129815.024287:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053950720 00000100:00100000:1.0:1746129815.024302:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14954 00000100:00100000:1.0:1746129815.024306:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3297:x1830949053950720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.024366:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14947 00000100:00080000:0.0:1746129815.024390:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129815.024393:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1746129815.024423:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131463800/2, rc 0, transno 17179874006 00000100:00100000:0.0:1746129815.024427:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053948928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.024431:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053949440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.024450:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.024461:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053949952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.024472:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.024479:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053950464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.024489:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.024503:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053949952 00000100:00100000:0.0:1746129815.024505:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053949952 00000100:00100000:0.0:1746129815.024515:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14955 00000100:00100000:0.0:1746129815.024519:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949053949440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.024594:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949053949440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (142us total) trans 17179874012 rc 0/0 00000100:00100000:0.0:1746129815.024598:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14955 00000100:00100000:1.0:1746129815.025341:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053950720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1033us (1079us total) trans 21474841195 rc 0/0 00000100:00100000:1.0:1746129815.025346:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14954 00000004:00080000:1.0:1746129815.025364:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf6d80/2, rc 0, transno 21474841195 00000100:00100000:1.0:1746129815.025367:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053950720:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.025379:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5c00/2, rc 0, transno 17179874008 00000100:00100000:1.0:1746129815.025382:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053948800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.025388:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460700/2, rc 0, transno 17179874009 00000100:00100000:1.0:1746129815.025390:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949312:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.025395:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a5180/2, rc 0, transno 21474841191 00000100:00100000:1.0:1746129815.025397:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.025401:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4a80/2, rc 0, transno 21474841192 00000100:00100000:1.0:1746129815.025403:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053950336:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.025409:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461f80/2, rc 0, transno 17179874007 00000100:00100000:1.0:1746129815.025410:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949184:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.025415:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131461880/2, rc 0, transno 21474841189 00000100:00100000:1.0:1746129815.025417:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053949696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.025421:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a5500/2, rc 0, transno 21474841190 00000100:00100000:1.0:1746129815.025423:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053950208:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.025612:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131460000/2, rc 0, transno 17179874012 00000100:00100000:0.0:1746129815.025616:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053949440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.025622:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a4380/2, rc 0, transno 21474841196 00000100:00100000:0.0:1746129815.025625:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053949952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.025631:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a55a7800/2, rc 0, transno 21474841197 00000100:00100000:0.0:1746129815.025633:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053950464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.034100:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.039535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.048509:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.089834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.093084:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.093191:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054169088 00000100:00100000:0.0:1746129815.093197:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054169088 00000100:00100000:0.0:1746129815.093255:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10909 00000100:00100000:0.0:1746129815.093261:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31384:x1830949054169088:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129815.093278:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.093289:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fc00/0x48868a4e43953d4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3553dc expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.093373:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093382:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093390:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093399:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093404:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093408:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093482:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093488:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093493:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129815.093499:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129815.093546:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093551:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093555:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093562:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189e200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129815.093564:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093569:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093576:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129815.093578:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129815.093581:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093584:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e200/0x48868a4e43953d51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093597:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093601:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093605:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093608:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189f600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129815.093610:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093613:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093617:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244900) 00010000:00010000:0.0:1746129815.093618:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129815.093621:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093624:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f600/0x48868a4e43953d58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.093647:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fc00/0x48868a4e43953d4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553dc expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.093654:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553dc expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.093659:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129815.093661:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129815.093662:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ee00, rc 0) 00000100:00100000:0.0:1746129815.093684:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31384:x1830949054169088:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 424us (605us total) trans 8589944896 rc 0/0 00000100:00100000:0.0:1746129815.093690:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10909 00000100:00080000:0.0:1746129815.093704:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129815.097031:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.097124:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.097143:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.097156:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.100895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.101092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.101109:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.101125:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.101865:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054169600 00000100:00100000:1.0:1746129815.101868:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054169600 00000100:00100000:1.0:1746129815.101883:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054169728 00000100:00100000:1.0:1746129815.101884:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054169728 00000100:00100000:1.0:1746129815.101891:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054169856 00000100:00100000:1.0:1746129815.101892:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054169856 00000100:00100000:1.0:1746129815.101909:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14961 00000100:00100000:1.0:1746129815.101913:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054169600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129815.101919:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.101928:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3553f8 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129815.101941:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d395, atime: 0x6813d395, ctime: 0x6813d395, blocks: 0x81f 00010000:00010000:1.0:1746129815.101948:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.101950:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.101954:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 33 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.101962:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 33 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.101969:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3bc00, rc 0) 00000100:00100000:1.0:1746129815.103040:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054169600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1125us (1946us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.103045:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14961 00000100:00100000:0.0:1746129815.110033:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.110098:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.113991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.114174:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054170880 00000100:00100000:1.0:1746129815.114177:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054170880 00010000:00010000:1.0:1746129815.114196:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccfa00/0x48868a4e43953d3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553d5 expref: 285 pid: 14313 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129815.114211:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054170752 00000100:00100000:1.0:1746129815.114213:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054170752 00010000:00010000:1.0:1746129815.114220:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553dc expref: 10 pid: 15044 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746129815.114244:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7465 00000100:00100000:1.0:1746129815.114249:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1962:x1830949054170880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129815.114257:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129815.114262:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccfa00/0x48868a4e43953d3c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553d5 expref: 285 pid: 14313 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129815.114271:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccfa00/0x48868a4e43953d3c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553d5 expref: 285 pid: 14313 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129815.114286:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccfa00/0x48868a4e43953d3c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553d5 expref: 285 pid: 14313 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129815.114302:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129815.114306:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129815.114312:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129815.114316:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129815.114334:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949054170880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.114339:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7465 00000100:00100000:1.0:1746129815.114373:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7466 00000100:00100000:1.0:1746129815.114378:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054170752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129815.114384:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129815.114387:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553dc expref: 10 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129815.114395:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553dc expref: 10 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129815.114405:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ee00/0x48868a4e43953d5f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553dc expref: 10 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746129815.114413:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129815.114416:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129815.114421:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129815.114426:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129815.114443:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129815.114455:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054170752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.114460:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7466 00000100:00100000:1.0:1746129815.114478:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054171136 00000100:00100000:1.0:1746129815.114481:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054171136 00000100:00100000:1.0:1746129815.114492:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054171392 00000100:00100000:1.0:1746129815.114494:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054171392 00000100:00100000:1.0:1746129815.114501:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054171008 00000100:00100000:1.0:1746129815.114502:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054171008 00000100:00100000:1.0:1746129815.114510:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054171264 00000100:00100000:1.0:1746129815.114512:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054171264 00000100:00100000:1.0:1746129815.114522:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14966 00000100:00100000:1.0:1746129815.114526:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054171136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129815.114532:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.114540:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355430 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.114552:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114553:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114558:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114567:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114575:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ac00, rc 0) 00000100:00100000:1.0:1746129815.114589:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054171136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 63us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.114593:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14966 00000100:00100000:1.0:1746129815.114602:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14967 00000100:00100000:1.0:1746129815.114606:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1963:x1830949054171392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129815.114612:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.114618:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35543e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.114626:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114627:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114630:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114638:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114645:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3aa00, rc 0) 00000100:00100000:1.0:1746129815.114658:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1963:x1830949054171392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 51us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.114663:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14967 00000100:00100000:1.0:1746129815.114672:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14968 00000100:00100000:1.0:1746129815.114676:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1963:x1830949054171008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129815.114680:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.114686:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355429 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.114694:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114695:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114699:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114707:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114718:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3be00, rc 0) 00000100:00100000:1.0:1746129815.114731:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1963:x1830949054171008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 55us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.114735:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14968 00000100:00100000:1.0:1746129815.114743:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14969 00000100:00100000:1.0:1746129815.114746:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054171264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129815.114750:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.114755:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b800/0x48868a4e43953ddd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355437 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.114762:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114764:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.114766:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b800/0x48868a4e43953ddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355437 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114774:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b800/0x48868a4e43953ddd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355437 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.114779:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b800, rc 0) 00000100:00100000:1.0:1746129815.114791:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054171264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.114796:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14969 00000100:00100000:0.0:1746129815.128055:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.128092:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.128130:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.128152:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054171904 00000100:00100000:0.0:1746129815.128157:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054171904 00002000:00100000:0.0:1746129815.128189:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800936dca80 x1830949054171904/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.128197:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830949054171904 ext(0->1048575) 00002000:00010000:0.0:1746129815.128202:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:0.0:1746129815.128224:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054172160 00000100:00100000:0.0:1746129815.128225:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054172160 00002000:00100000:0.0:1746129815.128244:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800936ded80 x1830949054172160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.128250:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830949054172160 ext(1048576->2097151) 00002000:00010000:0.0:1746129815.128252:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ded80 00000100:00100000:0.0:1746129815.128263:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6670 00000100:00100000:0.0:1746129815.128268:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054171904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129815.129285:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054171648 00000100:00100000:1.0:1746129815.129290:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054171648 00000100:00100000:1.0:1746129815.129311:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 216 00000100:00100000:1.0:1746129815.129315:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949054171648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129815.129342:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d496050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949054171648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.129347:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 216 00000100:00100000:0.0:1746129815.134531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.134580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.135132:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6673 00000100:00100000:0.0:1746129815.135138:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054172672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129815.141189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.141214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.141238:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.141265:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.142517:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6676 00000100:00100000:0.0:1746129815.142527:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1964:x1830949054173440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129815.148134:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054171904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19857us (20032us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129815.148144:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6670 00002000:00100000:0.0:1746129815.148153:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800936dca80 x1830949054171904/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.148161:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dca80 with x1830949054171904 ext(0->1048575) 00002000:00010000:0.0:1746129815.148166:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dca80 00000100:00100000:1.0:1746129815.149201:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054172672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14062us (14618us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129815.149208:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6673 00002000:00100000:1.0:1746129815.149213:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800936de300 x1830949054172672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129815.149220:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de300 with x1830949054172672 ext(1048576->2097151) 00002000:00010000:1.0:1746129815.149223:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936de300 00000100:00100000:0.0:1746129815.195550:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.195720:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054174080 00000100:00100000:1.0:1746129815.195726:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054174080 00000100:00100000:0.0:1746129815.195843:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1964:x1830949054173440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 53319us (54603us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129815.195862:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10914 00000100:00100000:1.0:1746129815.195870:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31387:x1830949054174080:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129815.195871:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6676 00002000:00100000:0.0:1746129815.195879:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f6eed80 x1830949054173440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129815.195882:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746129815.195887:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6eed80 with x1830949054173440 ext(1048576->2097151) 00002000:00010000:0.0:1746129815.195891:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6eed80 00010000:00010000:1.0:1746129815.195893:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355453 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.195933:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129815.195940:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.195952:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129815.195962:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.195972:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129815.195974:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129815.195976:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129815.195981:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c207c00, rc 0) 00000100:00100000:1.0:1746129815.195999:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31387:x1830949054174080:12345-192.168.204.31@tcp:101:cat.0 Request processed in 130us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.196068:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10914 00000100:00100000:1.0:1746129815.197882:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949054173696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 54821us (56611us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129815.197892:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6677 00002000:00100000:1.0:1746129815.197900:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009f6edf80 x1830949054173696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129815.197913:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6edf80 with x1830949054173696 ext(1048576->2097151) 00002000:00010000:1.0:1746129815.197917:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6edf80 00000100:00100000:0.0:1746129815.198660:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.198698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.198873:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7468 00000100:00100000:0.0:1746129815.198880:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054174336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129815.198887:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129815.198891:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccf400/0x48868a4e43953d20 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ce expref: 9 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.198945:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccf400/0x48868a4e43953d20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ce expref: 9 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.198957:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccf400/0x48868a4e43953d20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ce expref: 9 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.198984:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129815.198988:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.198994:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.198999:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.199006:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.199017:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129815.199041:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054174336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.199046:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7468 00000100:00100000:0.0:1746129815.200435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.200549:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054174464 00000100:00100000:1.0:1746129815.200554:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054174464 00000100:00100000:1.0:1746129815.200830:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10915 00000100:00100000:1.0:1746129815.200837:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31388:x1830949054174464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129815.200870:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.200882:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35545a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.200916:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.200925:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.200933:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129815.200935:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129815.200938:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.200943:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c207800, rc 0) 00000100:00100000:1.0:1746129815.200967:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31388:x1830949054174464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 131us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.200972:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10915 00000001:00080000:0.0:1746129815.239395:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944896 is committed 00000001:00080000:0.0:1746129815.239407:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944898 is committed 00000001:00080000:0.0:1746129815.239413:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944893 is committed 00000001:00080000:0.0:1746129815.239417:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944899 is committed 00000004:00080000:0.0:1746129815.239419:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2615 committed 00000004:00080000:0.0:1746129815.239425:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2605 committed 00000004:00080000:0.0:1746129815.239430:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2604 committed 00000004:00080000:0.0:1746129815.239431:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2603 committed 00000004:00080000:0.0:1746129815.239435:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2602 committed 00000004:00080000:0.0:1746129815.239436:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2614 committed 00000004:00080000:0.0:1746129815.239438:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2601 committed 00000004:00080000:0.0:1746129815.239439:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2613 committed 00000004:00080000:0.0:1746129815.239441:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2600 committed 00000004:00080000:0.0:1746129815.239442:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2612 committed 00000004:00080000:0.0:1746129815.239443:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2611 committed 00000004:00080000:0.0:1746129815.239445:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2610 committed 00000004:00080000:0.0:1746129815.239446:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2599 committed 00000004:00080000:0.0:1746129815.239448:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2598 committed 00000004:00080000:0.0:1746129815.239449:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2609 committed 00000004:00080000:0.0:1746129815.239450:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2608 committed 00000004:00080000:0.0:1746129815.239451:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2597 committed 00000001:00080000:0.0:1746129815.239460:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944894 is committed 00010000:00010000:3.0:1746129815.239585:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.239590:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.239609:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.239618:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053953152:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129815.239620:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053951488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.239699:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.239723:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951488 00000100:00100000:0.0:1746129815.239728:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951488 00000100:00100000:0.0:1746129815.239753:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14970 00000100:00100000:0.0:1746129815.239758:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949053951488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129815.239900:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129815.239902:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:0.0:1746129815.239904:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129815 -> 1746129815 00002000:00010000:0.0:1746129815.239906:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:0.0:1746129815.239907:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129815.239928:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053951488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (228us total) trans 17179874013 rc 0/0 00000100:00100000:0.0:1746129815.239933:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14970 00000100:00100000:1.0:1746129815.241007:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053951360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.241035:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.241053:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053951872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.241064:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.241067:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053951616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.241073:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952384:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.241088:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.241097:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951360 00000100:00100000:1.0:1746129815.241098:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.241100:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951360 00000100:00100000:1.0:1746129815.241107:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.241118:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746129815.241118:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951872 00000100:00100000:0.0:1746129815.241120:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951872 00000100:00100000:1.0:1746129815.241122:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053951744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.241127:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952384 00000100:00100000:0.0:1746129815.241129:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952384 00000100:00100000:1.0:1746129815.241132:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.242154:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952896 00000100:00100000:0.0:1746129815.242160:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952896 00000100:00100000:1.0:1746129815.242166:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.242181:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951744 00000100:00100000:0.0:1746129815.242183:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951744 00000100:00100000:1.0:1746129815.242189:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.242213:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952256 00000100:00100000:0.0:1746129815.242215:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952256 00000100:00100000:0.0:1746129815.242238:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14971 00000100:00100000:0.0:1746129815.242244:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830949053951360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.242324:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14973 00000100:00100000:0.0:1746129815.242329:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3297:x1830949053952384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.242410:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952768:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129815.242421:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129815.242424:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129815.242426:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129809 00002000:00010000:0.0:1746129815.242428:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129815.242430:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:3.0:1746129815.242449:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14974 00000100:00100000:0.0:1746129815.242454:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+52:3297:x1830949053952384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (1364us total) trans 21474841198 rc 0/0 00000100:00100000:3.0:1746129815.242455:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3297:x1830949053952896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.242459:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14973 00000100:00100000:0.0:1746129815.242471:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14975 00000100:00100000:0.0:1746129815.242475:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053951744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129815.242540:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3297:x1830949053952896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (1431us total) trans 21474841199 rc 0/0 00000100:00100000:3.0:1746129815.242545:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14974 00000100:00100000:0.0:1746129815.242547:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+51:3297:x1830949053951744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1413us total) trans 17179874015 rc 0/0 00000100:00100000:0.0:1746129815.242552:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14975 00000100:00100000:3.0:1746129815.242555:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14976 00000100:00100000:3.0:1746129815.242558:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3297:x1830949053952256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.242569:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.242584:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053952128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.242600:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.242610:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053952640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129815.242623:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3297:x1830949053952256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (433us total) trans 17179874016 rc 0/0 00000100:00100000:0.0:1746129815.242625:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.242632:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053953280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129815.242637:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14976 00000100:00100000:0.0:1746129815.242643:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129815.242645:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053951616 00000100:00100000:3.0:1746129815.242647:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053951616 00000100:00100000:3.0:1746129815.242655:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952128 00000100:00100000:3.0:1746129815.242657:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952128 00000100:00100000:0.0:1746129815.242660:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952640 00000100:00100000:3.0:1746129815.242661:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053953280 00000100:00100000:3.0:1746129815.242663:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053953280 00000100:00100000:0.0:1746129815.242663:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952640 00000100:00100000:3.0:1746129815.242668:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14977 00000100:00100000:3.0:1746129815.242672:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053951616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.242674:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14978 00000100:00100000:0.0:1746129815.242678:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053952128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129815.242730:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129815.242732:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129815.242734:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129814 -> 1746129814 00002000:00010000:3.0:1746129815.242736:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129815.242737:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4139 -> 4139 00000100:00100000:0.0:1746129815.242757:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3299:x1830949053952128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (156us total) trans 17179874018 rc 0/0 00000100:00100000:3.0:1746129815.242761:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3299:x1830949053951616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (191us total) trans 17179874017 rc 0/0 00000100:00100000:0.0:1746129815.242762:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14978 00000100:00100000:3.0:1746129815.242765:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14977 00000100:00100000:0.0:1746129815.242776:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14979 00000100:00100000:3.0:1746129815.242779:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14980 00000100:00100000:0.0:1746129815.242780:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3299:x1830949053953280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129815.242783:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3299:x1830949053952640:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.242828:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd47b80/2, rc 0, transno 17179874017 00000100:00100000:0.0:1746129815.242833:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053951616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.242840:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd44000/2, rc 0, transno 17179874018 00000100:00100000:0.0:1746129815.242842:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053952128:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129815.242883:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:3.0:1746129815.242886:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129815.242887:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:3.0:1746129815.242888:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129815.242890:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:3.0:1746129815.242910:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3299:x1830949053952640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (283us total) trans 21474841200 rc 0/0 00000100:00100000:3.0:1746129815.242914:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14980 00002000:00010000:0.0:1746129815.242951:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129815.242954:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:0.0:1746129815.242956:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129815 -> 1746129815 00002000:00010000:0.0:1746129815.242958:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:0.0:1746129815.242960:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:3.0:1746129815.242968:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129815.242970:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129815.242972:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129815.242973:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129815.242975:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129815.242979:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3297:x1830949053951360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 736us (1944us total) trans 17179874019 rc 0/0 00000100:00100000:0.0:1746129815.242984:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14971 00000100:00100000:3.0:1746129815.242990:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3299:x1830949053953280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 210us (346us total) trans 21474841201 rc 0/0 00000100:00100000:3.0:1746129815.242995:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14979 00000004:00080000:3.0:1746129815.243302:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423ed80/2, rc 0, transno 21474841200 00000100:00100000:3.0:1746129815.243315:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053952640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129815.243324:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8791c00/2, rc 0, transno 21474841201 00000100:00100000:3.0:1746129815.243327:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053953280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129815.243706:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.243743:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.243756:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053953408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.243767:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952768 00000100:00100000:1.0:1746129815.243769:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.243771:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952768 00000004:00080000:1.0:1746129815.243781:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6ec380/2, rc 0, transno 17179874019 00000100:00100000:1.0:1746129815.243784:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053951360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.243784:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053953408 00000100:00100000:0.0:1746129815.243786:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053953408 00000004:00080000:1.0:1746129815.243789:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd46680/2, rc 0, transno 17179874014 00000100:00100000:1.0:1746129815.243792:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053951872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.243794:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14981 00000004:00080000:1.0:1746129815.243797:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423e300/2, rc 0, transno 21474841198 00000100:00100000:0.0:1746129815.243798:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3297:x1830949053952768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.243799:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952384:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.243804:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8792680/2, rc 0, transno 21474841199 00000100:00100000:1.0:1746129815.243806:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.243812:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd47100/2, rc 0, transno 17179874015 00000100:00100000:1.0:1746129815.243814:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053951744:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.243818:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd46a00/2, rc 0, transno 17179874016 00000100:00100000:1.0:1746129815.243820:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.243835:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14982 00000100:00100000:1.0:1746129815.243840:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3297:x1830949053953408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.243926:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3297:x1830949053953408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (156us total) trans 21474841203 rc 0/0 00000100:00100000:1.0:1746129815.243934:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14982 00000004:00080000:1.0:1746129815.243959:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423d880/2, rc 0, transno 21474841202 00000100:00100000:1.0:1746129815.243961:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053952768:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.243966:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790000/2, rc 0, transno 21474841203 00000100:00100000:1.0:1746129815.243968:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053953408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.244086:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949053952768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (154us total) trans 21474841202 rc 0/0 00000100:00100000:0.0:1746129815.244092:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14981 00000004:00080000:0.0:1746129815.244141:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd45880/2, rc 0, transno 17179874013 00000100:00100000:0.0:1746129815.244145:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053951488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.244149:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053952000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.244167:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.244178:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053952512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.244190:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.244198:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053953024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.244208:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.244221:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053952512 00000100:00100000:0.0:1746129815.244223:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053952512 00000100:00100000:0.0:1746129815.244247:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14983 00000100:00100000:0.0:1746129815.244251:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3298:x1830949053952000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.244326:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053952000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (158us total) trans 17179874020 rc 0/0 00000100:00100000:0.0:1746129815.244331:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14983 00000100:00100000:0.0:1746129815.244344:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14985 00000100:00100000:0.0:1746129815.244348:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053953024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.244418:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053953024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (209us total) trans 21474841205 rc 0/0 00000100:00100000:0.0:1746129815.244422:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14985 00000004:00080000:0.0:1746129815.244443:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fd47800/2, rc 0, transno 17179874020 00000100:00100000:0.0:1746129815.244446:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053952000:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.244452:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423ea00/2, rc 0, transno 21474841204 00000100:00100000:0.0:1746129815.244455:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053952512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.244459:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8790380/2, rc 0, transno 21474841205 00000100:00100000:0.0:1746129815.244461:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053953024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.244918:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746129815.244927:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053953664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.244946:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.248562:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.248646:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053953536:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129815.248683:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fccea00/0x48868a4e43953df2 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 9 pid: 15044 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129815.248698:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.248723:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba79200, rc 0) 00000100:00100000:3.0:1746129815.248757:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31384:x1830949054173952:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 56210us (56507us total) trans 8589944899 rc 0/0 00000100:00100000:3.0:1746129815.248764:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10913 00000004:00080000:1.0:1746129815.251020:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061dc00/2, rc 0, transno 21474841206 00000100:00100000:1.0:1746129815.251029:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053953664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.251406:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.251891:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054174848 00000100:00100000:3.0:1746129815.251896:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054174848 00000100:00100000:3.0:1746129815.251933:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4535 00000100:00100000:3.0:1746129815.251939:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31384:x1830949054174848:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:3.0:1746129815.252015:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31384:x1830949054174848:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 75us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.252020:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4535 00000100:00100000:1.0:1746129815.263336:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054175104 00000100:00100000:1.0:1746129815.263344:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054175104 00002000:00100000:1.0:1746129815.263385:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88008fad0a80 x1830949054175104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129815.263394:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949054175104 ext(1048576->2097151) 00002000:00010000:1.0:1746129815.263399:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0a80 00000100:00100000:3.0:1746129815.263415:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054175232 00000100:00100000:1.0:1746129815.263416:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6678 00000100:00100000:3.0:1746129815.263419:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054175232 00000100:00100000:1.0:1746129815.263423:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054175104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129815.263442:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14987 00000100:00100000:3.0:1746129815.263448:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:31384:x1830949054175232:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129815.263456:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.263470:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355461 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.263490:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcce000/0x48868a4e43953d7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f1 expref: 38 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.263497:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.263503:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.263504:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.263507:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1253376->1937407] (req 1253376->1937407) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.263531:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.263541:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746129815.263550:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053953792:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.263623:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcce000/0x48868a4e43953d7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f1 expref: 38 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.263630:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcce000/0x48868a4e43953d7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f1 expref: 38 pid: 10930 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746129815.263638:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053953920:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.263653:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129815.273453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.273487:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053953920:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129815.273570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.273603:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053953792:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.273631:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1253376->1937407] (req 1253376->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.273643:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fdc00, rc 0) 00000100:00100000:3.0:1746129815.273670:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:31384:x1830949054175232:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10221us (10338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.273676:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14987 00000100:00100000:1.0:1746129815.273773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.273964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.273985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.274003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.274006:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054175616 00000100:00100000:3.0:1746129815.274009:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054175616 00000100:00100000:1.0:1746129815.274015:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054176512 00000100:00100000:1.0:1746129815.274017:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054176512 00010000:00010000:1.0:1746129815.274028:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 861 lvb_type: 1 00002000:00100000:3.0:1746129815.274029:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009207e300 x1830949054175616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.274037:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949054175616 ext(2097152->3145727) 00002000:00010000:3.0:1746129815.274040:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:1.0:1746129815.274041:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7470 00000100:00100000:1.0:1746129815.274045:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:1962:x1830949054176512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129815.274050:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054175872 00000100:00100000:3.0:1746129815.274052:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054175872 00010000:00010000:1.0:1746129815.274052:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746129815.274059:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009207df80 x1830949054175872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129815.274059:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 861 lvb_type: 1 00002000:00100000:3.0:1746129815.274065:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949054175872 ext(3145728->4194303) 00010000:00010000:1.0:1746129815.274066:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 861 lvb_type: 1 00002000:00010000:3.0:1746129815.274067:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207df80 00000100:00100000:3.0:1746129815.274075:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054176128 00000100:00100000:3.0:1746129815.274076:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054176128 00010000:00010000:1.0:1746129815.274076:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3be00/0x48868a4e43953dd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355429 expref: 37 pid: 8437 timeout: 861 lvb_type: 1 00002000:00100000:3.0:1746129815.274083:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009207d880 x1830949054176128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129815.274086:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.274087:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746129815.274089:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949054176128 ext(2097152->3145727) 00002000:00010000:3.0:1746129815.274091:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d880 00010000:00010000:1.0:1746129815.274092:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.274099:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054176384 00010000:00010000:1.0:1746129815.274099:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.274100:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054176384 00002000:00100000:3.0:1746129815.274107:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009207f100 x1830949054176384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.274112:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949054176384 ext(3145728->4194303) 00002000:00010000:3.0:1746129815.274114:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:3.0:1746129815.274121:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6679 00010000:00010000:1.0:1746129815.274121:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.274126:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054175616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129815.274134:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053954048:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129815.274173:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129815.274189:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6680 00000100:00100000:1.0:1746129815.274194:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054175872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129815.275332:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054175104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11909us (12054us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129815.275338:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6678 00002000:00100000:0.0:1746129815.275343:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88008fad0a80 x1830949054175104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.275350:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949054175104 ext(1048576->2097151) 00002000:00010000:0.0:1746129815.275353:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0a80 00000100:00100000:0.0:1746129815.281292:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.281321:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054176768 00000100:00100000:0.0:1746129815.281329:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054176768 00002000:00100000:0.0:1746129815.281363:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1253376->1257471) req@ffff88009468f800 x1830949054176768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.281372:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468f800 with x1830949054176768 ext(1253376->1257471) 00002000:00010000:0.0:1746129815.281376:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468f800 00000100:00100000:0.0:1746129815.281396:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6683 00000100:00100000:0.0:1746129815.281402:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+41:1963:x1830949054176768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129815.283035:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+40:1963:x1830949054176768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 1630us (1749us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129815.283043:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6683 00002000:00100000:0.0:1746129815.283049:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1253376->1257471) req@ffff88009468f800 x1830949054176768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.283056:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468f800 with x1830949054176768 ext(1253376->1257471) 00002000:00010000:0.0:1746129815.283060:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468f800 00000100:00100000:3.0:1746129815.291480:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054176896 00000100:00100000:3.0:1746129815.291488:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054176896 00000100:00100000:3.0:1746129815.291515:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054177024 00000100:00100000:3.0:1746129815.291517:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054177024 00000100:00100000:3.0:1746129815.291539:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14988 00000100:00100000:3.0:1746129815.291545:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31388:x1830949054176896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129815.291559:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.291573:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355468 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.291595:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 39 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.291605:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129815.291607:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129815.291610:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 38 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.291631:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 39 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.291640:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 39 pid: 3624 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.291649:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053954176:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129815.291652:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054175872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17458us (17878us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129815.291659:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6680 00002000:00100000:1.0:1746129815.291666:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009207df80 x1830949054175872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129815.291673:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949054175872 ext(3145728->4194303) 00002000:00010000:1.0:1746129815.291677:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207df80 00000100:00100000:3.0:1746129815.291691:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129815.296058:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053954176:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.296083:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 38 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.296097:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fce00, rc 0) 00000100:00100000:3.0:1746129815.297211:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31388:x1830949054176896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5661us (6052us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.297219:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14988 00000100:00100000:0.0:1746129815.299974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.300347:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054175616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26219us (26774us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129815.300358:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6679 00002000:00100000:3.0:1746129815.300368:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009207e300 x1830949054175616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.300377:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949054175616 ext(2097152->3145727) 00010000:00010000:3.0:1746129815.300386:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b800/0x48868a4e43953ddd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355437 expref: 19 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.300401:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b800/0x48868a4e43953ddd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355437 expref: 19 pid: 8437 timeout: 861 lvb_type: 1 00002000:00010000:3.0:1746129815.300408:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207e300 00000100:00100000:0.0:1746129815.307936:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.308547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.308584:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054177536 00000100:00100000:3.0:1746129815.308588:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054177536 00000100:00100000:3.0:1746129815.308611:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14990 00000100:00100000:3.0:1746129815.308616:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31387:x1830949054177536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129815.308625:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.308638:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355476 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.308655:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.308660:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3231744->4100095] (req 3231744->4100095) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 32 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.308665:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129815.308669:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.308697:0:1877:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3231744->4100095] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 32 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.308708:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.308717:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fc200, rc 0) 00000100:00100000:3.0:1746129815.308737:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31387:x1830949054177536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 121us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.308742:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14990 00000100:00100000:0.0:1746129815.311358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.311713:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054178048 00000100:00100000:3.0:1746129815.311720:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054178048 00000100:00100000:3.0:1746129815.311764:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4536 00000100:00100000:3.0:1746129815.311771:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31384:x1830949054178048:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129815.312332:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31384:x1830949054178048:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 560us (978us total) trans 8589944900 rc 0/0 00000100:00100000:3.0:1746129815.312339:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4536 00000100:00100000:0.0:1746129815.313086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.313149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.313464:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054177792 00000100:00100000:3.0:1746129815.313468:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054177792 00002000:00100000:3.0:1746129815.313492:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1253376->1937407) req@ffff88012b024380 x1830949054177792/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.313501:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024380 with x1830949054177792 ext(1253376->1937407) 00010000:00010000:3.0:1746129815.313508:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 36 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.313519:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 36 pid: 3624 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746129815.313530:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b024380 00000100:00100000:3.0:1746129815.313544:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1812 00000100:00100000:3.0:1746129815.313549:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1964:x1830949054177792:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129815.323162:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.324319:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054178432 00000100:00100000:3.0:1746129815.324328:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054178432 00002000:00100000:3.0:1746129815.324364:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4096000->4100095) req@ffff88009207ea00 x1830949054178432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.324373:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949054178432 ext(4096000->4100095) 00010000:00010000:3.0:1746129815.324381:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.324392:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746129815.324398:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207ea00 00000100:00100000:3.0:1746129815.324526:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1813 00000100:00100000:3.0:1746129815.324533:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054178432:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129815.324815:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054178432:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 281us (1659us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129815.324822:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1813 00002000:00100000:3.0:1746129815.324828:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4096000->4100095) req@ffff88009207ea00 x1830949054178432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/4536 e 0 to 0 dl 1746129826 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.324835:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949054178432 ext(4096000->4100095) 00010000:00010000:3.0:1746129815.324840:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.324863:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746129815.324869:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009207ea00 00000100:00100000:3.0:1746129815.329152:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+38:1964:x1830949054177792:12345-192.168.204.31@tcp:4:cat.0 Request processed in 15594us (16020us total) trans 17179874021 rc 0/0 00000100:00100000:3.0:1746129815.329162:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1812 00002000:00100000:3.0:1746129815.329171:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1253376->1937407) req@ffff88012b024380 x1830949054177792/t17179874021(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/448 e 0 to 0 dl 1746129826 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.329179:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024380 with x1830949054177792 ext(1253376->1937407) 00010000:00010000:3.0:1746129815.329188:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.329199:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746129815.329205:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b024380 00000100:00100000:0.0:1746129815.330811:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.331189:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054178688 00000100:00100000:3.0:1746129815.331196:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054178688 00002000:00100000:3.0:1746129815.331239:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3231744->4100095) req@ffff88012b027480 x1830949054178688/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.331247:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027480 with x1830949054178688 ext(3231744->4100095) 00010000:00010000:3.0:1746129815.331254:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.331265:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746129815.331271:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b027480 00000100:00100000:3.0:1746129815.331292:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1814 00000100:00100000:3.0:1746129815.331297:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054178688:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129815.332234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.332363:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054178816 00000100:00100000:3.0:1746129815.332367:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054178816 00010000:00010000:3.0:1746129815.332383:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.332599:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7473 00000100:00100000:3.0:1746129815.332606:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+38:1962:x1830949054178816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129815.332615:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129815.332636:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.332647:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.332669:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fdc00/0x48868a4e43953e0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1937407) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355461 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.333071:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.333074:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.333081:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.333089:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129815.342306:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.342330:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054179072 00000100:00100000:0.0:1746129815.342337:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054179072 00002000:00100000:0.0:1746129815.342376:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b027100 x1830949054179072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129815.342453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.342574:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054179328 00000100:00100000:3.0:1746129815.342578:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054179328 00002000:00100000:3.0:1746129815.342594:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009adaf100 x1830949054179328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.342602:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949054179328 ext(1048576->2097151) 00002000:00010000:3.0:1746129815.342606:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaf100 00000100:00100000:3.0:1746129815.342622:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6684 00000100:00100000:3.0:1746129815.342628:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054179328:12345-192.168.204.31@tcp:3:multiop.0 00002000:00100000:0.0:1746129815.342730:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027100 with x1830949054179072 ext(1048576->2097151) 00002000:00010000:0.0:1746129815.342733:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b027100 00000100:00100000:0.0:1746129815.342751:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6685 00000100:00100000:0.0:1746129815.342757:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054179072:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129815.355163:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054179072:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12396us (12856us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129815.355174:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6685 00002000:00100000:1.0:1746129815.355183:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b027100 x1830949054179072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129815.355192:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027100 with x1830949054179072 ext(1048576->2097151) 00002000:00010000:1.0:1746129815.355197:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b027100 00000100:00100000:3.0:1746129815.356970:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054179328:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14337us (14512us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129815.356978:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6684 00002000:00100000:3.0:1746129815.356985:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009adaf100 x1830949054179328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.356993:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949054179328 ext(1048576->2097151) 00002000:00010000:3.0:1746129815.356996:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaf100 00000100:00100000:0.0:1746129815.361492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.365054:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054178688:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 33747us (34238us total) trans 21474841207 rc 0/0 00000100:00100000:3.0:1746129815.365067:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1814 00002000:00100000:3.0:1746129815.365078:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3231744->4100095) req@ffff88012b027480 x1830949054178688/t21474841207(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/448 e 0 to 0 dl 1746129826 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.365086:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027480 with x1830949054178688 ext(3231744->4100095) 00010000:00010000:3.0:1746129815.365095:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 36 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:3.0:1746129815.365108:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b6b7600/0x48868a4e43953e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3231744->4100095) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35546f expref: 36 pid: 1877 timeout: 861 lvb_type: 0 00002000:00010000:3.0:1746129815.365114:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b027480 00000100:00100000:0.0:1746129815.367301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.377676:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.377707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.377720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.378516:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.378528:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054180480 00000100:00100000:0.0:1746129815.378530:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054180480 00002000:00100000:0.0:1746129815.378543:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a504c700 x1830949054180480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.378550:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949054180480 ext(3145728->4194303) 00002000:00010000:0.0:1746129815.378553:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c700 00000100:00100000:0.0:1746129815.378565:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054180608 00000100:00100000:0.0:1746129815.378567:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054180608 00002000:00100000:0.0:1746129815.378576:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a504e680 x1830949054180608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129815.378581:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949054180608 ext(2097152->3145727) 00002000:00010000:0.0:1746129815.378584:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504e680 00000100:00100000:0.0:1746129815.378592:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6687 00000100:00100000:0.0:1746129815.378596:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054180480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129815.379795:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6689 00000100:00100000:0.0:1746129815.379800:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054180608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129815.381441:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054180736 00000100:00100000:3.0:1746129815.381448:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054180736 00002000:00100000:3.0:1746129815.381486:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008fad3800 x1830949054180736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.381494:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949054180736 ext(3145728->4194303) 00002000:00010000:3.0:1746129815.381498:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3800 00000100:00100000:3.0:1746129815.381518:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6690 00000100:00100000:3.0:1746129815.381524:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054180736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129815.389820:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054180224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11230us (12142us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129815.389831:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6686 00002000:00100000:3.0:1746129815.389841:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012b024000 x1830949054180224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.389872:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024000 with x1830949054180224 ext(3145728->4194303) 00002000:00010000:3.0:1746129815.389877:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024000 00000100:00100000:3.0:1746129815.402180:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054180736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20654us (21620us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129815.402188:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6690 00002000:00100000:3.0:1746129815.402194:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008fad3800 x1830949054180736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.402201:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949054180736 ext(3145728->4194303) 00002000:00010000:3.0:1746129815.402205:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3800 00000100:00100000:0.0:1746129815.404779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.411249:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054181248 00000100:00100000:3.0:1746129815.411258:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054181248 00002000:00100000:3.0:1746129815.411294:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88008fad1880 x1830949054181248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.411303:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1880 with x1830949054181248 ext(4194304->4931583) 00002000:00010000:3.0:1746129815.411307:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad1880 00000100:00100000:3.0:1746129815.411336:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6691 00000100:00100000:3.0:1746129815.411343:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054181248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129815.419290:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054181248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7936us (8091us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129815.419301:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6691 00002000:00100000:3.0:1746129815.419310:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88008fad1880 x1830949054181248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.419319:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1880 with x1830949054181248 ext(4194304->4931583) 00002000:00010000:3.0:1746129815.419324:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad1880 00000100:00100000:0.0:1746129815.419520:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.420308:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054181504 00000100:00100000:3.0:1746129815.420315:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054181504 00002000:00100000:3.0:1746129815.420343:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a504dc00 x1830949054181504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/0 e 0 to 0 dl 1746129826 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.420351:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949054181504 ext(4194304->4931583) 00002000:00010000:3.0:1746129815.420354:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:3.0:1746129815.420934:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6692 00000100:00100000:3.0:1746129815.420942:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054181504:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129815.430089:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.430159:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054181760 00000100:00100000:3.0:1746129815.430168:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054181760 00000100:00100000:3.0:1746129815.430218:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4537 00000100:00100000:3.0:1746129815.430234:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c562450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31387:x1830949054181760:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129815.430413:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c562450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31387:x1830949054181760:12345-192.168.204.31@tcp:35:cat.0 Request processed in 179us (333us total) trans 8589944901 rc 0/0 00000100:00100000:3.0:1746129815.430419:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4537 00000100:00100000:3.0:1746129815.434239:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054181504:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13280us (14701us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129815.434251:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6692 00002000:00100000:3.0:1746129815.434261:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a504dc00 x1830949054181504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:556/0 lens 488/440 e 0 to 0 dl 1746129826 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129815.434270:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949054181504 ext(4194304->4931583) 00002000:00010000:3.0:1746129815.434275:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:0.0:1746129815.451139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.452087:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054182016 00000100:00100000:3.0:1746129815.452096:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054182016 00000100:00100000:3.0:1746129815.452179:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4538 00000100:00100000:3.0:1746129815.452186:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31388:x1830949054182016:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129815.454013:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31388:x1830949054182016:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1821us (2875us total) trans 8589944902 rc 0/0 00000100:00100000:3.0:1746129815.454022:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4538 00000100:00100000:0.0:1746129815.467189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.467394:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054182144 00000100:00100000:3.0:1746129815.467402:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054182144 00000100:00100000:3.0:1746129815.467602:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10916 00000100:00100000:3.0:1746129815.467610:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31395:x1830949054182144:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129815.467629:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.467643:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81000/0x48868a4e43953e38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35548b expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.467694:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467706:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467715:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467727:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467732:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467737:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467827:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467840:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35540d expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.467884:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.467912:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35540d expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.467921:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a00cb200/0x48868a4e43953d89 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35540d expref: 283 pid: 14313 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.467932:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053955200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.468012:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129815.469321:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053955200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.469335:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129815.469541:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.469711:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054182400 00000100:00100000:3.0:1746129815.469716:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054182400 00000100:00100000:3.0:1746129815.469753:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4539 00000100:00100000:3.0:1746129815.469758:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:7658:x1830949054182400:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129815.470527:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:7658:x1830949054182400:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 767us (985us total) trans 8589944903 rc 0/0 00000100:00100000:3.0:1746129815.470534:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4539 00000100:00100000:0.0:1746129815.472238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129815.473093:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473102:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129815.473133:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:3.0:1746129815.473137:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129815.473150:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473158:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473166:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473171:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473177:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473181:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb81200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129815.473185:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473190:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473198:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129815.473200:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129815.473203:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473207:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81200/0x48868a4e43953e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473216:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473231:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473235:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473239:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb81400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129815.473242:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473246:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473252:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8700) 00010000:00010000:3.0:1746129815.473253:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129815.473255:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473259:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81400/0x48868a4e43953e46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.473287:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81000/0x48868a4e43953e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35548b expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.473296:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35548b expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.473302:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129815.473304:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129815.473306:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb81600, rc 0) 00000100:00100000:3.0:1746129815.473342:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31395:x1830949054182144:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 5733us (6161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.473347:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10916 00000100:00100000:0.0:1746129815.476783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.479875:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.479901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.479923:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.479941:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.479956:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054182784 00000100:00100000:0.0:1746129815.479961:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054182784 00000100:00100000:0.0:1746129815.479995:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054182912 00000100:00100000:0.0:1746129815.479997:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054182912 00000100:00100000:0.0:1746129815.480005:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054183168 00000100:00100000:0.0:1746129815.480006:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054183168 00000100:00100000:0.0:1746129815.480014:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054183040 00000100:00100000:0.0:1746129815.480015:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054183040 00000100:00100000:0.0:1746129815.480025:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14994 00000100:00100000:0.0:1746129815.480031:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054182784:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129815.480041:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.480052:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355499 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.480073:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480074:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480081:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480092:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480100:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b3600, rc 0) 00000100:00100000:0.0:1746129815.480127:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054182784:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 96us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.480132:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14994 00000100:00100000:0.0:1746129815.480143:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14995 00000100:00100000:0.0:1746129815.480147:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054182912:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129815.480152:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.480157:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554a0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.480165:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480166:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480170:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480177:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480186:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b2000, rc 0) 00000100:00100000:0.0:1746129815.480198:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054182912:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.480202:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14995 00000100:00100000:0.0:1746129815.480209:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14996 00000100:00100000:0.0:1746129815.480213:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054183168:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129815.480218:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.480236:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554ae expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.480245:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480246:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480250:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480258:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480264:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b2200, rc 0) 00000100:00100000:0.0:1746129815.480277:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054183168:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 64us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.480281:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14996 00000100:00100000:0.0:1746129815.480290:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14997 00000100:00100000:0.0:1746129815.480294:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054183040:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129815.480301:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.480305:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554a7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.480313:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480314:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480317:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480324:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480330:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b3e00, rc 0) 00000100:00100000:0.0:1746129815.480341:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054183040:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 47us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.480346:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14997 00000100:00080000:0.0:1746129815.480357:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129815.480420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.480434:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054183296 00000100:00100000:0.0:1746129815.480436:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054183296 00000100:00100000:0.0:1746129815.480448:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14998 00000100:00100000:0.0:1746129815.480452:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054183296:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129815.480457:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.480463:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554b5 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.480471:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480473:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.480476:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480483:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.480489:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b3400, rc 0) 00000100:00100000:0.0:1746129815.480501:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054183296:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 49us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.480505:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14998 00000100:00100000:0.0:1746129815.483175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.483517:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054183552 00000100:00100000:3.0:1746129815.483523:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054183552 00000100:00100000:3.0:1746129815.483566:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10917 00000100:00100000:3.0:1746129815.483572:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31395:x1830949054183552:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129815.483585:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.483597:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81800/0x48868a4e43953e7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554bc expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.483668:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81a00/0x48868a4e43953e85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.483677:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35548b expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.483683:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81a00/0x48868a4e43953e85 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.483707:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35548b expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.483715:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81600/0x48868a4e43953e4d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35548b expref: 8 pid: 15044 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.483725:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053955328:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.485020:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129815.489770:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053955328:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.489789:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81a00/0x48868a4e43953e85 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129815.489882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129815.504287:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81a00/0x48868a4e43953e85 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554bc expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.504298:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129815.504300:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129815.504302:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb81a00, rc 0) 00000100:00100000:2.0:1746129815.504336:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054183552:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 20764us (21167us total) trans 8589944904 rc 0/0 00000100:00100000:2.0:1746129815.504342:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10917 00000100:00100000:0.0:1746129815.509778:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.509875:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054183936 00000100:00100000:2.0:1746129815.509883:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054183936 00000100:00100000:2.0:1746129815.510103:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10918 00000100:00100000:2.0:1746129815.510111:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054183936:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129815.510130:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129815.510133:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129815.510156:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb81a00/0x48868a4e43953e85 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554bc expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.510169:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129815.510173:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129815.510182:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620800/0x48868a4e43953e93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554c3 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.510262:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620600/0x48868a4e43953e9a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.510272:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620600/0x48868a4e43953e9a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.510280:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620600/0x48868a4e43953e9a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129815.510290:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:2.0:1746129815.510367:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620800/0x48868a4e43953e93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554c3 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.510388:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620600/0x48868a4e43953e9a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554c3 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.510395:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129815.510397:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129815.510399:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5620600, rc 0) 00000100:00100000:2.0:1746129815.510437:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31395:x1830949054183936:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 327us (664us total) trans 8589944905 rc 0/0 00000100:00100000:2.0:1746129815.510443:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10918 00000100:00100000:2.0:1746129815.514005:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.514132:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184064 00000100:00100000:3.0:1746129815.514140:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184064 00000100:00100000:3.0:1746129815.514174:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10919 00000100:00100000:3.0:1746129815.514181:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31395:x1830949054184064:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129815.514201:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.514216:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb80a00/0x48868a4e43953ea8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554ca expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.514280:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb80a00/0x48868a4e43953ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ca expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.514291:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb80a00/0x48868a4e43953ea8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ca expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.514305:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129815.514308:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129815.514310:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb80a00, rc 0) 00000100:00100000:3.0:1746129815.514352:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31395:x1830949054184064:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 171us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.514358:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10919 00000100:00100000:2.0:1746129815.520337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.520373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.520402:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.520425:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184448 00000100:00100000:2.0:1746129815.520425:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184192 00000100:00100000:3.0:1746129815.520432:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184448 00000100:00100000:2.0:1746129815.520432:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184192 00000100:00100000:3.0:1746129815.520463:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184704 00000100:00100000:3.0:1746129815.520464:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184704 00000100:00100000:2.0:1746129815.521427:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 14999 00000100:00100000:2.0:1746129815.521437:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054184448:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129815.521496:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.521534:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.521558:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521565:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 37 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521571:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.521573:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.521575:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.521624:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 37 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521636:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 37 pid: 3624 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.521647:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053955456:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.521738:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521745:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 8 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.521752:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095240380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053955584:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.521779:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 37 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.521786:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 37 pid: 3624 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746129815.521791:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053955712:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.521804:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129815.521829:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15000 00000100:00100000:2.0:1746129815.521835:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054184192:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129815.521888:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.521906:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 34 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521912:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521918:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521923:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.521925:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.521926:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.521946:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521954:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 18 pid: 3623 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.521962:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053955840:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.521986:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.521993:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 9 pid: 3624 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.522000:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053955968:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.522009:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15001 00000100:00100000:3.0:1746129815.522015:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054184704:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129815.522022:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 34 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522029:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 34 pid: 10930 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.522035:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053956096:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.522045:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.522054:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.522060:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129815.522061:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.522068:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 34 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.522073:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.522074:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.522076:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.522090:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 34 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.522097:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 34 pid: 1877 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.522104:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053956224:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.522114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129815.522128:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129815.522128:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184320 00000100:00100000:2.0:1746129815.522132:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184320 00010000:00010000:3.0:1746129815.522134:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746129815.522145:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053956352:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.522161:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15002 00010000:00010000:3.0:1746129815.522165:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.522166:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054184320:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129815.522172:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 18 pid: 1877 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.522178:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053956480:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.522180:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.522188:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00010000:00010000:2.0:1746129815.522188:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522194:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522201:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522206:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.522208:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.522210:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.522233:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522241:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.522249:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053956608:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.522275:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522282:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.522289:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053956736:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.522306:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129815.522313:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.522320:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053956864:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.522331:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129815.522379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.522410:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129815.523297:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184576 00000100:00100000:1.0:1746129815.523302:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184576 00000100:00100000:1.0:1746129815.523320:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184832 00000100:00100000:1.0:1746129815.523321:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184832 00000100:00100000:1.0:1746129815.523332:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15003 00000100:00100000:1.0:1746129815.523336:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054184576:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129815.523351:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.523361:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 34 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.523367:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.523373:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.523377:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.523378:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.523379:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129815.523408:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.523415:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 18 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129815.523427:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053956992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129815.523461:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.523468:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 10 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129815.523474:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053957120:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129815.523487:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 34 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.523493:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 34 pid: 1140 timeout: 861 lvb_type: 1 00000100:00100000:1.0:1746129815.523499:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053957248:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129815.523508:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129815.525748:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15004 00000100:00100000:0.0:1746129815.525760:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054184832:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129815.525791:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.525804:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 37 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.525811:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.525819:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.525824:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.525826:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.525828:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.525867:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.525877:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 37 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.525887:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053957376:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.525952:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.525959:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 10 pid: 7976 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.525967:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053957504:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.525986:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 37 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.525998:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 37 pid: 7975 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.526005:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053957632:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129815.526017:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129815.533065:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ef100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053955456:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.533099:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095240380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053955584:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.533121:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053955712:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.533148:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.533183:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.533200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.533215:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054184960 00000100:00100000:2.0:1746129815.533231:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054184960 00010000:00010000:2.0:1746129815.533256:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 38 pid: 3624 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.533275:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185216 00000100:00100000:2.0:1746129815.533277:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185216 00010000:00010000:2.0:1746129815.533284:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746129815.533298:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7477 00000100:00100000:2.0:1746129815.533303:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+38:1963:x1830949054184960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.533316:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.533333:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 38 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.533343:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 38 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.533362:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5621800/0x48868a4e43953e31 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355484 expref: 38 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.533374:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.533406:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:1963:x1830949054184960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.533412:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7477 00000100:00100000:2.0:1746129815.533438:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7478 00000100:00100000:2.0:1746129815.533443:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949054185216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.533450:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.533462:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.533469:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.533480:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fce00/0x48868a4e43953e15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355468 expref: 38 pid: 3624 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.533487:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.533499:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949054185216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.533504:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7478 00000100:00100000:2.0:1746129815.533534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.533548:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185088 00000100:00100000:2.0:1746129815.533551:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185088 00010000:00010000:2.0:1746129815.533560:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 11 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.533572:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7479 00000100:00100000:2.0:1746129815.533576:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054185088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.533582:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.533588:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 11 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.533638:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 11 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.533649:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b2000/0x48868a4e43953e62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a0 expref: 11 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.533657:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.533659:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.533662:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533669:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533685:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.533698:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054185088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 121us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.533703:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7479 00010000:00010000:2.0:1746129815.533738:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533744:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533760:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533771:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533777:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533782:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5620400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129815.533786:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533792:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533800:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.533805:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5620400/0x48868a4e43953eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.533837:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054184448:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 12402us (13464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.533843:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 14999 00000100:00100000:2.0:1746129815.534012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534022:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185344 00000100:00100000:2.0:1746129815.534025:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185344 00010000:00010000:2.0:1746129815.534037:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 19 pid: 3623 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534052:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7480 00000100:00100000:2.0:1746129815.534056:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054185344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.534062:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.534074:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 19 pid: 3623 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534082:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 19 pid: 3623 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534094:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.534111:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054185344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.534116:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7480 00010000:00010000:2.0:1746129815.534144:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98a00/0x48868a4e43953dba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35541b expref: 18 pid: 3623 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534156:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053955840:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.534164:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053955968:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.534171:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053956096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.534183:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.534201:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053956608:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.534208:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053956736:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129815.534214:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949053956864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129815.534242:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.534266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534277:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185600 00000100:00100000:2.0:1746129815.534279:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185600 00010000:00010000:2.0:1746129815.534289:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534302:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7481 00000100:00100000:2.0:1746129815.534307:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949054185600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.534312:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.534319:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534327:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534337:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fccf000/0x48868a4e43953d6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553e3 expref: 35 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534344:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.534358:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054185600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.534366:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7481 00000100:00100000:2.0:1746129815.534401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534411:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185984 00000100:00100000:2.0:1746129815.534413:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185984 00010000:00010000:2.0:1746129815.534422:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534434:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7482 00000100:00100000:2.0:1746129815.534438:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054185984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.534443:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.534451:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534458:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534467:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3600/0x48868a4e43953e5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355499 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534476:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.534488:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054185984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.534493:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7482 00000100:00100000:2.0:1746129815.534525:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534581:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185472 00000100:00100000:2.0:1746129815.534584:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185472 00010000:00010000:2.0:1746129815.534594:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 11 pid: 3624 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534606:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185856 00000100:00100000:2.0:1746129815.534608:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185856 00010000:00010000:2.0:1746129815.534614:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534628:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7483 00000100:00100000:2.0:1746129815.534632:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054185472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.534638:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.534645:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 11 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534652:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 11 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534662:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621a00/0x48868a4e43953e54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355492 expref: 11 pid: 3624 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534671:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.534673:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.534675:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534682:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534698:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.534712:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054185472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.534717:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7483 00000100:00100000:2.0:1746129815.534729:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7484 00000100:00100000:2.0:1746129815.534733:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:1964:x1830949054185856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.534739:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.534746:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534753:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534762:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095347800/0x48868a4e43953dc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355422 expref: 37 pid: 3623 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.534770:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.534780:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1964:x1830949054185856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.534784:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7484 00010000:00010000:2.0:1746129815.534800:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534806:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534821:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534828:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534833:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534837:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f57e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129815.534839:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534844:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534870:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.534874:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f57e00/0x48868a4e43953eb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.534898:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054184192:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 13065us (14570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.534903:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15000 00000100:00100000:2.0:1746129815.534927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534959:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.534965:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186112 00000100:00100000:2.0:1746129815.534967:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186112 00010000:00010000:2.0:1746129815.534975:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 34 pid: 1877 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746129815.534984:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186240 00000100:00100000:2.0:1746129815.534985:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186240 00010000:00010000:2.0:1746129815.534990:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 18 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.534999:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7485 00000100:00100000:2.0:1746129815.535002:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054186112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.535006:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.535013:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 34 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.535019:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 34 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.535027:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.535036:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054186112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.535040:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7485 00000100:00100000:2.0:1746129815.535048:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7486 00000100:00100000:2.0:1746129815.535051:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054186240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.535055:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.535061:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 18 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.535067:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 18 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.535074:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.535080:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054186240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 29us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.535084:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7486 00000100:00100000:2.0:1746129815.535126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.535156:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.535163:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186368 00000100:00100000:2.0:1746129815.535165:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186368 00010000:00010000:2.0:1746129815.535172:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.535181:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186496 00000100:00100000:2.0:1746129815.535182:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186496 00010000:00010000:2.0:1746129815.535187:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 34 pid: 1140 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.535195:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7487 00000100:00100000:2.0:1746129815.535198:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054186368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.535201:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.535206:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.535217:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 9 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.535239:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.535250:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054186368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.535254:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7487 00000100:00100000:2.0:1746129815.535263:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7488 00000100:00100000:2.0:1746129815.535266:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054186496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.535271:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.535276:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 34 pid: 1140 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.535282:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 34 pid: 1140 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.535288:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.535289:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.535292:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.535297:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.535304:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.535312:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054186496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.535316:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7488 00010000:00010000:3.0:1746129815.536456:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c68400/0x48868a4e43953e2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35547d expref: 33 pid: 1877 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.536470:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053956224:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.536478:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053956352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.536485:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053956480:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.536500:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537362:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ac00/0x48868a4e43953dc8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355430 expref: 17 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.537372:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053956992:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.537380:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800922b3e00/0x48868a4e43953e70 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554a7 expref: 8 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.537387:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053957120:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.537394:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3bc00/0x48868a4e43953da5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553f8 expref: 32 pid: 1140 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.537399:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053957248:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.537410:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537415:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537424:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537444:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537451:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537457:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537462:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caa1800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129815.537464:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537470:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537481:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.537485:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caa1800/0x48868a4e43953ecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129815.537535:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054184576:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 14198us (15155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.537542:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15003 00000100:00100000:2.0:1746129815.543522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.544432:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.544445:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054185728 00000100:00100000:2.0:1746129815.544452:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054185728 00010000:00010000:2.0:1746129815.544478:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 7 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.544497:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186624 00000100:00100000:2.0:1746129815.544499:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186624 00010000:00010000:2.0:1746129815.544507:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 17 pid: 1877 timeout: 861 lvb_type: 0 00000100:00100000:2.0:1746129815.544522:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7489 00000100:00100000:2.0:1746129815.544528:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054185728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.544540:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.544558:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 7 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.544568:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 7 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.544587:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800922b2200/0x48868a4e43953e69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ae expref: 7 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.544598:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.544634:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054185728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.544640:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7489 00000100:00100000:2.0:1746129815.544664:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7490 00000100:00100000:2.0:1746129815.544668:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054186624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.544673:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.544679:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 17 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.544686:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 17 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.544695:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920fc200/0x48868a4e43953e23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355476 expref: 17 pid: 1877 timeout: 861 lvb_type: 0 00010000:00010000:2.0:1746129815.544702:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.544704:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.544708:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544715:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544730:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.544740:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054186624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 72us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.544744:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7490 00000100:00100000:2.0:1746129815.544769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.544779:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186752 00000100:00100000:2.0:1746129815.544782:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186752 00010000:00010000:2.0:1746129815.544790:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.544799:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7491 00000100:00100000:2.0:1746129815.544803:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949054186752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.544808:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.544817:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.544824:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.544833:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcce800/0x48868a4e43953d74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3553ea expref: 37 pid: 10930 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.544839:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.544840:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129815.544843:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544862:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544872:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.544883:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054186752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.544888:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7491 00010000:00010000:2.0:1746129815.544903:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544909:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544924:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544929:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544935:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544941:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f56000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129815.544944:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544949:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544957:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.544961:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f56000/0x48868a4e43953ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.544989:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054184320:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 22823us (22875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.544995:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15002 00000100:00100000:2.0:1746129815.545060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.545069:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054186880 00000100:00100000:2.0:1746129815.545071:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054186880 00010000:00010000:2.0:1746129815.545080:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 36 pid: 7975 timeout: 861 lvb_type: 1 00000100:00100000:2.0:1746129815.545090:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7492 00000100:00100000:2.0:1746129815.545093:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054186880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129815.545098:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129815.545105:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 36 pid: 7975 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.545112:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 36 pid: 7975 timeout: 861 lvb_type: 1 00010000:00010000:2.0:1746129815.545122:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129815.545133:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054186880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 39us (73us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.545138:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7492 00000100:00100000:0.0:1746129815.545332:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053957376:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.545342:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fccfc00/0x48868a4e43953dac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355406 expref: 35 pid: 7975 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746129815.545349:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053957632:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129815.545393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.545408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.545420:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949053957504:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.545437:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.546907:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187008 00000100:00100000:3.0:1746129815.546914:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187008 00010000:00010000:3.0:1746129815.546931:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 7 pid: 7976 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746129815.546952:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187136 00000100:00100000:3.0:1746129815.546954:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187136 00010000:00010000:3.0:1746129815.546960:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 36 pid: 8437 timeout: 861 lvb_type: 1 00000100:00100000:3.0:1746129815.546971:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7493 00000100:00100000:3.0:1746129815.546976:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054187008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129815.546984:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129815.546995:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 7 pid: 7976 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.547004:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 7 pid: 7976 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.547018:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3400/0x48868a4e43953e77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554b5 expref: 7 pid: 7976 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.547028:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129815.547054:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054187008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.547059:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7493 00000100:00100000:3.0:1746129815.547093:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7494 00000100:00100000:3.0:1746129815.547097:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1963:x1830949054187136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129815.547103:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129815.547110:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 36 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.547117:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 36 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.547126:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x48868a4e43953dcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35543e expref: 36 pid: 8437 timeout: 861 lvb_type: 1 00010000:00010000:3.0:1746129815.547133:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.547134:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.547137:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547143:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547158:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129815.547170:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1963:x1830949054187136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 72us (1761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.547175:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7494 00010000:00010000:3.0:1746129815.547190:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547196:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547212:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547218:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547235:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547240:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb80c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129815.547243:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547249:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547258:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547263:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb80c00/0x48868a4e43953ebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.547293:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054184704:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 25279us (26891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.547299:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15001 00010000:00010000:3.0:1746129815.547403:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547409:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547420:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547425:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547430:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547435:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800922b3000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129815.547437:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547441:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547448:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.547453:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3000/0x48868a4e43953ed2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129815.547480:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054184832:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 21725us (25070us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.547484:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15004 00000100:00100000:3.0:1746129815.551302:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.551324:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187392 00000100:00100000:3.0:1746129815.551331:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187392 00000100:00100000:3.0:1746129815.551366:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10920 00000100:00100000:3.0:1746129815.551372:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31395:x1830949054187392:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129815.551410:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129815.551433:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb80a00/0x48868a4e43953ea8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ca expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551446:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129815.551450:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129815.551473:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.551482:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551489:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551494:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551500:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129815.551524:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551534:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 283 pid: 14315 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.551550:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053957760:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.551616:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551623:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 9 pid: 14315 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.551630:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053957888:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129815.551651:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.551656:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 9 pid: 15044 timeout: 861 lvb_type: 0 00000100:00100000:3.0:1746129815.551663:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053958016:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129815.551678:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8c4d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129815.558519:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053957760:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129815.560122:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053957888:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129815.560150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.560164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.560886:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.560970:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187520 00000100:00100000:0.0:1746129815.560975:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187520 00010000:00010000:0.0:1746129815.561005:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 10 pid: 14315 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746129815.561027:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187648 00000100:00100000:0.0:1746129815.561030:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187648 00010000:00010000:0.0:1746129815.561038:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 284 pid: 14315 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746129815.561053:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187776 00000100:00100000:0.0:1746129815.561055:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187776 00010000:00010000:0.0:1746129815.561062:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 11 pid: 15044 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746129815.561075:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7495 00000100:00100000:0.0:1746129815.561080:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054187520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129815.561090:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129815.561095:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 11 pid: 14315 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561104:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 11 pid: 14315 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561121:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207c00/0x48868a4e43953e00 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355453 expref: 11 pid: 14315 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561132:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129815.561137:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561143:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129815.561179:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054187520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.561186:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7495 00000100:00100000:0.0:1746129815.561200:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7496 00000100:00100000:0.0:1746129815.561204:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949054187648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129815.561211:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129815.561214:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 284 pid: 14315 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561235:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 284 pid: 14315 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561244:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c207800/0x48868a4e43953e07 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35545a expref: 284 pid: 14315 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561251:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129815.561254:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561258:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129815.561271:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949054187648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.561276:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7496 00000100:00100000:0.0:1746129815.561285:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7497 00000100:00100000:0.0:1746129815.561289:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054187776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129815.561294:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129815.561298:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 9 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561305:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 9 pid: 15044 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746129815.561314:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129815.561317:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561324:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561331:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561345:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129815.561356:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054187776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.561361:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7497 00010000:00010000:0.0:1746129815.561389:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953df9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35544c expref: 8 pid: 15044 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746129815.561397:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949053958016:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129815.561414:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561421:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129815.561425:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000040:00080000:0.0:1746129815.561995:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3433, 88 off288832 00000004:00080000:0.0:1746129815.563348:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761621497967ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563413:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3448, 88 off290064 00000004:00080000:0.0:1746129815.563416:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761621568144ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563428:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3449, 88 off290152 00000004:00080000:0.0:1746129815.563432:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761621584282ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563441:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3434, 88 off288920 00000004:00080000:0.0:1746129815.563444:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761621596083ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563452:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3435, 88 off289008 00000004:00080000:0.0:1746129815.563454:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761621606280ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563461:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3450, 88 off290240 00000004:00080000:0.0:1746129815.563463:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761621615167ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563797:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3451, 88 off290328 00000004:00080000:0.0:1746129815.563801:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761621952740ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563812:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3452, 88 off290416 00000004:00080000:0.0:1746129815.563815:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761621966702ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563822:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3436, 88 off289096 00000004:00080000:0.0:1746129815.563825:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761621976865ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563833:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3453, 88 off290504 00000004:00080000:0.0:1746129815.563836:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761621987803ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563842:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3437, 88 off289184 00000004:00080000:0.0:1746129815.563844:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761621996544ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563866:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3454, 88 off290592 00000004:00080000:0.0:1746129815.563868:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761622020077ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129815.563874:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3438, 88 off289272 00000004:00080000:0.0:1746129815.563877:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761622028887ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563882:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3439, 88 off289360 00000004:00080000:0.0:1746129815.563885:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761622037123ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563891:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3440, 88 off289448 00000004:00080000:0.0:1746129815.563893:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761622045520ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563900:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3441, 88 off289536 00000004:00080000:0.0:1746129815.563902:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 761622054525ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129815.563911:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3455, 88 off290680 00000004:00080000:0.0:1746129815.563914:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761622066052ns, next at 716792379979ns, rc = 0 00000001:00080000:0.0:1746129815.587120:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944906 is committed 00000004:00080000:0.0:1746129815.587132:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2623 committed 00000004:00080000:0.0:1746129815.587139:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2614 committed 00000004:00080000:0.0:1746129815.587143:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2613 committed 00000004:00080000:0.0:1746129815.587145:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2612 committed 00000004:00080000:0.0:1746129815.587146:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2611 committed 00000004:00080000:0.0:1746129815.587148:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2622 committed 00000004:00080000:0.0:1746129815.587149:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2610 committed 00000004:00080000:0.0:1746129815.587151:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2621 committed 00000004:00080000:0.0:1746129815.587152:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2609 committed 00000004:00080000:0.0:1746129815.587153:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2620 committed 00000004:00080000:0.0:1746129815.587155:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2619 committed 00000004:00080000:0.0:1746129815.587156:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2618 committed 00000004:00080000:0.0:1746129815.587157:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2608 committed 00000004:00080000:0.0:1746129815.587158:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2607 committed 00000004:00080000:0.0:1746129815.587160:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2617 committed 00000004:00080000:0.0:1746129815.587161:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2616 committed 00000004:00080000:0.0:1746129815.587163:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2606 committed 00000001:00080000:0.0:1746129815.587174:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944903 is committed 00000001:00080000:0.0:1746129815.587180:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944901 is committed 00000100:00100000:0.0:1746129815.587310:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.587359:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.587380:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.587393:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.587406:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129815.587409:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958272:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746129815.587462:0:15044:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ba87800 reply state ffff88009c8cb800 transno 8589944906 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:3.0:1746129815.587471:0:15044:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746129815.587536:0:15044:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129815.587546:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054187392:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 36173us (36250us total) trans 8589944906 rc 0/0 00000100:00100000:3.0:1746129815.587553:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10920 00000100:00100000:3.0:1746129815.587580:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958144 00000100:00100000:3.0:1746129815.587585:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958144 00000100:00100000:3.0:1746129815.587604:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958656 00000100:00100000:3.0:1746129815.587606:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958656 00000100:00100000:3.0:1746129815.587617:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15005 00000100:00100000:3.0:1746129815.587621:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3298:x1830949053958144:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129815.587674:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.587682:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.587688:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.587693:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4d4f600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129815.587696:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.587702:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.587715:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129815.587718:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129815.587721:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.587726:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4d4f600/0x48868a4e43953ed9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00000100:00100000:2.0:1746129815.587744:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15006 00000100:00100000:2.0:1746129815.587750:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3298:x1830949053958656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129815.587761:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3298:x1830949053958144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (401us total) trans 17179874022 rc 0/0 00000100:00100000:3.0:1746129815.587766:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15005 00000100:00100000:2.0:1746129815.587862:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3298:x1830949053958656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (452us total) trans 17179874023 rc 0/0 00000100:00100000:2.0:1746129815.587867:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15006 00000100:00100000:0.0:1746129815.588163:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.588184:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.588200:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.588569:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053958400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129815.588898:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958272 00000100:00100000:2.0:1746129815.588903:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958272 00000100:00100000:2.0:1746129815.588920:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958784 00000100:00100000:2.0:1746129815.588922:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958784 00000100:00100000:0.0:1746129815.588926:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053958528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129815.588933:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15007 00000100:00100000:2.0:1746129815.588938:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3298:x1830949053958272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.588944:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.588959:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053959040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.588972:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.588984:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053959552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.588996:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.589006:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053960064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589018:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.589038:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958528 00000100:00100000:0.0:1746129815.589040:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958528 00000100:00100000:0.0:1746129815.589054:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959040 00000100:00100000:0.0:1746129815.589055:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959040 00000100:00100000:0.0:1746129815.589063:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959552 00000100:00100000:0.0:1746129815.589064:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959552 00000100:00100000:0.0:1746129815.589073:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960064 00000100:00100000:0.0:1746129815.589074:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960064 00000100:00100000:0.0:1746129815.589082:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15008 00000100:00100000:0.0:1746129815.589086:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3298:x1830949053958784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.589166:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3298:x1830949053958784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (963us total) trans 17179874025 rc 0/0 00000100:00100000:0.0:1746129815.589171:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15008 00000100:00100000:0.0:1746129815.589181:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15009 00000100:00100000:0.0:1746129815.589186:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3297:x1830949053958528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.589314:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053958528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (369us total) trans 17179874026 rc 0/0 00000100:00100000:0.0:1746129815.589320:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15009 00000100:00100000:0.0:1746129815.589329:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15010 00000100:00100000:0.0:1746129815.589333:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3297:x1830949053959040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.589401:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053959040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (427us total) trans 17179874027 rc 0/0 00000100:00100000:0.0:1746129815.589405:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15010 00000100:00100000:0.0:1746129815.589413:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15011 00000100:00100000:0.0:1746129815.589417:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053959552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589544:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3297:x1830949053959552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (546us total) trans 21474841208 rc 0/0 00000100:00100000:0.0:1746129815.589548:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15011 00000100:00100000:0.0:1746129815.589557:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15012 00000100:00100000:0.0:1746129815.589560:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949053960064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589626:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3297:x1830949053960064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (606us total) trans 21474841209 rc 0/0 00000100:00100000:0.0:1746129815.589630:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15012 00000004:00080000:0.0:1746129815.589716:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645f800/2, rc 0, transno 17179874026 00000100:00100000:0.0:1746129815.589721:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053958528:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.589728:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645f100/2, rc 0, transno 17179874027 00000100:00100000:0.0:1746129815.589730:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053959040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.589737:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaea00/2, rc 0, transno 21474841208 00000100:00100000:0.0:1746129815.589743:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053959552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.589749:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac000/2, rc 0, transno 21474841209 00000100:00100000:0.0:1746129815.589752:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053960064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.589870:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645d180/2, rc 0, transno 17179874025 00000100:00100000:0.0:1746129815.589874:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.589881:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645fb80/2, rc 0, transno 17179874022 00000100:00100000:0.0:1746129815.589883:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958144:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129815.589890:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645c700/2, rc 0, transno 17179874023 00000100:00100000:0.0:1746129815.589892:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958656:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129815.589899:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589914:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.589929:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589940:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.589947:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053960192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589959:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.589968:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129815.589972:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.589985:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.589994:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.590004:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129815.590015:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959168 00000100:00100000:0.0:1746129815.590018:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959168 00000100:00100000:0.0:1746129815.590027:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959680 00000100:00100000:0.0:1746129815.590028:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959680 00000100:00100000:0.0:1746129815.590033:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960192 00000100:00100000:0.0:1746129815.590034:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960192 00000100:00100000:0.0:1746129815.590039:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959296 00000100:00100000:0.0:1746129815.590041:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959296 00000100:00100000:0.0:1746129815.590046:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959808 00000100:00100000:0.0:1746129815.590047:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959808 00000100:00100000:0.0:1746129815.590053:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15013 00000100:00100000:0.0:1746129815.590057:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053959168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.590149:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053959168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (233us total) trans 21474841210 rc 0/0 00000100:00100000:0.0:1746129815.590153:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15013 00000100:00100000:0.0:1746129815.590162:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15014 00000100:00100000:0.0:1746129815.590165:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053959680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.590250:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053959680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (309us total) trans 21474841211 rc 0/0 00000100:00100000:0.0:1746129815.590255:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15014 00000100:00100000:0.0:1746129815.590264:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15015 00000100:00100000:0.0:1746129815.590267:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053960192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.590346:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053960192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (385us total) trans 21474841212 rc 0/0 00000100:00100000:0.0:1746129815.590350:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15015 00000100:00100000:0.0:1746129815.590358:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15016 00000100:00100000:0.0:1746129815.590361:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053959296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.590440:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053959296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (453us total) trans 21474841213 rc 0/0 00000100:00100000:0.0:1746129815.590444:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15016 00000100:00100000:0.0:1746129815.590452:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15017 00000100:00100000:0.0:1746129815.590456:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3298:x1830949053959808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129815.590527:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3298:x1830949053959808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (521us total) trans 21474841214 rc 0/0 00000100:00100000:0.0:1746129815.590532:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15017 00000004:00080000:0.0:1746129815.590553:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac700/2, rc 0, transno 21474841213 00000100:00100000:0.0:1746129815.590557:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.590562:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac380/2, rc 0, transno 21474841214 00000100:00100000:0.0:1746129815.590564:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.590569:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaf800/2, rc 0, transno 21474841210 00000100:00100000:0.0:1746129815.590571:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.590575:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaf480/2, rc 0, transno 21474841211 00000100:00100000:0.0:1746129815.590577:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053959680:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129815.590581:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ada680/2, rc 0, transno 21474841212 00000100:00100000:0.0:1746129815.590583:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053960192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.590713:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.590730:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053958912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129815.590745:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.590754:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053959424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.590766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129815.590775:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053959936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129815.590788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129815.590931:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958400 00000100:00100000:3.0:1746129815.590935:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958400 00000100:00100000:3.0:1746129815.590948:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053958912 00000100:00100000:3.0:1746129815.590949:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053958912 00000100:00100000:3.0:1746129815.590955:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959424 00000100:00100000:3.0:1746129815.590956:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959424 00000100:00100000:3.0:1746129815.590961:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053959936 00000100:00100000:3.0:1746129815.590962:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053959936 00000100:00100000:3.0:1746129815.590969:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15018 00000100:00100000:3.0:1746129815.590973:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053958400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129815.591067:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3296:x1830949053958400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (354us total) trans 17179874028 rc 0/0 00000100:00100000:3.0:1746129815.591072:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15018 00000100:00100000:3.0:1746129815.591084:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15019 00000100:00100000:3.0:1746129815.591088:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3296:x1830949053958912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129815.591151:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3296:x1830949053958912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (404us total) trans 17179874029 rc 0/0 00000100:00100000:3.0:1746129815.591155:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15019 00000100:00100000:3.0:1746129815.591164:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15020 00000100:00100000:3.0:1746129815.591168:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830949053959424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129815.591264:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053959424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (496us total) trans 21474841215 rc 0/0 00000100:00100000:3.0:1746129815.591269:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15020 00000100:00100000:3.0:1746129815.591277:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15021 00000100:00100000:3.0:1746129815.591281:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3296:x1830949053959936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129815.591342:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746129815.591345:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746129815.591347:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129815.591349:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129815.591350:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1746129815.591366:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3296:x1830949053959936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 85us (577us total) trans 21474841216 rc 0/0 00000100:00100000:3.0:1746129815.591371:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15021 00000100:00100000:3.0:1746129815.591466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129815.591573:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054187904 00000100:00100000:3.0:1746129815.591576:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054187904 00000100:00100000:3.0:1746129815.591594:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10921 00000100:00100000:3.0:1746129815.591599:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31395:x1830949054187904:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129815.591611:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.591623:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554d1 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.591656:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.591667:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129815.591796:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+61:3298:x1830949053958272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2857us (4373us total) trans 17179874024 rc 0/0 00000100:00100000:2.0:1746129815.591804:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15007 00010000:00010000:3.0:1746129815.591822:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129815.591826:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129815.591828:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba79200, rc 0) 00000004:00080000:2.0:1746129815.591828:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645ca80/2, rc 0, transno 17179874024 00000100:00100000:2.0:1746129815.591832:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053958272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129815.591873:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054187904:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 273us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.591879:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10921 00000004:00080000:1.0:1746129815.591981:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645e680/2, rc 0, transno 17179874028 00000100:00100000:1.0:1746129815.591985:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053958400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.591991:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645ea00/2, rc 0, transno 17179874029 00000100:00100000:1.0:1746129815.591994:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053958912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129815.591999:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad880/2, rc 0, transno 21474841215 00000100:00100000:1.0:1746129815.592002:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053959424:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129815.592007:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adadf80/2, rc 0, transno 21474841216 00000100:00100000:1.0:1746129815.592010:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053959936:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129815.595667:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129815.595691:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188032 00000100:00100000:2.0:1746129815.595698:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188032 00000100:00100000:2.0:1746129815.595729:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10922 00000100:00100000:2.0:1746129815.595735:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054188032:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129815.595748:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129815.595763:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216400/0x48868a4e43953ee7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554d8 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.595909:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.595922:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.595931:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129815.595990:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:2.0:1746129815.595996:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129815.596059:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129815.596081:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216400/0x48868a4e43953ee7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.596092:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129815.596099:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129815.596102:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129815.596104:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216c00, rc 0) 00000100:00100000:2.0:1746129815.596141:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31395:x1830949054188032:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 406us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129815.596147:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10922 00000100:00100000:2.0:1746129815.599783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.600241:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188160 00000100:00100000:0.0:1746129815.600248:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188160 00000100:00100000:0.0:1746129815.600287:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15022 00000100:00100000:0.0:1746129815.600294:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1961:x1830949054188160:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129815.600309:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129815.600323:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554df expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129815.600343:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d393, atime: 0x6813d391, ctime: 0x6813d393, blocks: 0x7e7 00010000:00010000:0.0:1746129815.600357:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.600359:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.600367:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 6 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.600379:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 6 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.600388:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67400, rc 0) 00000100:00100000:0.0:1746129815.600433:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054188160:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 139us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129815.600439:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15022 00000100:00100000:0.0:1746129815.600469:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.600541:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.600554:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.600565:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.600582:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129815.600623:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188288 00000100:00100000:0.0:1746129815.600626:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188288 00000100:00100000:1.0:1746129815.601330:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188416 00000100:00100000:1.0:1746129815.601335:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188416 00000100:00100000:1.0:1746129815.601353:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188544 00000100:00100000:1.0:1746129815.601355:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188544 00000100:00100000:1.0:1746129815.601363:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188672 00000100:00100000:1.0:1746129815.601364:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188672 00000100:00100000:1.0:1746129815.601379:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054188800 00000100:00100000:1.0:1746129815.601381:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054188800 00000100:00100000:1.0:1746129815.601393:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15023 00000100:00100000:1.0:1746129815.601398:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054188288:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:3.0:1746129815.601399:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15024 00010000:00010000:1.0:1746129815.601405:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129815.601406:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054188416:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:0.0:1746129815.601411:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15025 00010000:00010000:3.0:1746129815.601412:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129815.601415:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554e6 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129815.601417:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054188544:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129815.601421:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554ed expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129815.601424:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746129815.601428:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d397, atime: 0x6813d397, ctime: 0x6813d397, blocks: 0x821 00010000:00010000:0.0:1746129815.601432:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554f4 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129815.601434:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d397, atime: 0x6813d397, ctime: 0x6813d397, blocks: 0x821 00010000:00010000:1.0:1746129815.601437:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.601439:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.601442:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.601443:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.601443:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746129815.601444:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d395, atime: 0x6813d395, ctime: 0x6813d395, blocks: 0x821 00010000:00010000:3.0:1746129815.601448:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.601452:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.601453:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.601453:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129815.601457:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.601458:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.601460:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3a400, rc 0) 00010000:00010000:3.0:1746129815.601465:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c207a00, rc 0) 00010000:00010000:0.0:1746129815.601471:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129815.601479:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67a00, rc 0) 00000100:00100000:1.0:1746129815.601481:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054188288:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 83us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.601482:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054188416:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 77us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.601486:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15023 00000100:00100000:3.0:1746129815.601490:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15024 00000100:00100000:1.0:1746129815.601496:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15026 00000100:00100000:0.0:1746129815.601496:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054188544:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 79us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.601501:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054188672:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:0.0:1746129815.601501:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15025 00000100:00100000:3.0:1746129815.601504:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15027 00010000:00010000:1.0:1746129815.601506:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129815.601509:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054188800:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129815.601512:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3554fb expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129815.601514:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129815.601521:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355502 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129815.601522:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d397, atime: 0x6813d395, ctime: 0x6813d397, blocks: 0x15e5 00010000:00010000:1.0:1746129815.601529:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:3.0:1746129815.601530:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d397, atime: 0x6813d396, ctime: 0x6813d397, blocks: 0x102b 00010000:00010000:1.0:1746129815.601530:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129815.601534:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.601536:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.601538:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129815.601542:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.601543:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129815.601550:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129815.601551:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b400, rc 0) 00010000:00010000:3.0:1746129815.601557:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c207600, rc 0) 00000100:00100000:1.0:1746129815.601567:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054188672:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 66us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129815.601570:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054188800:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 61us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129815.601572:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15026 00000100:00100000:3.0:1746129815.601575:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15027 00000001:00080000:2.0:1746129815.620073:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841205 is committed 00000001:00080000:2.0:1746129815.620115:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841166 is committed 00000001:00080000:2.0:1746129815.620139:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841185 is committed 00000001:00080000:2.0:1746129815.620147:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841159 is committed 00000001:00080000:2.0:1746129815.620162:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841206 is committed 00000001:00080000:2.0:1746129815.620175:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841187 is committed 00000001:00080000:2.0:1746129815.620187:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841164 is committed 00000001:00080000:2.0:1746129815.620212:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841207 is committed 00000001:00080000:2.0:1746129815.620240:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841186 is committed 00000001:00080000:0.0:1746129815.682829:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874027 is committed 00000001:00080000:0.0:1746129815.682880:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874003 is committed 00000001:00080000:0.0:1746129815.682922:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873950 is committed 00000001:00080000:0.0:1746129815.682950:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179873974 is committed 00000001:00080000:0.0:1746129815.682963:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874004 is committed 00000001:00080000:0.0:1746129815.683002:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874029 is committed 00000001:00080000:0.0:1746129815.683008:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874021 is committed 00010000:00010000:1.0:1746129816.197046:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129816.614017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.614083:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.615108:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054189056 00000100:00100000:3.0:1746129816.615117:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054189056 00000100:00100000:3.0:1746129816.615169:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054189312 00000100:00100000:3.0:1746129816.615172:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054189312 00000100:00100000:3.0:1746129816.615189:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6693 00000100:00100000:3.0:1746129816.615195:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054189056:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:3.0:1746129816.615253:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.615269:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129816.615271:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129816.615275:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129816.615308:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129816.615373:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6694 00000100:00100000:2.0:1746129816.615380:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054189312:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129816.615395:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.615401:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.615402:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.615405:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.615411:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.616164:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129816.617288:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.617332:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.617360:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054189696 00000100:00100000:0.0:1746129816.617364:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054189696 00000100:00100000:0.0:1746129816.617394:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054189824 00000100:00100000:0.0:1746129816.617396:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054189824 00000100:00100000:0.0:1746129816.617410:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6695 00000100:00100000:0.0:1746129816.617416:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054189696:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129816.617436:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.617445:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129816.617446:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129816.617450:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.617459:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129816.618177:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6696 00000100:00100000:1.0:1746129816.618185:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054189824:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129816.618211:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.618221:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129816.618222:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129816.618225:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.618232:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129816.628335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.628362:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.628377:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.629616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.629652:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054190208 00000100:00100000:2.0:1746129816.629659:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054190208 00000100:00100000:2.0:1746129816.629706:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054190336 00000100:00100000:2.0:1746129816.629709:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054190336 00000100:00100000:2.0:1746129816.629723:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054190592 00000100:00100000:2.0:1746129816.629725:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054190592 00000100:00100000:2.0:1746129816.629739:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6697 00000100:00100000:2.0:1746129816.629746:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054190208:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129816.629776:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.629789:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.629790:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.629795:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.629806:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129816.629962:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6698 00000100:00100000:3.0:1746129816.629969:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054190336:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:3.0:1746129816.629986:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.629993:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129816.629995:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129816.629998:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.630005:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129816.631065:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6699 00000100:00100000:2.0:1746129816.631072:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054190592:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129816.631088:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.631095:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.631097:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.631100:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.631108:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129816.636075:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054190848 00000100:00100000:0.0:1746129816.636087:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054190848 00000100:00100000:0.0:1746129816.636155:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6700 00000100:00100000:0.0:1746129816.636163:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054190848:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:0.0:1746129816.636193:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.639083:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129816.639085:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129816.639091:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.639106:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642539:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642554:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642561:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642568:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129816.642571:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642578:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642595:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.642600:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3400/0x48868a4e43953f1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129816.642910:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054189056:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 27709us (28894us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.642919:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6693 00010000:00010000:1.0:1746129816.649284:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.649300:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.649307:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.649313:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3b800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129816.649317:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.649323:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.649338:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.649343:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b800/0x48868a4e43953f34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129816.649428:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054189824:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 31240us (32090us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129816.649437:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6696 00010000:00010000:3.0:1746129816.656675:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.656691:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.656697:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.656702:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87ac00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129816.656706:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.656713:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.656727:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.656733:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87ac00/0x48868a4e43953f26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129816.657648:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054189312:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 42263us (43559us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.657658:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6694 00010000:00010000:1.0:1746129816.662760:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.662774:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.662793:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.662799:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009caa0200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129816.662803:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.662810:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.662824:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.662829:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009caa0200/0x48868a4e43953f2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663338:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663346:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663351:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663356:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87bc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129816.663358:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663364:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663373:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.663378:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43953f3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129816.665551:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054189696:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 48127us (48260us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129816.665562:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6695 00000100:00100000:3.0:1746129816.665644:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054190208:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 35898us (37314us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.665650:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6697 00010000:00010000:2.0:1746129816.674672:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.674698:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.674705:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.674711:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87be00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129816.674714:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.674721:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.674737:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.674743:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f87be00/0x48868a4e43953f49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129816.674835:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054190592:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 43759us (46452us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.674866:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6699 00010000:00010000:3.0:1746129816.683700:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.683714:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.683721:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.683726:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eca6e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129816.683729:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.683735:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.683750:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.683760:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43953f42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687058:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687073:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687080:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687085:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b154200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129816.687088:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687098:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687113:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.687119:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b154200/0x48868a4e43953f50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129816.687197:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054190848:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 51029us (57578us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129816.687218:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6700 00000100:00100000:3.0:1746129816.688058:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054190336:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 58086us (59692us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.688066:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6698 00000100:00100000:0.0:1746129816.695981:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.697053:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054190976 00000100:00100000:2.0:1746129816.697060:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054190976 00000100:00080000:0.0:1746129816.697676:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129816.697742:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 722 00000100:00100000:2.0:1746129816.697751:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31395:x1830949054190976:12345-192.168.204.31@tcp:103:mirror_io.0 00010000:00010000:2.0:1746129816.697762:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129816.697784:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5620600/0x48868a4e43953e9a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554c3 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.698140:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129816.698144:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129816.698187:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054190976:12345-192.168.204.31@tcp:103:mirror_io.0 Request processed in 439us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.698193:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 722 00000100:00100000:0.0:1746129816.700357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.700441:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054191232 00000100:00100000:3.0:1746129816.700447:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054191232 00000100:00100000:3.0:1746129816.700481:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4540 00000100:00100000:3.0:1746129816.700486:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31395:x1830949054191232:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129816.700933:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31395:x1830949054191232:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 445us (579us total) trans 8589944907 rc 0/0 00000100:00100000:3.0:1746129816.700939:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4540 00000100:00100000:0.0:1746129816.702519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.703061:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054191488 00000100:00100000:3.0:1746129816.703068:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054191488 00000100:00100000:3.0:1746129816.703275:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4541 00000100:00100000:3.0:1746129816.703281:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31395:x1830949054191488:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129816.703457:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31395:x1830949054191488:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 175us (942us total) trans 8589944908 rc 0/0 00000100:00100000:3.0:1746129816.703462:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4541 00000100:00100000:0.0:1746129816.725822:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.726306:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054191744 00000100:00100000:2.0:1746129816.726315:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054191744 00000100:00100000:2.0:1746129816.726382:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10923 00000100:00100000:2.0:1746129816.726388:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31404:x1830949054191744:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129816.726407:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.726422:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355509 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.726611:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00000100:00080000:0.0:1746129816.726749:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129816.726789:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.726803:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.726815:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.726820:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.726825:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727059:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727066:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727072:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129816.727079:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:2.0:1746129816.727139:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727144:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727149:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727154:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87a600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129816.727157:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727162:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727172:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129816.727175:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129816.727178:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727182:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a600/0x48868a4e43953f5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727195:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727228:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727232:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727235:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87a800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129816.727237:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727241:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727246:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49f00) 00010000:00010000:2.0:1746129816.727248:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129816.727250:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727254:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43953f65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.727286:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.727296:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.727301:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129816.727303:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129816.727305:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87ac00, rc 0) 00000100:00100000:2.0:1746129816.727343:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31404:x1830949054191744:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 954us (1528us total) trans 8589944909 rc 0/0 00000100:00100000:2.0:1746129816.727349:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10923 00000100:00100000:0.0:1746129816.729232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.730075:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054192000 00000100:00100000:3.0:1746129816.730082:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054192000 00000100:00100000:3.0:1746129816.730478:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10924 00000100:00100000:3.0:1746129816.730485:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31406:x1830949054192000:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129816.730507:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129816.730520:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2400/0x48868a4e43953f7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355510 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.730607:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730617:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730625:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730635:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730640:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730644:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730718:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43953f8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730724:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43953f8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730729:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43953f8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129816.730735:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:3.0:1746129816.730794:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730803:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730808:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730812:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129816.730815:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730820:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730827:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129816.730829:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129816.730832:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730836:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e43953f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730873:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730877:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730881:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730885:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129816.730887:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730893:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730899:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800acd6ae00) 00010000:00010000:3.0:1746129816.730900:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129816.730902:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730906:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43953f88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.730932:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2400/0x48868a4e43953f7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355510 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.730940:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43953f8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355510 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.730945:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129816.730947:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129816.730949:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2800, rc 0) 00000100:00100000:3.0:1746129816.733218:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31406:x1830949054192000:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2725us (3985us total) trans 8589944910 rc 0/0 00000100:00100000:3.0:1746129816.733227:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10924 00000100:00100000:0.0:1746129816.733776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.734778:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054192256 00000100:00100000:3.0:1746129816.734784:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054192256 00000100:00100000:3.0:1746129816.734814:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10925 00000100:00100000:3.0:1746129816.734820:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31407:x1830949054192256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129816.734836:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129816.734862:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43953f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355517 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.734932:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.734942:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.734950:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129816.734958:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:3.0:1746129816.735040:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43953f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.735051:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.735057:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129816.735060:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129816.735062:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3800, rc 0) 00000100:00100000:3.0:1746129816.735107:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31407:x1830949054192256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 287us (1332us total) trans 8589944911 rc 0/0 00000100:00100000:3.0:1746129816.735112:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10925 00000100:00100000:0.0:1746129816.742005:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.742109:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054192512 00000100:00100000:2.0:1746129816.742118:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054192512 00000100:00100000:2.0:1746129816.742163:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10926 00000100:00100000:2.0:1746129816.742170:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31403:x1830949054192512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.742187:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.742210:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ae00/0x48868a4e43953fb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35551e expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.742286:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953fb9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.742297:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953fb9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129816.742306:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953fb9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129816.742317:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:2.0:1746129816.742406:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ae00/0x48868a4e43953fb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35551e expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.742434:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35551e expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.742441:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129816.742443:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129816.742445:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87bc00, rc 0) 00000100:00100000:2.0:1746129816.742488:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31403:x1830949054192512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 318us (490us total) trans 8589944912 rc 0/0 00000100:00100000:2.0:1746129816.742493:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10926 00000100:00100000:0.0:1746129816.750804:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.752435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.753965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.754051:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054192640 00000100:00100000:2.0:1746129816.754060:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054192640 00000100:00100000:2.0:1746129816.754113:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054192768 00000100:00100000:2.0:1746129816.754116:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054192768 00000100:00100000:2.0:1746129816.754133:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15028 00000100:00100000:2.0:1746129816.754140:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+10:1962:x1830949054192640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.754155:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.754169:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355525 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.754188:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.754190:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.754209:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.754227:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.754236:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87a600, rc 0) 00000100:00100000:2.0:1746129816.754276:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+11:1962:x1830949054192640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 136us (3483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.754281:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15028 00000100:00100000:2.0:1746129816.754294:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15029 00000100:00100000:2.0:1746129816.754298:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054192768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.754304:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.754312:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35552c expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.754330:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.754331:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.754335:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 18 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.754343:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 18 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.754349:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87a200, rc 0) 00000100:00100000:2.0:1746129816.754363:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054192768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 64us (1932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.754367:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15029 00000100:00080000:1.0:1746129816.754426:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746129816.754429:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129816.755342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.755358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.755370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.755401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.755450:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054192896 00000100:00100000:2.0:1746129816.755454:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054192896 00000100:00100000:2.0:1746129816.755471:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193024 00000100:00100000:2.0:1746129816.755473:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193024 00000100:00100000:2.0:1746129816.755482:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193152 00000100:00100000:2.0:1746129816.755484:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193152 00000100:00100000:2.0:1746129816.755493:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193280 00000100:00100000:2.0:1746129816.755494:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193280 00000100:00100000:2.0:1746129816.755502:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193408 00000100:00100000:2.0:1746129816.755504:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193408 00000100:00100000:2.0:1746129816.755520:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15030 00000100:00100000:2.0:1746129816.755524:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054192896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.755532:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.755540:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355533 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.755550:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755551:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755555:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755564:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755570:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534c200, rc 0) 00000100:00100000:2.0:1746129816.755589:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054192896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.755594:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15030 00000100:00100000:2.0:1746129816.755604:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15031 00000100:00100000:2.0:1746129816.755608:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054193024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.755614:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.755621:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35553a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.755629:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755630:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755633:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755642:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755648:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534d600, rc 0) 00000100:00100000:2.0:1746129816.755660:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054193024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.755664:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15031 00000100:00100000:2.0:1746129816.755672:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15032 00000100:00100000:2.0:1746129816.755676:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054193152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.755680:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.755685:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355541 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.755693:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755694:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755697:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755704:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755710:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534da00, rc 0) 00000100:00100000:2.0:1746129816.755721:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054193152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.755725:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15032 00000100:00100000:2.0:1746129816.755732:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15033 00000100:00100000:2.0:1746129816.755736:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054193280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.755740:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.755745:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355548 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.755752:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755753:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755756:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755763:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755768:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b534d000, rc 0) 00000100:00100000:2.0:1746129816.755778:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054193280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 43us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.755782:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15033 00000100:00100000:2.0:1746129816.755789:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15034 00000100:00100000:2.0:1746129816.755792:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:1964:x1830949054193408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.755798:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.755803:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35554f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.755809:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755810:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.755813:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 7 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755820:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 7 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.755826:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca6200, rc 0) 00000100:00100000:2.0:1746129816.755836:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949054193408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 43us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.755840:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15034 00000100:00080000:2.0:1746129816.755864:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129816.757596:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.757626:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.759336:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.761312:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.762261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.762572:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193536 00000100:00100000:2.0:1746129816.762581:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193536 00000100:00100000:2.0:1746129816.762619:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193664 00000100:00100000:2.0:1746129816.762621:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193664 00000100:00100000:2.0:1746129816.762629:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193792 00000100:00100000:2.0:1746129816.762630:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193792 00000100:00100000:2.0:1746129816.762640:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054193920 00000100:00100000:2.0:1746129816.762642:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054193920 00000100:00100000:2.0:1746129816.762651:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054194048 00000100:00100000:2.0:1746129816.762652:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054194048 00000100:00100000:2.0:1746129816.762664:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15035 00000100:00100000:2.0:1746129816.762671:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1963:x1830949054193536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.762688:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.762702:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355556 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.762721:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762722:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762729:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762742:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762751:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c207800, rc 0) 00000100:00100000:2.0:1746129816.762788:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054193536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 118us (5201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.762793:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15035 00000100:00100000:2.0:1746129816.762807:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15036 00000100:00100000:2.0:1746129816.762811:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949054193664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.762816:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.762822:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35555d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.762833:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762834:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762838:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762860:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762868:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c206600, rc 0) 00000100:00100000:2.0:1746129816.762884:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054193664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 73us (5260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.762888:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15036 00000100:00100000:2.0:1746129816.762897:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15037 00000100:00100000:2.0:1746129816.762901:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054193792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.762907:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.762914:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355564 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.762922:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762923:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762926:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762934:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762939:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c206000, rc 0) 00000100:00100000:2.0:1746129816.762951:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054193792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 49us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.762955:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15037 00000100:00100000:2.0:1746129816.762962:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15038 00000100:00100000:2.0:1746129816.762966:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054193920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.762973:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.762978:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35556b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.762985:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762986:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.762989:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.762996:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.763001:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c206a00, rc 0) 00000100:00100000:2.0:1746129816.763012:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054193920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 46us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.763016:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15038 00000100:00100000:2.0:1746129816.763023:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15039 00000100:00100000:2.0:1746129816.763027:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1963:x1830949054194048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129816.763031:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129816.763036:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355572 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.763045:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.763046:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129816.763049:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.763056:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129816.763062:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c207200, rc 0) 00000100:00100000:2.0:1746129816.763074:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054194048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 47us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.763078:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15039 00000100:00080000:2.0:1746129816.763092:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129816.780306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.780343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.780367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.780408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129816.780466:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054194304 00000100:00100000:1.0:1746129816.780475:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054194304 00002000:00100000:1.0:1746129816.780513:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a5491f80 x1830949054194304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.780522:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491f80 with x1830949054194304 ext(0->1048575) 00002000:00010000:1.0:1746129816.780527:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491f80 00000100:00100000:1.0:1746129816.780552:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054194560 00000100:00100000:1.0:1746129816.780555:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054194560 00002000:00100000:1.0:1746129816.780568:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a5490380 x1830949054194560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.780575:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949054194560 ext(1048576->2097151) 00002000:00010000:1.0:1746129816.780578:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490380 00000100:00100000:1.0:1746129816.780588:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054194816 00000100:00100000:1.0:1746129816.780590:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054194816 00002000:00100000:1.0:1746129816.780599:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a5492680 x1830949054194816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.780605:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492680 with x1830949054194816 ext(1048576->2097151) 00002000:00010000:1.0:1746129816.780608:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5492680 00000100:00100000:1.0:1746129816.780615:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054195072 00000100:00100000:1.0:1746129816.780617:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054195072 00002000:00100000:1.0:1746129816.780626:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00f800 x1830949054195072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.780632:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f800 with x1830949054195072 ext(1048576->2097151) 00002000:00010000:1.0:1746129816.780635:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00f800 00000100:00100000:1.0:1746129816.780645:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6701 00000100:00100000:1.0:1746129816.780652:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054194304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.783378:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6702 00000100:00100000:2.0:1746129816.783389:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054194560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.784605:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6703 00000100:00100000:2.0:1746129816.784613:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054194816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129816.787471:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6704 00000100:00100000:0.0:1746129816.787488:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054195072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129816.804482:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054194560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21088us (24130us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.804492:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6702 00002000:00100000:3.0:1746129816.804502:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a5490380 x1830949054194560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.804516:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490380 with x1830949054194560 ext(1048576->2097151) 00002000:00010000:3.0:1746129816.804521:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490380 00000100:00100000:1.0:1746129816.805117:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054195072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17637us (24707us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129816.805124:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6704 00002000:00100000:1.0:1746129816.805128:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00f800 x1830949054195072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.805135:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00f800 with x1830949054195072 ext(1048576->2097151) 00002000:00010000:1.0:1746129816.805138:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00f800 00000100:00100000:0.0:1746129816.809659:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.813597:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.813636:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.813663:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.813956:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054195328 00000100:00100000:2.0:1746129816.813964:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054195328 00002000:00100000:2.0:1746129816.814000:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009b00fb80 x1830949054195328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.814009:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054195328 ext(0->1048575) 00002000:00010000:2.0:1746129816.814014:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00fb80 00000100:00100000:2.0:1746129816.814034:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054195584 00000100:00100000:2.0:1746129816.814037:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054195584 00002000:00100000:2.0:1746129816.814047:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009b00c380 x1830949054195584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.814054:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949054195584 ext(1048576->2097151) 00002000:00010000:2.0:1746129816.814056:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00c380 00000100:00100000:2.0:1746129816.814065:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054195840 00000100:00100000:2.0:1746129816.814067:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054195840 00002000:00100000:2.0:1746129816.814075:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009b00d880 x1830949054195840/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.814081:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949054195840 ext(1048576->2097151) 00002000:00010000:2.0:1746129816.814083:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d880 00000100:00100000:2.0:1746129816.814095:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054196096 00000100:00100000:2.0:1746129816.814097:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054196096 00002000:00100000:2.0:1746129816.814107:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00dc00 x1830949054196096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.814112:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949054196096 ext(1048576->2097151) 00002000:00010000:2.0:1746129816.814114:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:2.0:1746129816.814129:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6705 00000100:00100000:2.0:1746129816.814135:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054195328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.815153:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6706 00000100:00100000:2.0:1746129816.815158:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054195584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.816153:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6707 00000100:00100000:2.0:1746129816.816159:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054195840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.817133:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6708 00000100:00100000:2.0:1746129816.817139:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054196096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129816.823000:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054194816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38379us (42622us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.823011:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6703 00002000:00100000:3.0:1746129816.823021:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a5492680 x1830949054194816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.823029:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492680 with x1830949054194816 ext(1048576->2097151) 00002000:00010000:3.0:1746129816.823034:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5492680 00000100:00100000:3.0:1746129816.823251:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054194304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 42599us (42951us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.823256:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6701 00002000:00100000:3.0:1746129816.823262:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a5491f80 x1830949054194304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.823269:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491f80 with x1830949054194304 ext(0->1048575) 00002000:00010000:3.0:1746129816.823272:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491f80 00000100:00100000:3.0:1746129816.845335:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054195328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 31192us (35674us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.845345:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6705 00002000:00100000:3.0:1746129816.845356:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009b00fb80 x1830949054195328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.845365:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054195328 ext(0->1048575) 00002000:00010000:3.0:1746129816.845371:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00fb80 00000100:00100000:2.0:1746129816.853891:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054195584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 38723us (40292us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.853901:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6706 00002000:00100000:2.0:1746129816.853911:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009b00c380 x1830949054195584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.853926:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949054195584 ext(1048576->2097151) 00002000:00010000:2.0:1746129816.853931:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00c380 00000100:00100000:0.0:1746129816.858298:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.858401:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.858416:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.858444:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.858464:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054196352 00000100:00100000:1.0:1746129816.858465:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054196608 00000100:00100000:1.0:1746129816.858471:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054196608 00000100:00100000:0.0:1746129816.858471:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054196352 00002000:00100000:1.0:1746129816.858502:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094768700 x1830949054196608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129816.858502:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009b00c000 x1830949054196352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.858510:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768700 with x1830949054196608 ext(3145728->4194303) 00002000:00100000:0.0:1746129816.858511:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c000 with x1830949054196352 ext(2097152->3145727) 00002000:00010000:1.0:1746129816.858514:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768700 00002000:00010000:0.0:1746129816.858514:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00c000 00000100:00100000:1.0:1746129816.858527:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054196864 00000100:00100000:1.0:1746129816.858529:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054196864 00002000:00100000:1.0:1746129816.858540:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094768000 x1830949054196864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.858546:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768000 with x1830949054196864 ext(2097152->3145727) 00002000:00010000:1.0:1746129816.858548:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768000 00000100:00100000:1.0:1746129816.858925:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054197120 00000100:00100000:1.0:1746129816.858931:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054197120 00002000:00100000:1.0:1746129816.858951:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009476aa00 x1830949054197120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.858958:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949054197120 ext(3145728->4194303) 00002000:00010000:1.0:1746129816.858960:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:1.0:1746129816.858981:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6709 00000100:00100000:1.0:1746129816.858989:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054196608:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129816.859025:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6710 00000100:00100000:0.0:1746129816.859035:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054196352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129816.859112:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6711 00000100:00100000:1.0:1746129816.859119:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054196864:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.859269:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6712 00000100:00100000:2.0:1746129816.859278:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054197120:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.862510:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054195840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 46340us (48861us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.862523:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6707 00002000:00100000:2.0:1746129816.862534:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009b00d880 x1830949054195840/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.862544:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949054195840 ext(1048576->2097151) 00002000:00010000:2.0:1746129816.862549:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d880 00000100:00100000:3.0:1746129816.868630:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054196096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 51481us (54955us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129816.868643:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6708 00002000:00100000:3.0:1746129816.868656:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00dc00 x1830949054196096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.868665:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949054196096 ext(1048576->2097151) 00002000:00010000:3.0:1746129816.868670:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:0.0:1746129816.874303:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054196608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15304us (15891us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129816.874314:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6709 00002000:00100000:0.0:1746129816.874324:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094768700 x1830949054196608/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129816.874332:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768700 with x1830949054196608 ext(3145728->4194303) 00002000:00010000:0.0:1746129816.874337:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768700 00000100:00100000:2.0:1746129816.887228:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054196352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 28185us (28927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.887245:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6710 00002000:00100000:2.0:1746129816.887256:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009b00c000 x1830949054196352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.887265:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c000 with x1830949054196352 ext(2097152->3145727) 00002000:00010000:2.0:1746129816.887271:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00c000 00000100:00100000:2.0:1746129816.896443:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054197120:12345-192.168.204.31@tcp:3:cat.0 Request processed in 37159us (37990us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.896457:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6712 00002000:00100000:2.0:1746129816.896469:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009476aa00 x1830949054197120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.896479:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949054197120 ext(3145728->4194303) 00002000:00010000:2.0:1746129816.896483:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:2.0:1746129816.898896:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054196864:12345-192.168.204.31@tcp:3:cat.0 Request processed in 39769us (40469us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.899131:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6711 00002000:00100000:2.0:1746129816.899140:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094768000 x1830949054196864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.899148:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768000 with x1830949054196864 ext(2097152->3145727) 00002000:00010000:2.0:1746129816.899153:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768000 00000100:00100000:0.0:1746129816.911446:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.911604:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.911879:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.911998:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.912153:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054197376 00000100:00100000:2.0:1746129816.912161:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054197376 00002000:00100000:2.0:1746129816.912205:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094768a80 x1830949054197376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.912215:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949054197376 ext(2097152->3145727) 00002000:00010000:2.0:1746129816.912219:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:2.0:1746129816.912237:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054197632 00000100:00100000:2.0:1746129816.912240:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054197632 00002000:00100000:2.0:1746129816.912250:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009476b800 x1830949054197632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.912256:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949054197632 ext(3145728->4194303) 00002000:00010000:2.0:1746129816.912259:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476b800 00000100:00100000:2.0:1746129816.912272:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054197888 00000100:00100000:2.0:1746129816.912274:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054197888 00002000:00100000:2.0:1746129816.912285:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6a5c00 x1830949054197888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.912292:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5c00 with x1830949054197888 ext(2097152->3145727) 00002000:00010000:2.0:1746129816.912294:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5c00 00000100:00100000:2.0:1746129816.912302:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054198144 00000100:00100000:2.0:1746129816.912304:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054198144 00002000:00100000:2.0:1746129816.912312:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6a5880 x1830949054198144/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.912318:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5880 with x1830949054198144 ext(3145728->4194303) 00002000:00010000:2.0:1746129816.912320:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5880 00000100:00100000:2.0:1746129816.912330:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6713 00000100:00100000:2.0:1746129816.912336:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054197376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129816.913448:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6714 00000100:00100000:2.0:1746129816.913455:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054197632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129816.914548:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6715 00000100:00100000:1.0:1746129816.914558:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054197888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129816.915705:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6716 00000100:00100000:1.0:1746129816.915713:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054198144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129816.922789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.924792:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054198656 00000100:00100000:3.0:1746129816.924801:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054198656 00002000:00100000:3.0:1746129816.924906:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f6a6a00 x1830949054198656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/0 e 0 to 0 dl 1746129827 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.924915:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6a00 with x1830949054198656 ext(4194304->4931583) 00002000:00010000:3.0:1746129816.924919:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a6a00 00000100:00100000:3.0:1746129816.924955:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6717 00000100:00100000:3.0:1746129816.924962:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054198656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129816.927465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.927537:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054198400 00000100:00100000:3.0:1746129816.927543:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054198400 00000100:00100000:3.0:1746129816.927589:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10927 00000100:00100000:3.0:1746129816.927595:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31406:x1830949054198400:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129816.927610:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129816.927613:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746129816.927633:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87bc00/0x48868a4e43953fb9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35551e expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.928902:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43953f8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355510 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.928913:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129816.928917:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129816.928927:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800945ce400/0x48868a4e4395401b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355579 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.928963:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129816.929527:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129816.929570:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054198912 00000100:00100000:2.0:1746129816.929575:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054198912 00010000:00010000:3.0:1746129816.930028:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930036:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930043:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930049:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930056:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.930081:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930094:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 285 pid: 15044 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.930104:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129816.930165:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930171:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.930178:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129816.930213:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930219:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.930225:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960576:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129816.930247:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.930253:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 9 pid: 15044 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.930258:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960704:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129816.930276:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129816.930902:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10928 00000100:00100000:1.0:1746129816.930911:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31404:x1830949054198912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129816.930926:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129816.930929:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746129816.930936:0:14315:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746129816.930951:0:14315:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 285 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746129816.930959:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129816.930963:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129816.930968:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129816.930973:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129816.930979:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094880400/0x48868a4e43954029 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355580 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.931003:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129816.931009:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129816.931018:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129816.931178:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129816.931186:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129816.934689:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054197376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22346us (23244us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129816.934698:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6713 00002000:00100000:2.0:1746129816.934707:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094768a80 x1830949054197376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129816.934716:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949054197376 ext(2097152->3145727) 00002000:00010000:2.0:1746129816.934720:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:1.0:1746129816.938101:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054197888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23538us (26245us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129816.938112:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6715 00002000:00100000:1.0:1746129816.938122:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6a5c00 x1830949054197888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.938131:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5c00 with x1830949054197888 ext(2097152->3145727) 00002000:00010000:1.0:1746129816.938136:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5c00 00010000:00010000:3.0:1746129816.941355:0:14313:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@ffff88009ba87480 x1830949053960320) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 1/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 286 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746129816.941372:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87ac00/0x48868a4e43953f6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355509 expref: 286 pid: 15044 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.941400:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960320:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129816.943534:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.943595:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129816.943605:0:14313:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@ffff88009ba85500 x1830949053960576) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746129816.943616:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3800/0x48868a4e43953fa4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355517 expref: 285 pid: 14313 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.943625:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960576:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129816.943631:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129816.943648:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129816.943652:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.943659:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.943665:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129816.943762:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199040 00000100:00100000:2.0:1746129816.943768:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199040 00010000:00010000:2.0:1746129816.943790:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 10 pid: 15044 timeout: 862 lvb_type: 0 00000100:00100000:2.0:1746129816.943817:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7498 00000100:00100000:2.0:1746129816.943823:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054199040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129816.943931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.944058:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199168 00000100:00100000:3.0:1746129816.944061:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199168 00010000:00010000:3.0:1746129816.944071:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 11 pid: 15044 timeout: 862 lvb_type: 0 00000100:00100000:3.0:1746129816.945252:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7499 00000100:00100000:3.0:1746129816.945260:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054199168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129816.945271:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129816.945277:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 11 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746129816.945286:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 11 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746129816.945302:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba79200/0x48868a4e43953ee0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d1 expref: 11 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:3.0:1746129816.945311:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129816.945314:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.945320:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.945323:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129816.945356:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054199168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129816.945361:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7499 00000100:00100000:1.0:1746129816.945865:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054198144:12345-192.168.204.31@tcp:3:cat.0 Request processed in 30136us (33849us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129816.945873:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6716 00002000:00100000:1.0:1746129816.945880:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6a5880 x1830949054198144/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129816.945888:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5880 with x1830949054198144 ext(3145728->4194303) 00002000:00010000:1.0:1746129816.945892:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a5880 00000100:00100000:0.0:1746129816.946134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129816.946147:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199296 00000100:00100000:3.0:1746129816.946150:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199296 00000100:00100000:3.0:1746129816.946176:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10929 00000100:00100000:3.0:1746129816.946181:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31403:x1830949054199296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129816.946192:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129816.946210:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355587 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.946243:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129816.946249:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.946260:0:15044:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129816.946268:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129816.946275:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129816.946278:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129816.946279:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129816.946283:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945cfa00, rc 0) 00000100:00100000:3.0:1746129816.946299:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31403:x1830949054199296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129816.946304:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10929 00010000:00010000:2.0:1746129816.946781:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129816.946788:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746129816.946796:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746129816.946810:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e43953eee lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554d8 expref: 9 pid: 15044 timeout: 862 lvb_type: 0 00010000:00010000:2.0:1746129816.946822:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129816.946824:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129816.946831:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129816.946835:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129816.946841:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129816.946859:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129816.946876:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129816.946948:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054197632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 33492us (35342us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129816.946957:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6714 00002000:00100000:0.0:1746129816.946962:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009476b800 x1830949054197632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129816.946968:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949054197632 ext(3145728->4194303) 00002000:00010000:0.0:1746129816.946972:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476b800 00000100:00100000:2.0:1746129816.947031:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054199040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3207us (3500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129816.947037:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7498 00010000:00010000:2.0:1746129816.947084:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129816.947090:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00000040:00080000:2.0:1746129816.947707:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3442, 88 off289624 00000004:00080000:2.0:1746129816.947713:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763005864844ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947757:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3456, 88 off290768 00000004:00080000:2.0:1746129816.947761:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763005913230ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947772:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3457, 88 off290856 00000004:00080000:2.0:1746129816.947774:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763005926165ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947780:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3443, 88 off289712 00000004:00080000:2.0:1746129816.947783:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763005934762ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947788:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3444, 88 off289800 00000004:00080000:2.0:1746129816.947790:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763005942553ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947796:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3458, 88 off290944 00000004:00080000:2.0:1746129816.947799:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763005951113ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947805:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3459, 88 off291032 00000004:00080000:2.0:1746129816.947807:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763005959422ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947813:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3460, 88 off291120 00000004:00080000:2.0:1746129816.947815:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763005967413ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947821:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3445, 88 off289888 00000004:00080000:2.0:1746129816.947823:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763005974915ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947828:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3461, 88 off291208 00000004:00080000:2.0:1746129816.947831:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763005983184ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947837:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3446, 88 off289976 00000004:00080000:2.0:1746129816.947839:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763005990794ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947844:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3462, 88 off291296 00000004:00080000:2.0:1746129816.947866:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763006018047ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.947874:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3447, 88 off290064 00000004:00080000:2.0:1746129816.947877:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763006028925ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947882:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3448, 88 off290152 00000004:00080000:2.0:1746129816.947884:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763006036490ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947890:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3449, 88 off290240 00000004:00080000:2.0:1746129816.947892:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763006044232ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947897:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3450, 88 off290328 00000004:00080000:2.0:1746129816.947899:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763006051659ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.947906:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3463, 88 off291384 00000004:00080000:2.0:1746129816.947908:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763006060332ns, next at 716792379979ns, rc = 0 00000100:00100000:3.0:1746129816.948375:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054198656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23413us (25594us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129816.948383:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6717 00002000:00100000:3.0:1746129816.948388:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f6a6a00 x1830949054198656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:557/0 lens 488/440 e 0 to 0 dl 1746129827 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129816.948394:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6a00 with x1830949054198656 ext(4194304->4931583) 00002000:00010000:3.0:1746129816.948397:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a6a00 00000100:00100000:0.0:1746129816.954774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129816.954798:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199424 00000100:00100000:0.0:1746129816.954805:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199424 00000100:00100000:0.0:1746129816.954839:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10930 00000100:00100000:0.0:1746129816.954868:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31407:x1830949054199424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129816.954890:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129816.954904:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35558e expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.955013:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 286 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.955024:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 286 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129816.955033:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129816.955036:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129816.955039:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129816.955044:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676000, rc 0) 00000100:00100000:0.0:1746129816.955082:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31407:x1830949054199424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 237us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129816.955088:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10930 00000001:00080000:0.0:1746129816.965977:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944913 is committed 00010000:00010000:2.0:1746129816.966060:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.966072:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129816.966075:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129816.966078:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129816.966086:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.966092:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129816.966125:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.966137:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 11 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129816.966148:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960832:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129816.966226:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000004:00080000:0.0:1746129816.966262:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2631 committed 00000004:00080000:0.0:1746129816.966268:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2623 committed 00000004:00080000:0.0:1746129816.966273:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2622 committed 00000004:00080000:0.0:1746129816.966275:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2621 committed 00000004:00080000:0.0:1746129816.966276:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2620 committed 00000004:00080000:0.0:1746129816.966277:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2630 committed 00000004:00080000:0.0:1746129816.966279:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2619 committed 00000004:00080000:0.0:1746129816.966280:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2629 committed 00000004:00080000:0.0:1746129816.966281:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2618 committed 00000004:00080000:0.0:1746129816.966283:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2628 committed 00000004:00080000:0.0:1746129816.966284:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2627 committed 00000004:00080000:0.0:1746129816.966285:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2626 committed 00000004:00080000:0.0:1746129816.966287:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2617 committed 00000004:00080000:0.0:1746129816.966288:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2616 committed 00000004:00080000:0.0:1746129816.966289:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2625 committed 00000004:00080000:0.0:1746129816.966290:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2624 committed 00000004:00080000:0.0:1746129816.966292:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2615 committed 00000001:00080000:0.0:1746129816.966301:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944909 is committed 00000001:00080000:0.0:1746129816.966305:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944911 is committed 00000001:00080000:0.0:1746129816.966310:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944908 is committed 00000100:00100000:0.0:1746129816.966472:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053961344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.966500:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966515:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053961856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.966521:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053960960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.966527:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966546:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053961216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.966549:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.966561:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053961472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.966562:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966570:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053961728:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.966573:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966581:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.966588:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053961088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.966599:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961344 00000100:00100000:1.0:1746129816.966600:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966604:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961344 00000100:00100000:1.0:1746129816.966609:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053961600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.966619:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.966944:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.966955:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961856 00000100:00100000:0.0:1746129816.966958:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961856 00000100:00100000:1.0:1746129816.966962:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966972:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053960960 00000100:00100000:1.0:1746129816.966973:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.966974:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053960960 00000100:00100000:0.0:1746129816.966982:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961216 00000100:00100000:0.0:1746129816.966984:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961216 00000100:00100000:1.0:1746129816.966985:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.966989:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961472 00000100:00100000:0.0:1746129816.966991:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961472 00000100:00100000:1.0:1746129816.966992:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129816.966996:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.966997:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961728 00000100:00100000:0.0:1746129816.966998:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961728 00000100:00100000:0.0:1746129816.967003:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961088 00000100:00100000:0.0:1746129816.967004:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961088 00000100:00100000:1.0:1746129816.967007:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.967010:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961600 00000100:00100000:0.0:1746129816.967011:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961600 00000100:00100000:1.0:1746129816.967013:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.967016:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962112 00000100:00100000:0.0:1746129816.967017:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962112 00000100:00100000:1.0:1746129816.967022:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.967023:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962624 00000100:00100000:0.0:1746129816.967024:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962624 00000100:00100000:0.0:1746129816.967029:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962240 00000100:00100000:0.0:1746129816.967030:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962240 00000100:00100000:1.0:1746129816.967035:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962752 00000100:00100000:1.0:1746129816.967036:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962752 00000100:00100000:0.0:1746129816.967038:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15040 00000100:00100000:0.0:1746129816.967043:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053961344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.967048:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15041 00000100:00100000:1.0:1746129816.967051:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949053961856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.967190:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053961856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (660us total) trans 21474841218 rc 0/0 00000100:00100000:0.0:1746129816.967190:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053961344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 146us (688us total) trans 21474841217 rc 0/0 00000100:00100000:1.0:1746129816.967210:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15041 00000100:00100000:0.0:1746129816.967467:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15040 00000100:00100000:0.0:1746129816.967480:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15042 00000100:00100000:3.0:1746129816.967484:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15043 00000100:00100000:0.0:1746129816.967485:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053960960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129816.967494:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15044 00000100:00100000:3.0:1746129816.967498:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053961472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.967549:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15045 00000100:00100000:0.0:1746129816.967553:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3297:x1830949053961728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129816.967570:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3299:x1830949053961472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (996us total) trans 21474841219 rc 0/0 00000100:00100000:3.0:1746129816.967575:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15044 00000100:00100000:3.0:1746129816.967585:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15046 00000100:00100000:3.0:1746129816.967588:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3296:x1830949053961088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129816.967616:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129816.967619:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129816.967621:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129816.967623:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129816.967624:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129816.967641:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3297:x1830949053961728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1059us total) trans 21474841221 rc 0/0 00002000:00010000:3.0:1746129816.967646:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746129816.967646:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15045 00002000:00010000:3.0:1746129816.967648:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129813 -> 1746129813 00002000:00010000:3.0:1746129816.967650:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:3.0:1746129816.967652:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129813 -> 1746129813 00002000:00010000:3.0:1746129816.967653:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129816.967654:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15047 00000100:00100000:0.0:1746129816.967658:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053961600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129816.967671:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053961088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (1070us total) trans 21474841222 rc 0/0 00000100:00100000:3.0:1746129816.967676:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15046 00000100:00100000:3.0:1746129816.967684:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15048 00000100:00100000:3.0:1746129816.967688:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053962112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.967724:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053961600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (1103us total) trans 21474841223 rc 0/0 00000100:00100000:0.0:1746129816.967728:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15047 00000100:00100000:0.0:1746129816.967736:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15049 00000100:00100000:0.0:1746129816.967740:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053962624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129816.967821:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15050 00000100:00100000:3.0:1746129816.967826:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053962240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.967884:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15051 00000100:00100000:1.0:1746129816.967889:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3296:x1830949053962752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.967910:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053961984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.968072:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.968085:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053962496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129816.968088:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053961984 00000100:00100000:2.0:1746129816.968091:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053961984 00000100:00100000:1.0:1746129816.968096:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129816.968104:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962496 00000100:00100000:2.0:1746129816.968106:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962496 00000100:00100000:2.0:1746129816.968113:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15052 00000100:00100000:2.0:1746129816.968116:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3299:x1830949053961984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.968116:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841206 gen 2 00000004:00080000:1.0:1746129816.968119:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd45c00, transno 21474841141 00000004:00080000:1.0:1746129816.968124:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f100, transno 21474841142 00000004:00080000:1.0:1746129816.968126:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8793100, transno 21474841143 00000004:00080000:1.0:1746129816.968128:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c700, transno 21474841144 00000004:00080000:1.0:1746129816.968130:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792300, transno 21474841145 00000004:00080000:1.0:1746129816.968132:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47480, transno 21474841146 00000004:00080000:1.0:1746129816.968134:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04df80, transno 21474841147 00000004:00080000:1.0:1746129816.968136:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f800, transno 21474841148 00000004:00080000:1.0:1746129816.968138:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061f480, transno 21474841149 00000100:00100000:2.0:1746129816.968139:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15053 00000004:00080000:1.0:1746129816.968140:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4f480, transno 21474841150 00000100:00100000:2.0:1746129816.968142:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3299:x1830949053962496:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.968142:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4fb80, transno 21474841151 00000004:00080000:1.0:1746129816.968144:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4e300, transno 21474841152 00000004:00080000:1.0:1746129816.968146:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4d500, transno 21474841153 00000004:00080000:1.0:1746129816.968148:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4ca80, transno 21474841154 00000004:00080000:1.0:1746129816.968149:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4d880, transno 21474841155 00000004:00080000:1.0:1746129816.968151:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4f800, transno 21474841156 00000004:00080000:1.0:1746129816.968153:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4c000, transno 21474841157 00000004:00080000:1.0:1746129816.968155:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4a80, transno 21474841158 00000004:00080000:1.0:1746129816.968157:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4700, transno 21474841167 00000004:00080000:1.0:1746129816.968159:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5180, transno 21474841168 00000004:00080000:1.0:1746129816.968160:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4e00, transno 21474841169 00000004:00080000:1.0:1746129816.968162:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6d80, transno 21474841170 00000004:00080000:1.0:1746129816.968164:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5880, transno 21474841171 00000004:00080000:1.0:1746129816.968166:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb7b80, transno 21474841172 00000004:00080000:1.0:1746129816.968168:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad3100, transno 21474841173 00000004:00080000:1.0:1746129816.968170:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6300, transno 21474841174 00000004:00080000:1.0:1746129816.968172:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4000, transno 21474841175 00000004:00080000:1.0:1746129816.968174:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7480, transno 21474841176 00000004:00080000:1.0:1746129816.968176:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7100, transno 21474841177 00000004:00080000:1.0:1746129816.968177:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e6300, transno 21474841178 00000004:00080000:1.0:1746129816.968179:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e6d80, transno 21474841179 00000004:00080000:1.0:1746129816.968180:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e4700, transno 21474841180 00000004:00080000:1.0:1746129816.968182:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e5f80, transno 21474841181 00000004:00080000:1.0:1746129816.968184:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7b80, transno 21474841182 00000004:00080000:1.0:1746129816.968186:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e6680, transno 21474841183 00000004:00080000:1.0:1746129816.968187:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5880, transno 21474841184 00000004:00080000:1.0:1746129816.968189:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461880, transno 21474841189 00000004:00080000:1.0:1746129816.968191:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a5500, transno 21474841190 00000004:00080000:1.0:1746129816.968203:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a5180, transno 21474841191 00000004:00080000:1.0:1746129816.968205:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4a80, transno 21474841192 00000004:00080000:1.0:1746129816.968207:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a6300, transno 21474841193 00000004:00080000:1.0:1746129816.968209:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a6a00, transno 21474841194 00000004:00080000:1.0:1746129816.968211:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf6d80, transno 21474841195 00000004:00080000:1.0:1746129816.968212:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a4380, transno 21474841196 00000004:00080000:1.0:1746129816.968214:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a55a7800, transno 21474841197 00000004:00080000:1.0:1746129816.968215:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423e300, transno 21474841198 00000004:00080000:1.0:1746129816.968218:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792680, transno 21474841199 00000004:00080000:1.0:1746129816.968219:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423ed80, transno 21474841200 00000004:00080000:1.0:1746129816.968221:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8791c00, transno 21474841201 00000004:00080000:1.0:1746129816.968222:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423d880, transno 21474841202 00000004:00080000:1.0:1746129816.968224:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790000, transno 21474841203 00000004:00080000:1.0:1746129816.968225:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423ea00, transno 21474841204 00000004:00080000:1.0:1746129816.968227:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8790380, transno 21474841205 00000004:00080000:1.0:1746129816.968228:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061dc00, transno 21474841206 00000100:00100000:1.0:1746129816.968627:0:3299:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009adaea00 x1830949053959552/t21474841208(21474841208) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129831 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746129816.968636:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631a300/2, rc 0, transno 21474841219 00000100:00100000:1.0:1746129816.968640:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053961472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.968648:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129816.968652:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053962368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.968671:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.968682:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053962880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.968693:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.968702:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962368 00000100:00100000:0.0:1746129816.968705:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962368 00000100:00100000:0.0:1746129816.968715:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053962880 00000100:00100000:0.0:1746129816.968716:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053962880 00000100:00100000:0.0:1746129816.968723:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15054 00000100:00100000:0.0:1746129816.968726:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949053962368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.968749:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15055 00000100:00100000:0.0:1746129816.968752:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949053962880:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129816.968812:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319880/2, rc 0, transno 21474841221 00000100:00100000:0.0:1746129816.968815:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053961728:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129816.968827:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631b800/2, rc 0, transno 21474841217 00000100:00100000:0.0:1746129816.968829:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053961344:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129816.968835:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319c00/2, rc 0, transno 21474841218 00000100:00100000:0.0:1746129816.968837:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053961856:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129816.968883:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129816.968886:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129816.968888:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129809 00002000:00010000:0.0:1746129816.968890:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129816.968891:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746129816.968911:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949053960960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1427us (2362us total) trans 21474841220 rc 0/0 00000100:00100000:0.0:1746129816.968916:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15042 00000004:00080000:1.0:1746129816.968989:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 17 in progress, 4 in flight, 54 done 00000100:00100000:0.0:1746129816.969016:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129816.969021:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053963008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129816.969025:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64700/2, rc 0, transno 21474841222 00000100:00100000:1.0:1746129816.969028:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053961088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129816.969034:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013631a680/2, rc 0, transno 21474841223 00000100:00100000:1.0:1746129816.969037:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053961600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.969037:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129816.969047:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009be64a80/2, rc 0, transno 21474841220 00000100:00100000:1.0:1746129816.969050:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053960960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.969050:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963008 00000100:00100000:0.0:1746129816.969053:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963008 00000100:00100000:0.0:1746129816.969062:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15056 00000100:00100000:0.0:1746129816.969065:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949053963008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129816.969164:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053960832:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129816.969188:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945ce400/0x48868a4e4395401b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 9 pid: 14313 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129816.969241:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129816.969248:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129816.969272:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129816.969274:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00010000:00010000:2.0:1746129816.969274:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800945cf000, rc 0) 00002000:00010000:3.0:1746129816.969276:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129814 -> 1746129814 00002000:00010000:3.0:1746129816.969277:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.969279:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4139 -> 4137 00000100:00100000:2.0:1746129816.969304:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31406:x1830949054198400:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 41710us (41846us total) trans 8589944913 rc 0/0 00000100:00100000:2.0:1746129816.969310:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10927 00000100:00100000:3.0:1746129816.969397:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053962240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1571us (2387us total) trans 17179874030 rc 0/0 00000100:00100000:3.0:1746129816.969402:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15050 00000100:00100000:3.0:1746129816.969415:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949053961216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129816.969483:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:3.0:1746129816.969485:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.969487:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:3.0:1746129816.969488:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.969490:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:3.0:1746129816.969510:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3297:x1830949053961216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2021us (2947us total) trans 21474841224 rc 0/0 00000100:00100000:3.0:1746129816.969514:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15043 00000100:00100000:0.0:1746129816.969521:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949053963008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 455us (483us total) trans 21474841225 rc 0/0 00000100:00100000:0.0:1746129816.969526:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15056 00000004:00080000:0.0:1746129816.969604:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136319180/2, rc 0, transno 21474841224 00000100:00100000:0.0:1746129816.969608:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053961216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129816.969620:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1bb80/2, rc 0, transno 21474841225 00000100:00100000:0.0:1746129816.969622:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053963008:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129816.970414:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129816.970418:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.970420:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.970421:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.970423:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129816.970447:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949053962112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2758us (3483us total) trans 17179874031 rc 0/0 00000100:00100000:1.0:1746129816.970452:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15048 00000100:00100000:2.0:1746129816.970639:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053962752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2750us (3615us total) trans 17179874032 rc 0/0 00000100:00100000:2.0:1746129816.970645:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15051 00002000:00010000:3.0:1746129816.970654:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129816.970656:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.970658:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.970659:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.970661:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129816.970683:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3299:x1830949053961984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2566us (2611us total) trans 17179874033 rc 0/0 00000100:00100000:3.0:1746129816.970688:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15052 00000100:00100000:3.0:1746129816.970711:0:3299:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874029 gen 2 00000004:00080000:3.0:1746129816.970714:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a7800, transno 17179873955 00000100:00100000:2.0:1746129816.970723:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3299:x1830949053962496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2580us (2625us total) trans 17179874034 rc 0/0 00000100:00100000:2.0:1746129816.970727:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15053 00000004:00080000:3.0:1746129816.970731:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a4000, transno 17179873956 00000004:00080000:3.0:1746129816.970734:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a4380, transno 17179873957 00000004:00080000:3.0:1746129816.970736:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc000, transno 17179873958 00000004:00080000:3.0:1746129816.970738:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dea00, transno 17179873959 00000004:00080000:3.0:1746129816.970740:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a6680, transno 17179873960 00000004:00080000:3.0:1746129816.970742:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a7100, transno 17179873961 00000004:00080000:3.0:1746129816.970744:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a5180, transno 17179873962 00000004:00080000:3.0:1746129816.970746:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a6300, transno 17179873963 00000004:00080000:3.0:1746129816.970748:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d637100, transno 17179873964 00000100:00100000:0.0:1746129816.970813:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3296:x1830949053962624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3073us (3826us total) trans 17179874035 rc 0/0 00000100:00100000:0.0:1746129816.970818:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15049 00000004:00080000:3.0:1746129816.971068:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d635c00, transno 17179873965 00000004:00080000:3.0:1746129816.971070:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a4700, transno 17179873966 00000004:00080000:3.0:1746129816.971072:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d635880, transno 17179873967 00000004:00080000:3.0:1746129816.971122:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a4a80, transno 17179873968 00000004:00080000:3.0:1746129816.971124:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634380, transno 17179873969 00000004:00080000:3.0:1746129816.971126:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6a4e00, transno 17179873970 00000004:00080000:3.0:1746129816.971128:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adb480, transno 17179873981 00000004:00080000:3.0:1746129816.971130:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423e680, transno 17179873982 00000004:00080000:3.0:1746129816.971132:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adb800, transno 17179873983 00000004:00080000:3.0:1746129816.971134:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd3b80, transno 17179873984 00000004:00080000:3.0:1746129816.971136:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adad80, transno 17179873985 00000004:00080000:3.0:1746129816.971138:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423c000, transno 17179873986 00000004:00080000:3.0:1746129816.971141:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad8a80, transno 17179873987 00000004:00080000:3.0:1746129816.971143:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd3100, transno 17179873988 00000004:00080000:3.0:1746129816.971145:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242d80, transno 17179873989 00000004:00080000:3.0:1746129816.971147:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e4a80, transno 17179873990 00000004:00080000:3.0:1746129816.971149:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242300, transno 17179873991 00000004:00080000:3.0:1746129816.971151:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e5180, transno 17179873992 00000004:00080000:3.0:1746129816.971153:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242680, transno 17179873993 00000004:00080000:3.0:1746129816.971154:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e4e00, transno 17179873994 00000004:00080000:3.0:1746129816.971156:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e4380, transno 17179873995 00000004:00080000:3.0:1746129816.971159:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e5880, transno 17179873996 00000004:00080000:3.0:1746129816.971161:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c7b80, transno 17179874005 00000004:00080000:3.0:1746129816.971163:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131463800, transno 17179874006 00000004:00080000:3.0:1746129816.971165:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461f80, transno 17179874007 00000100:00100000:0.0:1746129816.971258:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053962368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2530us (2586us total) trans 17179874036 rc 0/0 00000100:00100000:0.0:1746129816.971283:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15054 00000004:00080000:3.0:1746129816.971324:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5c00, transno 17179874008 00000004:00080000:3.0:1746129816.971326:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460700, transno 17179874009 00000004:00080000:3.0:1746129816.971328:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460e00, transno 17179874010 00000004:00080000:3.0:1746129816.971329:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131461180, transno 17179874011 00000004:00080000:3.0:1746129816.971331:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131460000, transno 17179874012 00000004:00080000:3.0:1746129816.971333:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd45880, transno 17179874013 00000004:00080000:3.0:1746129816.971335:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd46680, transno 17179874014 00000004:00080000:3.0:1746129816.971337:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47100, transno 17179874015 00000004:00080000:3.0:1746129816.971339:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd46a00, transno 17179874016 00000004:00080000:3.0:1746129816.971341:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47b80, transno 17179874017 00000004:00080000:3.0:1746129816.971342:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd44000, transno 17179874018 00000004:00080000:3.0:1746129816.971345:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6ec380, transno 17179874019 00000004:00080000:3.0:1746129816.971346:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fd47800, transno 17179874020 00000004:00080000:3.0:1746129816.971348:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645fb80, transno 17179874022 00000004:00080000:3.0:1746129816.971350:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645c700, transno 17179874023 00000004:00080000:3.0:1746129816.971352:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645ca80, transno 17179874024 00000004:00080000:3.0:1746129816.971354:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645d180, transno 17179874025 00000004:00080000:3.0:1746129816.971356:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645f800, transno 17179874026 00000004:00080000:3.0:1746129816.971357:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645f100, transno 17179874027 00000004:00080000:3.0:1746129816.971360:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645e680, transno 17179874028 00000004:00080000:3.0:1746129816.971362:0:3299:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645ea00, transno 17179874029 00000100:00100000:3.0:1746129816.971368:0:3299:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012c040a80 x1830949053961984/t17179874033(17179874033) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129832 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746129816.971376:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040a80/2, rc 0, transno 17179874033 00000100:00100000:3.0:1746129816.971380:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053961984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.971450:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949053962880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2697us (2756us total) trans 17179874037 rc 0/0 00000100:00100000:0.0:1746129816.971455:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15055 00000004:00080000:2.0:1746129816.971490:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 59 in progress, 7 in flight, 5 done 00000004:00080000:1.0:1746129816.971528:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c040380/2, rc 0, transno 17179874030 00000100:00100000:1.0:1746129816.971532:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962240:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.971544:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645ed80/2, rc 0, transno 17179874032 00000100:00100000:1.0:1746129816.971547:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962752:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.971553:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c042300/2, rc 0, transno 17179874031 00000100:00100000:1.0:1746129816.971555:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962112:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.971560:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645ce00/2, rc 0, transno 17179874035 00000100:00100000:1.0:1746129816.971563:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053962624:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129816.971592:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645c000/2, rc 0, transno 17179874034 00000100:00100000:3.0:1746129816.971596:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053962496:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129816.971602:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043b80/2, rc 0, transno 17179874036 00000100:00100000:3.0:1746129816.971604:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053962368:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129816.971609:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645c380/2, rc 0, transno 17179874037 00000100:00100000:3.0:1746129816.971611:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053962880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.971786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:2.0:1746129816.971870:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 0 in flight, 51 done 00000100:00100000:1.0:1746129816.971943:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199552 00000100:00100000:1.0:1746129816.971948:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199552 00010000:00010000:1.0:1746129816.971971:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129816.971991:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7500 00000100:00100000:1.0:1746129816.971996:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054199552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129816.972007:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129816.972012:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129816.972021:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129816.972042:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cf000/0x48868a4e43954022 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355579 expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129816.972053:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129816.972068:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129816.972076:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129816.972081:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129816.972087:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129816.972100:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129816.972109:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129816.972114:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129816.972137:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1963:x1830949054199552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 140us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129816.972141:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7500 00000040:00080000:2.0:1746129816.972552:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3451, 88 off290416 00000004:00080000:2.0:1746129816.972557:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763030709225ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.972620:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3464, 88 off291472 00000004:00080000:2.0:1746129816.972625:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763030776772ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.972647:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3465, 88 off291560 00000004:00080000:2.0:1746129816.972651:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763030803507ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.972807:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3452, 88 off290504 00000004:00080000:2.0:1746129816.972812:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763030963605ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.972823:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3453, 88 off290592 00000004:00080000:2.0:1746129816.972825:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763030977082ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.972831:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3466, 88 off291648 00000004:00080000:2.0:1746129816.972834:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763030985907ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.972957:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3467, 88 off291736 00000004:00080000:2.0:1746129816.972961:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763031113532ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.972971:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3468, 88 off291824 00000004:00080000:2.0:1746129816.972973:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763031124945ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.972980:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3454, 88 off290680 00000004:00080000:2.0:1746129816.972982:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763031134242ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.972990:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3469, 88 off291912 00000004:00080000:2.0:1746129816.972992:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763031144219ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.972999:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3455, 88 off290768 00000004:00080000:2.0:1746129816.973001:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763031153552ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.973007:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3470, 88 off292000 00000004:00080000:2.0:1746129816.973137:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763031288575ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129816.973171:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3456, 88 off290856 00000004:00080000:2.0:1746129816.973174:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763031326273ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.973182:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3457, 88 off290944 00000004:00080000:2.0:1746129816.973184:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763031336024ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.973191:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3458, 88 off291032 00000004:00080000:2.0:1746129816.973204:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763031356264ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.973213:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3459, 88 off291120 00000004:00080000:2.0:1746129816.973215:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763031367135ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129816.973223:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3471, 88 off292088 00000004:00080000:2.0:1746129816.973226:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763031377843ns, next at 716792379979ns, rc = 0 00010000:00010000:2.0:1746129816.994908:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.994921:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129816.994923:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129816.994934:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 6 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.994944:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 6 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.994950:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 6 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.994963:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.994970:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.994975:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129816.995014:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129816.995032:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053963136:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129816.995125:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 6 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129816.995135:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053963264:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129816.995160:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000001:00080000:0.0:1746129816.995292:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944914 is committed 00000004:00080000:0.0:1746129816.995298:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2639 committed 00000004:00080000:0.0:1746129816.995320:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2632 committed 00000004:00080000:0.0:1746129816.995325:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2631 committed 00000004:00080000:0.0:1746129816.995326:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2630 committed 00000004:00080000:0.0:1746129816.995328:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2629 committed 00000004:00080000:0.0:1746129816.995329:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2638 committed 00000004:00080000:0.0:1746129816.995330:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2628 committed 00000004:00080000:0.0:1746129816.995332:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2637 committed 00000004:00080000:0.0:1746129816.995333:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2627 committed 00000004:00080000:0.0:1746129816.995334:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2636 committed 00000004:00080000:0.0:1746129816.995335:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2635 committed 00000004:00080000:0.0:1746129816.995336:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2634 committed 00000004:00080000:0.0:1746129816.995338:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2626 committed 00000004:00080000:0.0:1746129816.995339:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2625 committed 00000004:00080000:0.0:1746129816.995346:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2633 committed 00000004:00080000:0.0:1746129816.995347:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2632 committed 00000004:00080000:0.0:1746129816.995348:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2624 committed 00000100:00100000:3.0:1746129816.995513:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053963776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129816.995549:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129816.995568:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129816.995582:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129816.995597:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746129816.995601:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053963648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129816.995616:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129816.995627:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129816.995638:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129816.995655:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963776 00000100:00100000:3.0:1746129816.995660:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963776 00000100:00100000:3.0:1746129816.995690:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964288 00000100:00100000:3.0:1746129816.995692:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964288 00000100:00100000:3.0:1746129816.995702:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963648 00000100:00100000:3.0:1746129816.995704:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963648 00000100:00100000:3.0:1746129816.995713:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964160 00000100:00100000:3.0:1746129816.995714:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964160 00000100:00100000:3.0:1746129816.995724:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15057 00000100:00100000:3.0:1746129816.995730:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3299:x1830949053963776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.995872:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15058 00000100:00100000:1.0:1746129816.995880:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3299:x1830949053964288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129816.995904:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3299:x1830949053963776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (354us total) trans 17179874038 rc 0/0 00000100:00100000:3.0:1746129816.995909:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15057 00000100:00100000:3.0:1746129816.995925:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15059 00000100:00100000:3.0:1746129816.995929:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3299:x1830949053963648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.995973:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3299:x1830949053964288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (389us total) trans 17179874039 rc 0/0 00000100:00100000:1.0:1746129816.995978:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15058 00000100:00100000:1.0:1746129816.995989:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15060 00000100:00100000:1.0:1746129816.995993:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3299:x1830949053964160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129816.996003:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129816.996005:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.996007:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129814 -> 1746129814 00002000:00010000:3.0:1746129816.996008:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:3.0:1746129816.996010:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129816.996027:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3299:x1830949053963648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (410us total) trans 17179874040 rc 0/0 00000100:00100000:3.0:1746129816.996032:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15059 00000100:00100000:1.0:1746129816.996099:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3299:x1830949053964160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (459us total) trans 17179874041 rc 0/0 00000100:00100000:1.0:1746129816.996105:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15060 00000100:00100000:1.0:1746129816.996121:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996138:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.996150:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053965312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129816.996183:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85880/2, rc 0, transno 17179874040 00000100:00100000:1.0:1746129816.996187:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053963648:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.996207:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dc000/2, rc 0, transno 17179874041 00000100:00100000:1.0:1746129816.996210:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.996217:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87480/2, rc 0, transno 17179874038 00000100:00100000:1.0:1746129816.996219:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053963776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129816.996224:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dea00/2, rc 0, transno 17179874039 00000100:00100000:1.0:1746129816.996226:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.996233:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129816.996236:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996266:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.996294:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053965184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.996339:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964800 00000100:00100000:1.0:1746129816.996342:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964800 00000100:00100000:1.0:1746129816.996373:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053965312 00000100:00100000:1.0:1746129816.996375:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053965312 00000100:00100000:1.0:1746129816.996398:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964672 00000100:00100000:1.0:1746129816.996401:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964672 00000100:00100000:1.0:1746129816.996409:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053965184 00000100:00100000:0.0:1746129816.996410:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053963520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.996411:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053965184 00000100:00100000:1.0:1746129816.996420:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15061 00000100:00100000:1.0:1746129816.996424:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3299:x1830949053964800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.996434:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.996446:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.996461:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.996470:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.996485:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.996492:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053965056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.996507:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.996516:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746129816.996520:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053963392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.996535:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3299:x1830949053964800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (395us total) trans 21474841226 rc 0/0 00000100:00100000:0.0:1746129816.996537:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.996555:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053963904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.996561:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15061 00000100:00100000:0.0:1746129816.996574:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129816.996581:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996583:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963520 00000100:00100000:1.0:1746129816.996586:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963520 00000100:00100000:1.0:1746129816.996593:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964032 00000100:00100000:0.0:1746129816.996593:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.996594:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964032 00000100:00100000:0.0:1746129816.996604:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996611:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964544 00000100:00100000:1.0:1746129816.996613:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964544 00000100:00100000:0.0:1746129816.996617:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129816.996620:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053965056 00000100:00100000:1.0:1746129816.996635:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053965056 00000100:00100000:1.0:1746129816.996642:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963904 00000100:00100000:0.0:1746129816.996642:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053963392 00000100:00100000:1.0:1746129816.996643:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963904 00000100:00100000:0.0:1746129816.996645:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053963392 00000100:00100000:1.0:1746129816.996648:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964416 00000100:00100000:1.0:1746129816.996650:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964416 00000100:00100000:1.0:1746129816.996656:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053964928 00000100:00100000:1.0:1746129816.996658:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053964928 00000100:00100000:0.0:1746129816.996665:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15062 00000100:00100000:0.0:1746129816.996669:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949053965312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996675:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15063 00000100:00100000:1.0:1746129816.996679:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949053964672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.996760:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949053965312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (596us total) trans 21474841227 rc 0/0 00000100:00100000:0.0:1746129816.996766:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15062 00002000:00010000:1.0:1746129816.996768:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:1.0:1746129816.996771:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.996773:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:1.0:1746129816.996775:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00000100:00100000:0.0:1746129816.996776:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15064 00002000:00010000:1.0:1746129816.996777:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:0.0:1746129816.996779:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053965184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.996796:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053964672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (528us total) trans 21474841228 rc 0/0 00000100:00100000:1.0:1746129816.996800:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15063 00000100:00100000:1.0:1746129816.996810:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15065 00000100:00100000:1.0:1746129816.996814:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053963520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129816.996832:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129816.996834:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129816.996836:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129816.996837:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129816.996838:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129816.996872:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949053965184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (562us total) trans 21474841229 rc 0/0 00000100:00100000:0.0:1746129816.996877:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15064 00000100:00100000:0.0:1746129816.996885:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15066 00000100:00100000:0.0:1746129816.996888:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053964032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.996899:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15067 00000100:00100000:0.0:1746129816.996902:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053964544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129816.996908:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129816.996911:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.996913:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.996914:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.996916:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129816.996936:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053963520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (501us total) trans 17179874042 rc 0/0 00000100:00100000:1.0:1746129816.996940:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15065 00000100:00100000:1.0:1746129816.996949:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15068 00000100:00100000:1.0:1746129816.996954:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053965056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129816.996960:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129816.996962:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129816.996964:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129816.996965:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129813 -> 1746129813 00002000:00010000:0.0:1746129816.996967:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129816.996982:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053964544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (496us total) trans 21474841230 rc 0/0 00000100:00100000:0.0:1746129816.996986:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15067 00000100:00100000:0.0:1746129816.996995:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15069 00000100:00100000:0.0:1746129816.996998:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949053963904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129816.997025:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053965056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (517us total) trans 21474841231 rc 0/0 00000100:00100000:1.0:1746129816.997030:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15068 00000100:00100000:1.0:1746129816.997045:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15070 00000100:00100000:1.0:1746129816.997049:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053963392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129816.997059:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053963904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (484us total) trans 17179874043 rc 0/0 00000100:00100000:0.0:1746129816.997064:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15069 00000100:00100000:0.0:1746129816.997072:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15071 00000100:00100000:0.0:1746129816.997076:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949053964416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129816.997112:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129816.997115:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.997116:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.997118:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129815 -> 1746129815 00002000:00010000:1.0:1746129816.997120:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746129816.997128:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129816.997130:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129816.997132:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129809 00002000:00010000:0.0:1746129816.997134:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129811 00002000:00010000:0.0:1746129816.997135:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746129816.997137:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053963392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (599us total) trans 17179874044 rc 0/0 00000100:00100000:1.0:1746129816.997142:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15070 00000100:00100000:0.0:1746129816.997150:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053964416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (556us total) trans 21474841232 rc 0/0 00000100:00100000:1.0:1746129816.997151:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15072 00000100:00100000:0.0:1746129816.997154:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15071 00000100:00100000:1.0:1746129816.997155:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053964928:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129816.997173:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84380/2, rc 0, transno 17179874044 00000100:00100000:0.0:1746129816.997176:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053963392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129816.997182:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84000/2, rc 0, transno 17179874043 00000100:00100000:0.0:1746129816.997184:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053963904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129816.997190:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b480/2, rc 0, transno 21474841232 00000100:00100000:0.0:1746129816.997211:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129816.997218:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85500/2, rc 0, transno 17179874042 00000100:00100000:0.0:1746129816.997221:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053963520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129816.997226:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b800/2, rc 0, transno 21474841230 00000100:00100000:0.0:1746129816.997229:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129816.997234:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19f80/2, rc 0, transno 21474841231 00000100:00100000:0.0:1746129816.997237:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053965056:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129816.997239:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949053964928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (620us total) trans 21474841233 rc 0/0 00000100:00100000:1.0:1746129816.997244:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15072 00000004:00080000:0.0:1746129816.997245:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18000/2, rc 0, transno 21474841233 00000100:00100000:0.0:1746129816.997248:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129816.997270:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18700/2, rc 0, transno 21474841228 00000100:00100000:1.0:1746129816.997274:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964672:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129816.997280:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18e00/2, rc 0, transno 21474841229 00000100:00100000:1.0:1746129816.997283:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053965184:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129816.997299:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19180/2, rc 0, transno 21474841226 00000100:00100000:1.0:1746129816.997302:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053964800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129816.997309:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1a300/2, rc 0, transno 21474841227 00000100:00100000:1.0:1746129816.997312:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053965312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129816.998023:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053965440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129816.998048:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129816.998079:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053965440 00000100:00100000:2.0:1746129816.998083:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053965440 00000100:00100000:2.0:1746129816.998101:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15073 00000100:00100000:2.0:1746129816.998105:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3296:x1830949053965440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129816.998213:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3296:x1830949053965440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (164us total) trans 21474841234 rc 0/0 00000100:00100000:2.0:1746129816.998217:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15073 00000004:00080000:2.0:1746129816.998246:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad9500/2, rc 0, transno 21474841234 00000100:00100000:2.0:1746129816.998249:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053965440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129816.999034:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949053964032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2144us (2570us total) trans 17179874045 rc 0/0 00000100:00100000:0.0:1746129816.999040:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15066 00000004:00080000:1.0:1746129816.999077:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba86a00/2, rc 0, transno 17179874045 00000100:00100000:1.0:1746129816.999082:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053964032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.000187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.000294:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053963136:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.000303:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053963264:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.000332:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094880400/0x48868a4e43954029 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746129817.000348:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.000378:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094880a00, rc 0) 00000100:00100000:3.0:1746129817.000410:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31404:x1830949054198912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 69501us (70884us total) trans 8589944914 rc 0/0 00000100:00100000:3.0:1746129817.000417:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10928 00000100:00100000:1.0:1746129817.000483:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199680 00000100:00100000:1.0:1746129817.000487:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199680 00000100:00100000:1.0:1746129817.000512:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4542 00000100:00100000:1.0:1746129817.000517:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31407:x1830949054199680:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:1.0:1746129817.000572:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31407:x1830949054199680:12345-192.168.204.31@tcp:49:cat.0 Request processed in 55us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.000578:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4542 00000100:00100000:0.0:1746129817.002734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.002769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.002890:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199808 00000100:00100000:3.0:1746129817.002895:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199808 00000100:00100000:2.0:1746129817.003004:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054199936 00000100:00100000:2.0:1746129817.003008:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054199936 00000100:00100000:2.0:1746129817.003037:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10931 00000100:00100000:2.0:1746129817.003042:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31406:x1830949054199936:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.003057:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.003071:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800922b2c00/0x48868a4e43954045 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355595 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.003113:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800922b2c00/0x48868a4e43954045 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355595 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.003124:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800922b2c00/0x48868a4e43954045 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355595 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.003137:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129817.003140:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129817.003142:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b2c00, rc 0) 00000100:00100000:3.0:1746129817.003270:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4543 00000100:00100000:3.0:1746129817.003276:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31403:x1830949054199808:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129817.003337:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31406:x1830949054199936:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 293us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.003341:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10931 00000100:00080000:2.0:1746129817.003358:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129817.003606:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31403:x1830949054199808:12345-192.168.204.31@tcp:49:cat.0 Request processed in 330us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.003939:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4543 00000100:00100000:2.0:1746129817.008794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.008843:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.008956:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054200064 00000100:00100000:3.0:1746129817.008964:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054200064 00000100:00100000:1.0:1746129817.008991:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054200192 00000100:00100000:1.0:1746129817.008995:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054200192 00000100:00100000:3.0:1746129817.009002:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4544 00000100:00100000:3.0:1746129817.009008:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31406:x1830949054200064:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:1.0:1746129817.009032:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:1.0:1746129817.009038:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054200192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129817.009049:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129817.009074:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800922b2c00/0x48868a4e43954045 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355595 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.009086:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00000100:00100000:3.0:1746129817.009093:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31406:x1830949054200064:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 84us (310us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129817.009094:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.009099:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4544 00000100:00100000:1.0:1746129817.009120:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1963:x1830949054200192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.009126:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 723 00000100:00100000:0.0:1746129817.016368:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.016539:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054200448 00000100:00100000:3.0:1746129817.016547:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054200448 00002000:00100000:3.0:1746129817.016586:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff880092adaa00 x1830949054200448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.016596:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949054200448 ext(4927488->4931583) 00002000:00010000:3.0:1746129817.016601:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adaa00 00000100:00100000:3.0:1746129817.016627:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6718 00000100:00100000:3.0:1746129817.016635:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054200448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.016784:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054200448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 149us (423us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129817.016791:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6718 00002000:00100000:3.0:1746129817.016796:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff880092adaa00 x1830949054200448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.016803:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949054200448 ext(4927488->4931583) 00002000:00010000:3.0:1746129817.016805:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adaa00 00000100:00100000:0.0:1746129817.018333:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.018695:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054200576 00000100:00100000:2.0:1746129817.018700:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054200576 00000100:00100000:2.0:1746129817.018740:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15074 00000100:00100000:2.0:1746129817.018748:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31406:x1830949054200576:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.018759:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.018773:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35559c expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.018794:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 7 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.018802:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.018808:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.018819:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.018820:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.018823:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3387392->4194303] (req 3387392->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.018845:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.018945:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 19 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.018957:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053965568:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.019259:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.019268:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.019275:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053965696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.019299:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 7 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.019306:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 7 pid: 20441 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.019316:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053965824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.019329:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.023169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.024354:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.024414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.024465:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054200704 00000100:00100000:3.0:1746129817.024472:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054200704 00000100:00100000:3.0:1746129817.024505:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15075 00000100:00100000:3.0:1746129817.024512:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31404:x1830949054200704:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.024526:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.024544:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555a3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.024567:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.024575:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.024582:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.024592:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.024594:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.024597:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [4108288->4194303] (req 4108288->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.024619:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.024633:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.024643:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053965952:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.024712:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.024719:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 8 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.024726:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053966080:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.024747:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.024753:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 7 pid: 10930 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.024764:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053966208:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.024777:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.024842:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054200960 00000100:00100000:1.0:1746129817.024861:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054200960 00000100:00100000:1.0:1746129817.024883:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4545 00000100:00100000:1.0:1746129817.024887:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31407:x1830949054200960:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129817.025062:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054201088 00000100:00100000:2.0:1746129817.025065:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054201088 00010000:00010000:2.0:1746129817.025079:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.025093:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7501 00000100:00100000:2.0:1746129817.025097:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054201088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.025104:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.025116:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.025124:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.025138:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.025153:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054201088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 55us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.025158:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7501 00010000:00010000:2.0:1746129817.025182:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b534d000/0x48868a4e43953fea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355548 expref: 19 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.025203:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053965568:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.025229:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31407:x1830949054200960:12345-192.168.204.31@tcp:35:cat.0 Request processed in 341us (877us total) trans 8589944915 rc 0/0 00000100:00100000:1.0:1746129817.025278:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4545 00000100:00100000:2.0:1746129817.025320:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053965696:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.025326:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053965824:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.025343:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3387392->4194303] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.025351:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800922b3c00, rc 0) 00000100:00100000:2.0:1746129817.025365:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31406:x1830949054200576:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6618us (7035us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.025370:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15074 00000100:00100000:0.0:1746129817.025509:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.025616:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054201216 00000100:00100000:1.0:1746129817.025619:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054201216 00010000:00010000:1.0:1746129817.025703:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.025716:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7502 00000100:00100000:1.0:1746129817.025720:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054201216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129817.025725:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129817.025732:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.025738:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.025748:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c207600/0x48868a4e43953f18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355502 expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.025755:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1746129817.025837:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129817.026108:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054201216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 387us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.026114:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7502 00000100:00100000:2.0:1746129817.029742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.029757:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053965952:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.029768:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053966080:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.029775:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053966208:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.029801:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [4108288->4194303] (req 4108288->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.029816:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6fe600, rc 0) 00000100:00100000:3.0:1746129817.029868:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31404:x1830949054200704:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5356us (6706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.029876:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15075 00000100:00100000:2.0:1746129817.030137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.030587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.030700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.030720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.030818:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054201600 00000100:00100000:0.0:1746129817.030824:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054201600 00002000:00100000:0.0:1746129817.030866:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a645ea00 x1830949054201600/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.030875:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949054201600 ext(2097152->3145727) 00010000:00010000:0.0:1746129817.030882:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.030892:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00002000:00010000:0.0:1746129817.030898:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645ea00 00000100:00100000:0.0:1746129817.030911:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054201728 00000100:00100000:0.0:1746129817.030914:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054201728 00002000:00100000:0.0:1746129817.030924:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a645e680 x1830949054201728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.030930:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949054201728 ext(3145728->4194303) 00010000:00010000:0.0:1746129817.030934:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.030941:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00002000:00010000:0.0:1746129817.030946:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645e680 00000100:00100000:0.0:1746129817.030958:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054201984 00000100:00100000:0.0:1746129817.030960:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054201984 00002000:00100000:0.0:1746129817.030970:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a645f100 x1830949054201984/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.030976:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f100 with x1830949054201984 ext(3145728->4194303) 00010000:00010000:0.0:1746129817.030980:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.030986:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00002000:00010000:0.0:1746129817.030990:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645f100 00000100:00100000:0.0:1746129817.030997:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1815 00000100:00100000:0.0:1746129817.031002:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054201600:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129817.032115:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1816 00000100:00100000:0.0:1746129817.032121:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054201728:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129817.033092:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1817 00000100:00100000:2.0:1746129817.033101:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054201984:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129817.033228:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054202112 00000100:00100000:3.0:1746129817.033232:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054202112 00010000:00010000:3.0:1746129817.033250:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.033266:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054202240 00000100:00100000:3.0:1746129817.033268:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054202240 00010000:00010000:3.0:1746129817.033276:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 8 pid: 10930 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.033286:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7503 00000100:00100000:3.0:1746129817.033290:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054202112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.033298:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.033308:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.033316:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.033334:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534da00/0x48868a4e43953fe3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355541 expref: 14 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.033348:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.033368:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054202112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.033372:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7503 00000100:00100000:3.0:1746129817.033386:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7504 00000100:00100000:3.0:1746129817.033389:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054202240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.033394:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.033399:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 8 pid: 10930 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.033405:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 8 pid: 10930 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.033414:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b400/0x48868a4e43953f11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554fb expref: 8 pid: 10930 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.033425:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.033435:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054202240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (2714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.033439:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7504 00000100:00100000:2.0:1746129817.042625:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054201600:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11613us (12880us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.042635:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1815 00002000:00100000:2.0:1746129817.042645:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a645ea00 x1830949054201600/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.042654:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949054201600 ext(2097152->3145727) 00010000:00010000:2.0:1746129817.042662:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 11 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.042678:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 11 pid: 8437 timeout: 863 lvb_type: 1 00002000:00010000:2.0:1746129817.042685:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645ea00 00000100:00100000:2.0:1746129817.044340:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054201728:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12214us (14198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.044348:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1816 00002000:00100000:2.0:1746129817.044356:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a645e680 x1830949054201728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.044364:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949054201728 ext(3145728->4194303) 00010000:00010000:2.0:1746129817.044371:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.044381:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00002000:00010000:2.0:1746129817.044387:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645e680 00000100:00100000:2.0:1746129817.049378:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054201984:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16269us (18782us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.049389:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1817 00002000:00100000:2.0:1746129817.049399:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a645f100 x1830949054201984/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.049409:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645f100 with x1830949054201984 ext(3145728->4194303) 00010000:00010000:2.0:1746129817.049418:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.049430:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00002000:00010000:2.0:1746129817.049437:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645f100 00000100:00100000:0.0:1746129817.050907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.051030:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054202368 00000100:00100000:3.0:1746129817.051037:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054202368 00000100:00100000:3.0:1746129817.051077:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15076 00000100:00100000:3.0:1746129817.051083:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31403:x1830949054202368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.051097:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.051111:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555aa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.051132:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.051137:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4108288->4194303] (req 4108288->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.051143:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.051147:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.051175:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4108288->4194303] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.051186:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.051213:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ea00, rc 0) 00000100:00100000:3.0:1746129817.051248:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31403:x1830949054202368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 164us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.051253:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15076 00000100:00100000:0.0:1746129817.053551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.055424:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054202496 00000100:00100000:1.0:1746129817.055431:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054202496 00010000:00010000:1.0:1746129817.055461:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.055499:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7505 00000100:00100000:1.0:1746129817.055506:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054202496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129817.055519:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129817.055536:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.055552:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.055570:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c206a00/0x48868a4e4395400d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35556b expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.055596:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.055598:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.055605:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.055612:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.055640:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.055649:0:7109:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 12 pid: 8436 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.055659:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053966464:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129817.055733:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.057060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.057279:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054202624 00000100:00100000:3.0:1746129817.057284:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054202624 00010000:00010000:3.0:1746129817.057303:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.057325:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7506 00000100:00100000:3.0:1746129817.057331:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054202624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.057340:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.057354:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.057362:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.057376:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c207200/0x48868a4e43954014 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355572 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.057403:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.057405:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.057410:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.057421:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.057442:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 8 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.057451:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053966592:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.057514:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.058381:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949053966464:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129817.058406:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129817.058426:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054202496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2921us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.058434:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7505 00000100:00100000:0.0:1746129817.059363:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.059429:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054202880 00000100:00100000:2.0:1746129817.059434:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054202880 00002000:00100000:2.0:1746129817.059461:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4108288->4112383) req@ffff880094d8d880 x1830949054202880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.059470:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d880 with x1830949054202880 ext(4108288->4112383) 00010000:00010000:2.0:1746129817.059477:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 13 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.059487:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 13 pid: 8436 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.059493:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d8d880 00000100:00100000:2.0:1746129817.059506:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1818 00000100:00100000:2.0:1746129817.059511:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054202880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.059642:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054202880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 130us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129817.059647:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1818 00002000:00100000:2.0:1746129817.059652:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4108288->4112383) req@ffff880094d8d880 x1830949054202880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.059665:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d880 with x1830949054202880 ext(4108288->4112383) 00010000:00010000:2.0:1746129817.059670:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 13 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.059679:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 13 pid: 8436 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.059685:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d8d880 00000100:00100000:3.0:1746129817.060794:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053966592:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129817.060798:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129817.060806:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.060832:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054202624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3500us (3774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.060838:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7506 00000100:00100000:1.0:1746129817.060925:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054203136 00000100:00100000:1.0:1746129817.060930:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054203136 00002000:00100000:1.0:1746129817.060950:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3387392->3391487) req@ffff880094d8ea00 x1830949054203136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.060958:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ea00 with x1830949054203136 ext(3387392->3391487) 00002000:00010000:1.0:1746129817.060961:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ea00 00000100:00100000:1.0:1746129817.060973:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6719 00000100:00100000:1.0:1746129817.060978:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054203136:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.061062:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054203136:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 83us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.061067:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6719 00002000:00100000:1.0:1746129817.061072:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3387392->3391487) req@ffff880094d8ea00 x1830949054203136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.061078:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ea00 with x1830949054203136 ext(3387392->3391487) 00002000:00010000:1.0:1746129817.061081:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8ea00 00000100:00100000:0.0:1746129817.063367:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.063621:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.063676:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054203520 00000100:00100000:3.0:1746129817.063682:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054203520 00000100:00100000:2.0:1746129817.063693:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054203392 00000100:00100000:2.0:1746129817.063697:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054203392 00002000:00100000:3.0:1746129817.063710:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4108288->4194303) req@ffff880094d8d180 x1830949054203520/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.063719:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949054203520 ext(4108288->4194303) 00010000:00010000:3.0:1746129817.063726:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 13 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.063738:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 13 pid: 8436 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.063749:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d8d180 00000100:00100000:2.0:1746129817.063763:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15077 00000100:00100000:3.0:1746129817.063776:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1819 00000100:00100000:3.0:1746129817.063782:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054203520:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129817.063877:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31404:x1830949054203392:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.063885:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.063898:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555b1 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.063917:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.063923:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.063924:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.063927:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->3842047] (req 3145728->3842047) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.063949:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 7 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.063961:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 7 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.063970:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053966720:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.064017:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.068243:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.068291:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054203648 00000100:00100000:0.0:1746129817.068297:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054203648 00000100:00100000:2.0:1746129817.068300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:0.0:1746129817.068328:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3387392->4194303) req@ffff8800a645c700 x1830949054203648/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.068337:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949054203648 ext(3387392->4194303) 00000100:00100000:2.0:1746129817.068346:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053966720:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129817.068358:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 8 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.068368:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->3842047] (req 3145728->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.068369:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 8 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746129817.068375:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645c700 00010000:00010000:2.0:1746129817.068381:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094334c00, rc 0) 00000100:00100000:0.0:1746129817.068394:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1820 00000100:00100000:0.0:1746129817.068401:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054203648:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129817.068412:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31404:x1830949054203392:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4643us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.068419:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15077 00000100:00100000:2.0:1746129817.068434:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054203776 00000100:00100000:2.0:1746129817.068437:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054203776 00000100:00100000:2.0:1746129817.068450:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15078 00000100:00100000:2.0:1746129817.068455:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31406:x1830949054203776:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.068462:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.068473:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555b8 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.068488:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.068490:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.068494:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->4251647] (req 4194304->4251647) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 10 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.068501:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->4251647] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 10 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.068509:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335000, rc 0) 00000100:00100000:2.0:1746129817.068523:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31406:x1830949054203776:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.068528:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15078 00000100:00100000:3.0:1746129817.069415:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054203520:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5631us (5792us total) trans 21474841235 rc 0/0 00000100:00100000:3.0:1746129817.069422:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1819 00002000:00100000:3.0:1746129817.069428:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4108288->4194303) req@ffff880094d8d180 x1830949054203520/t21474841235(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.069436:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949054203520 ext(4108288->4194303) 00010000:00010000:3.0:1746129817.069442:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 15 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.069449:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 15 pid: 8436 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.069455:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094d8d180 00000100:00100000:0.0:1746129817.072451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.073556:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054203904 00000100:00100000:3.0:1746129817.073563:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054203904 00010000:00010000:3.0:1746129817.073591:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 15 pid: 8436 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.074468:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7507 00000100:00100000:3.0:1746129817.074477:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054203904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.074491:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129817.074506:0:10979:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129815 -> 1746129817 00002000:00010000:3.0:1746129817.074508:0:10979:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129815 -> 1746129817 00010000:00010000:3.0:1746129817.074514:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 15 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.074524:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 15 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.074543:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe600/0x48868a4e43954053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4108288->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555a3 expref: 15 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.074570:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.074572:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.074579:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.074587:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.074594:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.074595:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.074598:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.074605:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.074636:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.074646:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053966848:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.075146:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.075154:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053966976:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.075173:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.077566:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053966848:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129817.077645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.077875:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053966976:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.077901:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.077934:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054203904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3459us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.077943:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7507 00000100:00100000:3.0:1746129817.078090:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054204160 00000100:00100000:3.0:1746129817.078096:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054204160 00002000:00100000:3.0:1746129817.078121:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4247552->4251647) req@ffff88012c041f80 x1830949054204160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.078130:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949054204160 ext(4247552->4251647) 00002000:00010000:3.0:1746129817.078134:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041f80 00000100:00100000:3.0:1746129817.078146:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6720 00000100:00100000:3.0:1746129817.078151:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054204160:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129817.078289:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054204160:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 136us (644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129817.078294:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6720 00002000:00100000:3.0:1746129817.078299:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (4247552->4251647) req@ffff88012c041f80 x1830949054204160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.078310:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949054204160 ext(4247552->4251647) 00002000:00010000:3.0:1746129817.078313:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c041f80 00000100:00100000:1.0:1746129817.081481:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.081508:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054204416 00000100:00100000:1.0:1746129817.081514:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054204416 00000100:00100000:1.0:1746129817.081563:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4546 00000100:00100000:1.0:1746129817.081570:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31406:x1830949054204416:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129817.081895:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31406:x1830949054204416:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 324us (418us total) trans 8589944916 rc 0/0 00000100:00100000:1.0:1746129817.081902:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4546 00000100:00100000:1.0:1746129817.081949:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.082063:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054204672 00000100:00100000:3.0:1746129817.082067:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054204672 00002000:00100000:3.0:1746129817.082095:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009fd47b80 x1830949054204672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.082104:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47b80 with x1830949054204672 ext(3145728->4194303) 00002000:00010000:3.0:1746129817.082109:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd47b80 00000100:00100000:3.0:1746129817.082123:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6721 00000100:00100000:3.0:1746129817.082128:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054204672:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129817.086284:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054203648:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 17875us (18041us total) trans 17179874046 rc 0/0 00000100:00100000:0.0:1746129817.086295:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1820 00002000:00100000:0.0:1746129817.086304:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3387392->4194303) req@ffff8800a645c700 x1830949054203648/t17179874046(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.086313:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c700 with x1830949054203648 ext(3387392->4194303) 00010000:00010000:0.0:1746129817.086322:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 10 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.086334:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 10 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746129817.086341:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a645c700 00000100:00100000:3.0:1746129817.093769:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054204672:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11634us (11813us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.093779:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6721 00002000:00100000:3.0:1746129817.093788:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009fd47b80 x1830949054204672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.093797:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47b80 with x1830949054204672 ext(3145728->4194303) 00002000:00010000:3.0:1746129817.093802:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fd47b80 00000100:00100000:0.0:1746129817.094332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.097464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.097575:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054204800 00000100:00100000:2.0:1746129817.097584:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054204800 00010000:00010000:2.0:1746129817.097619:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 10 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.097639:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054204928 00000100:00100000:1.0:1746129817.097643:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054204928 00000100:00100000:2.0:1746129817.097647:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7508 00000100:00100000:2.0:1746129817.097654:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054204800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.097666:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129817.097682:0:10979:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129815 -> 1746129817 00000100:00100000:1.0:1746129817.097682:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15079 00002000:00010000:2.0:1746129817.097685:0:10979:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129815 -> 1746129817 00000100:00100000:1.0:1746129817.097688:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31403:x1830949054204928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.097689:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 11 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.097701:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 11 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.097702:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.097714:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555bf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.097890:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800922b3c00/0x48868a4e4395404c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3387392->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35559c expref: 12 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.097970:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.097977:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->3842047] (req 3145728->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.097983:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129817.097986:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.098028:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->3842047] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.098039:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.098046:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.098047:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.098052:0:8436:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.098059:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.098074:0:8436:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 19 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.098084:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 19 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.098100:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053967232:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129817.098169:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129817.098306:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.098330:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054204800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 676us (3998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.098337:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7508 00000100:00100000:1.0:1746129817.104224:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949053967232:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129817.104258:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c4600, rc 0) 00000100:00100000:1.0:1746129817.104687:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31403:x1830949054204928:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6997us (7228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.104696:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15079 00000100:00100000:0.0:1746129817.110794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.111534:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054205184 00000100:00100000:3.0:1746129817.111542:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054205184 00002000:00100000:3.0:1746129817.111581:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->3842047) req@ffff88012c040000 x1830949054205184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.111590:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949054205184 ext(3837952->3842047) 00010000:00010000:3.0:1746129817.111599:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.111612:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.111618:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c040000 00000100:00100000:3.0:1746129817.111646:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1821 00000100:00100000:3.0:1746129817.111652:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054205184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.111794:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054205184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 141us (1006us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129817.111799:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1821 00002000:00100000:3.0:1746129817.111803:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->3842047) req@ffff88012c040000 x1830949054205184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.111810:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949054205184 ext(3837952->3842047) 00010000:00010000:3.0:1746129817.111814:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.111822:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.111827:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c040000 00000100:00100000:0.0:1746129817.116400:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.116463:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054205568 00000100:00100000:1.0:1746129817.116486:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054205568 00000100:00100000:0.0:1746129817.116495:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.117276:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4547 00000100:00100000:1.0:1746129817.117285:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31404:x1830949054205568:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129817.117394:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054205696 00000100:00100000:2.0:1746129817.117399:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054205696 00002000:00100000:2.0:1746129817.117436:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3842047) req@ffff8800a5493100 x1830949054205696/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.117458:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493100 with x1830949054205696 ext(3145728->3842047) 00010000:00010000:2.0:1746129817.117465:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.117475:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31404:x1830949054205568:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 192us (1083us total) trans 8589944917 rc 0/0 00010000:00010000:2.0:1746129817.117478:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 20 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.117482:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4547 00002000:00010000:2.0:1746129817.117498:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5493100 00000100:00100000:2.0:1746129817.117537:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1822 00000100:00100000:2.0:1746129817.117543:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054205696:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129817.128695:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054205696:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11143us (12191us total) trans 17179874047 rc 0/0 00000100:00100000:2.0:1746129817.128707:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1822 00002000:00100000:2.0:1746129817.128717:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3842047) req@ffff8800a5493100 x1830949054205696/t17179874047(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.128726:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493100 with x1830949054205696 ext(3145728->3842047) 00010000:00010000:2.0:1746129817.128734:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 22 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.128749:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 22 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.128756:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5493100 00000100:00100000:0.0:1746129817.134039:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.134128:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054205824 00000100:00100000:2.0:1746129817.134136:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054205824 00010000:00010000:2.0:1746129817.134165:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 22 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.134212:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7509 00000100:00100000:2.0:1746129817.134219:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054205824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.134232:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.134250:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 22 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.134262:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 22 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.134284:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43954061 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b1 expref: 22 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.134313:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.134314:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.134321:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.134327:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.134354:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.134364:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053967360:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.134435:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.137379:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053967360:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.137395:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.137436:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054205824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3216us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.137444:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7509 00000100:00100000:0.0:1746129817.139701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.139781:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054206080 00000100:00100000:2.0:1746129817.139789:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054206080 00002000:00100000:2.0:1746129817.139824:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a5493b80 x1830949054206080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.139839:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949054206080 ext(3145728->4194303) 00002000:00010000:2.0:1746129817.139844:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:2.0:1746129817.140295:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6722 00000100:00100000:2.0:1746129817.140302:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206080:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129817.147071:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206080:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 6761us (7369us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.147081:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6722 00002000:00100000:2.0:1746129817.147091:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a5493b80 x1830949054206080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.147099:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949054206080 ext(3145728->4194303) 00002000:00010000:2.0:1746129817.147104:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:0.0:1746129817.149979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.150048:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054206208 00000100:00100000:1.0:1746129817.150055:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054206208 00000100:00100000:1.0:1746129817.150100:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15080 00000100:00100000:1.0:1746129817.150107:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129817.150121:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.150135:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5c00/0x48868a4e43954076 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555c6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.150178:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967488:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129817.150271:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746129817.151317:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129813 -> 1746129817 00000100:00100000:1.0:1746129817.151335:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967488:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129817.151367:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5c00/0x48868a4e43954076 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555c6 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.151377:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5c00/0x48868a4e43954076 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555c6 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.151402:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c5c00, rc 0) 00000100:00100000:1.0:1746129817.151632:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1524us (1659us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129817.151639:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15080 00000100:00100000:0.0:1746129817.155231:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.155351:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054206464 00000100:00100000:2.0:1746129817.155357:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054206464 00002000:00100000:2.0:1746129817.155392:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4251648->4931583) req@ffff8800a5492300 x1830949054206464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.155402:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492300 with x1830949054206464 ext(4251648->4931583) 00002000:00010000:2.0:1746129817.155406:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5492300 00000100:00100000:2.0:1746129817.155433:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6723 00000100:00100000:2.0:1746129817.155440:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.161943:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6495us (6711us total) trans 0 rc 679936/679936 00000100:00100000:2.0:1746129817.161954:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6723 00002000:00100000:2.0:1746129817.161965:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4251648->4931583) req@ffff8800a5492300 x1830949054206464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 679936/679936 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.161974:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492300 with x1830949054206464 ext(4251648->4931583) 00002000:00010000:2.0:1746129817.161979:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5492300 00000100:00100000:0.0:1746129817.167900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.167973:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054206592 00000100:00100000:1.0:1746129817.167990:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054206592 00000100:00100000:1.0:1746129817.168156:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15081 00000100:00100000:1.0:1746129817.168164:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054206592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129817.168182:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.168208:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5200/0x48868a4e4395407d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555cd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.168251:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967616:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129817.168318:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.170679:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967616:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129817.170714:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5200/0x48868a4e4395407d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555cd expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.170725:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5200/0x48868a4e4395407d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555cd expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.170751:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c5200, rc 0) 00000100:00100000:1.0:1746129817.170789:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054206592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2626us (2896us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129817.170795:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15081 00000100:00100000:0.0:1746129817.175310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.175378:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054206720 00000100:00100000:1.0:1746129817.175385:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054206720 00000100:00100000:1.0:1746129817.175977:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15082 00000100:00100000:1.0:1746129817.175985:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129817.175999:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.176011:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5600/0x48868a4e43954084 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555d4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.176050:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967744:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129817.176114:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.179143:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967744:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129817.179178:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5600/0x48868a4e43954084 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555d4 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.179203:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5600/0x48868a4e43954084 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555d4 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.179313:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c5600, rc 0) 00000100:00100000:1.0:1746129817.179488:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054206720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3503us (4184us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129817.179495:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15082 00000100:00100000:0.0:1746129817.184517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.184647:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054206976 00000100:00100000:1.0:1746129817.184656:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054206976 00000100:00100000:1.0:1746129817.184703:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4548 00000100:00100000:1.0:1746129817.184709:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31403:x1830949054206976:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129817.184919:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31403:x1830949054206976:12345-192.168.204.31@tcp:35:cat.0 Request processed in 209us (409us total) trans 8589944918 rc 0/0 00000100:00100000:1.0:1746129817.184925:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4548 00000100:00100000:0.0:1746129817.194666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.194789:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054207104 00000100:00100000:2.0:1746129817.194796:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054207104 00000100:00100000:2.0:1746129817.195483:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10932 00000100:00100000:2.0:1746129817.195538:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31414:x1830949054207104:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129817.195556:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.195571:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f800/0x48868a4e4395408b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555db expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.195616:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195626:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195634:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195644:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195650:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195655:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195875:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195883:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195889:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129817.195911:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:2.0:1746129817.195914:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129817.195925:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195932:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195937:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195942:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195947:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195952:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013186fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.195955:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195960:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195969:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129817.195971:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.195974:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.195979:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e43954092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196003:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196082:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196088:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196093:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013186f000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.196095:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196099:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196106:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49d00) 00010000:00010000:2.0:1746129817.196107:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.196110:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196114:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e43954099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.196134:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f800/0x48868a4e4395408b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.196144:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.196154:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129817.196156:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129817.196158:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186e600, rc 0) 00000100:00100000:2.0:1746129817.196214:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31414:x1830949054207104:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 679us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.196219:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10932 00010000:00010000:2.0:1746129817.199392:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129817.200710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.200892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.201170:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054207232 00000100:00100000:1.0:1746129817.201178:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054207232 00000100:00100000:1.0:1746129817.201224:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054207360 00000100:00100000:1.0:1746129817.201226:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054207360 00000100:00100000:1.0:1746129817.201240:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15083 00000100:00100000:1.0:1746129817.201246:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054207232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.201259:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.201271:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4c4c00/0x48868a4e439540a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555e2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.201308:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967872:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129817.201351:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15084 00000100:00100000:1.0:1746129817.201355:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.201359:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054207360:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129817.201367:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.201376:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555e9 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.201388:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.201390:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.201398:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.201411:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.201420:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186e200, rc 0) 00000100:00100000:2.0:1746129817.201488:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054207360:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 84us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.201494:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15084 00000100:00100000:1.0:1746129817.204246:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053967872:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129817.204289:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c4c00/0x48868a4e439540a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e2 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.204311:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c4c00/0x48868a4e439540a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e2 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.204336:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c4c00, rc 0) 00000100:00100000:1.0:1746129817.204369:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054207232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3122us (3664us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129817.204376:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15083 00000100:00100000:0.0:1746129817.208444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.208720:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054207616 00000100:00100000:2.0:1746129817.208729:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054207616 00000100:00100000:2.0:1746129817.208779:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10933 00000100:00100000:2.0:1746129817.208786:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31414:x1830949054207616:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129817.208802:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.208814:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ee00/0x48868a4e439540b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555f0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.208924:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.208935:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.208941:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.208966:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.208975:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 8 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.208984:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053968000:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.209549:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.211906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.212294:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053968000:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.212313:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129817.212412:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054207744 00000100:00100000:3.0:1746129817.212417:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054207744 00010000:00010000:3.0:1746129817.212447:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 9 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.212478:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7510 00000100:00100000:3.0:1746129817.212486:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054207744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.212496:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.212501:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 9 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.212510:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 9 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.212680:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186e600/0x48868a4e439540a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555db expref: 9 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.212815:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.212819:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.212827:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.212833:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.212894:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.212939:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054207744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 453us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.212944:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7510 00010000:00010000:0.0:1746129817.212990:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.212996:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129817.213011:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129817.213118:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186ee00/0x48868a4e439540b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.213144:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.213150:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129817.213152:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129817.213155:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186f400, rc 0) 00000100:00100000:0.0:1746129817.213175:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054207616:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4390us (4737us total) trans 8589944919 rc 0/0 00000100:00100000:0.0:1746129817.213180:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10933 00000100:00100000:0.0:1746129817.215097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.215621:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054207872 00000100:00100000:2.0:1746129817.215627:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054207872 00000100:00100000:2.0:1746129817.215672:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10934 00000100:00100000:2.0:1746129817.215679:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054207872:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129817.215696:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.215708:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e439540ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555f7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.215768:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.215780:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.215786:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.215809:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.215818:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 9 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.215828:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053968128:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.215930:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.217127:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053968128:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.217142:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129817.217366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.217520:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208000 00000100:00100000:3.0:1746129817.217525:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208000 00010000:00010000:3.0:1746129817.217542:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.217566:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7511 00000100:00100000:3.0:1746129817.217571:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054208000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.217580:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.217584:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.217592:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.217606:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f400/0x48868a4e439540bc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f0 expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.217618:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.217622:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.217629:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.217634:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.217657:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129817.217945:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.217952:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129817.217980:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:2.0:1746129817.217983:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129817.217993:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.218015:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186f000/0x48868a4e439540ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f7 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.218030:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f7 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.218035:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129817.218037:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129817.218039:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186fe00, rc 0) 00000100:00100000:3.0:1746129817.218091:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054208000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 518us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.218097:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7511 00000100:00100000:2.0:1746129817.218234:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054207872:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2555us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.218239:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10934 00000100:00100000:0.0:1746129817.221177:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.221276:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208128 00000100:00100000:1.0:1746129817.221283:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208128 00000100:00100000:1.0:1746129817.221376:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15085 00000100:00100000:1.0:1746129817.221385:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054208128:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.222225:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.222240:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5200/0x48868a4e439540d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3555fe expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.222287:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053968256:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129817.222365:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.224357:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053968256:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129817.224392:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5200/0x48868a4e439540d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555fe expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.224403:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5200/0x48868a4e439540d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555fe expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.225132:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4c5200, rc 0) 00000100:00100000:1.0:1746129817.225167:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054208128:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3783us (3998us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129817.225174:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15085 00000100:00100000:2.0:1746129817.232232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.232296:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208384 00000100:00100000:0.0:1746129817.232304:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208384 00000100:00100000:0.0:1746129817.232384:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10935 00000100:00100000:0.0:1746129817.232392:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054208384:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129817.232412:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129817.232654:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca7a00/0x48868a4e439540df lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355605 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.232735:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6400/0x48868a4e439540e6 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.232747:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6400/0x48868a4e439540e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.232756:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6400/0x48868a4e439540e6 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129817.232765:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00010000:00010000:0.0:1746129817.232881:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca7a00/0x48868a4e439540df lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355605 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.232898:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6400/0x48868a4e439540e6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355605 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.232905:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129817.232908:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129817.232911:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca6400, rc 0) 00000100:00100000:1.0:1746129817.232971:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31414:x1830949054208384:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 578us (746us total) trans 8589944920 rc 0/0 00000100:00100000:1.0:1746129817.232978:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10935 00000100:00100000:0.0:1746129817.235405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.235442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.235467:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208512 00000100:00100000:1.0:1746129817.235473:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208512 00000100:00100000:0.0:1746129817.235486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.236069:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208640 00000100:00100000:1.0:1746129817.236072:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208640 00000100:00100000:3.0:1746129817.236080:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208768 00000100:00100000:1.0:1746129817.236091:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15086 00000100:00100000:1.0:1746129817.236097:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054208512:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:2.0:1746129817.236120:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15087 00010000:00010000:1.0:1746129817.236127:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.236128:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054208640:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129817.236142:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 7 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.236149:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.236149:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 9 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.236155:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.236160:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.236160:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.236163:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.236165:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.236172:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.236179:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 20 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.236184:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.236186:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.236199:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.236199:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.236210:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 13 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.236217:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 20 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129817.236221:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053968384:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.236225:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 20 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.236234:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053968512:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.236267:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208768 00010000:00010000:1.0:1746129817.236284:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 9 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129817.236289:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15088 00010000:00010000:1.0:1746129817.236292:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 9 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.236294:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054208768:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129817.236300:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053968640:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.236309:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.236325:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.236332:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.236338:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.236343:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.236344:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.236346:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.236361:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.236369:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.236376:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053968768:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.236432:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.236437:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 7 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.236440:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.236445:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 7 pid: 8435 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.236447:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053968896:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.236453:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053969024:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.236471:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2c6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129817.236472:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.236479:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 9 pid: 10930 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.236486:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053969152:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.236501:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129817.236559:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.236567:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.236575:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053969280:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.236771:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.236779:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 9 pid: 20441 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.236786:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053969408:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.236802:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.237203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.237231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.237263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.238095:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054208896 00000100:00100000:3.0:1746129817.238101:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054208896 00000100:00100000:3.0:1746129817.238124:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209024 00000100:00100000:3.0:1746129817.238126:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209024 00000100:00100000:3.0:1746129817.238135:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209152 00000100:00100000:3.0:1746129817.238137:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209152 00000100:00100000:3.0:1746129817.238148:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15089 00000100:00100000:3.0:1746129817.238154:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054208896:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129817.238177:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238197:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.238208:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.238215:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.238220:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.238221:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.238223:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238242:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.238250:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.238259:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053969536:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.238311:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.238318:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.238325:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053969664:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.238347:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.238354:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 9 pid: 7976 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.238361:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053969792:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.238373:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.238388:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15090 00000100:00100000:3.0:1746129817.238393:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054209024:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129817.238407:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238416:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238422:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238426:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129817.238427:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129817.238429:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238440:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238450:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 9 pid: 8436 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.238457:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053969920:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.238479:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.238486:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.238492:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053970048:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.238504:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.238560:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15091 00000100:00100000:1.0:1746129817.238569:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054209152:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129817.238585:0:20441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.238594:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.238601:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.238605:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.238607:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.238609:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.238623:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.238630:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 10 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.238638:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053970176:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.238664:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.238671:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 9 pid: 8436 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.238683:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053970304:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.238695:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.240901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.240934:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.240953:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209280 00000100:00100000:0.0:1746129817.240958:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209280 00010000:00010000:0.0:1746129817.240982:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 10 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746129817.241000:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209664 00000100:00100000:0.0:1746129817.241002:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209664 00010000:00010000:0.0:1746129817.241012:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746129817.241025:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7512 00000100:00100000:0.0:1746129817.241031:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054209280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.241041:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.241059:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 10 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.241068:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 10 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.241086:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.241112:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054209280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.241117:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7512 00000100:00100000:0.0:1746129817.241151:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7513 00000100:00100000:0.0:1746129817.241156:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054209664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.241163:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.241175:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.241182:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 10 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.241204:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.241219:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054209664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.241223:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7513 00000100:00100000:0.0:1746129817.241248:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.241260:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209408 00000100:00100000:0.0:1746129817.241263:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209408 00010000:00010000:0.0:1746129817.241272:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 21 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746129817.241285:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7514 00000100:00100000:0.0:1746129817.241289:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054209408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.241294:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.241300:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 21 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.241308:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 21 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.241317:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.241330:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054209408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.241335:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7514 00000100:00100000:1.0:1746129817.241643:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053968384:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.241653:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6200/0x48868a4e43953ff1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35554f expref: 9 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.241667:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd46680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053968640:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.241812:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43953fce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35552c expref: 20 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.241825:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053968512:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.241833:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c207800/0x48868a4e43953ff8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355556 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.241840:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053968896:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129817.242638:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053968768:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.243229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.243247:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209536 00000100:00100000:3.0:1746129817.243251:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209536 00010000:00010000:3.0:1746129817.243266:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 14 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.243281:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7515 00000100:00100000:3.0:1746129817.243286:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054209536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.243294:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.243306:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 14 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.243319:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 14 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.243332:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f87a600/0x48868a4e43953fc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355525 expref: 14 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.243590:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053969152:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.243612:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.243663:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.243693:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054209536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 406us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.243698:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7515 00000100:00100000:3.0:1746129817.243781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.243790:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209792 00000100:00100000:3.0:1746129817.243792:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209792 00010000:00010000:3.0:1746129817.243802:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.243813:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7516 00000100:00100000:3.0:1746129817.243817:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054209792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.243823:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.243833:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.243839:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.243872:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b534c200/0x48868a4e43953fd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355533 expref: 20 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.243883:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.243896:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054209792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.243901:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7516 00000100:00100000:1.0:1746129817.244063:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949053969024:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.244108:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.244559:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053969280:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.244583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.244623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.244638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.244639:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210048 00000100:00100000:2.0:1746129817.244642:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210048 00010000:00010000:2.0:1746129817.244655:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.245085:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054209920 00000100:00100000:2.0:1746129817.245089:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054209920 00010000:00010000:2.0:1746129817.245099:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 11 pid: 10930 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.245112:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210176 00000100:00100000:3.0:1746129817.245113:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053970048:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.245113:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210176 00010000:00010000:2.0:1746129817.245120:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 10 pid: 8435 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.245132:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7517 00000100:00100000:2.0:1746129817.245137:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054210048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.245143:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.245154:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245162:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245174:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c206600/0x48868a4e43953fff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35555d expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245182:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.245215:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054210048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (1292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.245220:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7517 00000100:00100000:2.0:1746129817.245232:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7518 00000100:00100000:2.0:1746129817.245236:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054209920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.245243:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.245251:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 11 pid: 10930 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245258:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 11 pid: 10930 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245269:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3a400/0x48868a4e43953efc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554e6 expref: 11 pid: 10930 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245276:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.245278:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.245281:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.245356:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7519 00000100:00100000:0.0:1746129817.245362:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054210176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.245369:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.245379:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 10 pid: 8435 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.245387:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 10 pid: 8435 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.245398:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e43953ef5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554df expref: 10 pid: 8435 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.245409:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.245410:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.245412:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.245418:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.245434:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129817.245439:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053970176:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129817.245447:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054210176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.245456:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7519 00010000:00010000:1.0:1746129817.245460:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245466:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245484:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245490:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245501:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245507:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4c5400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129817.245510:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245512:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245517:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245525:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129817.245525:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.245530:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4c5400/0x48868a4e439540f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.245539:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054209920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 302us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.245544:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7518 00010000:00010000:2.0:1746129817.245622:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245629:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245641:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245648:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245653:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245657:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094334c00 already unused, calling callback (ffffffffa08a1d70) 00000100:00100000:3.0:1746129817.245659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129817.245660:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245665:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245673:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245678:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e439540fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.245707:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054208640:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 9581us (10265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.245713:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15087 00000100:00100000:3.0:1746129817.245716:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053969536:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.245751:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053969664:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.245755:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.245757:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949053969792:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.245766:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210432 00000100:00100000:2.0:1746129817.245768:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210432 00010000:00010000:3.0:1746129817.245770:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.245778:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 9 pid: 1140 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.245790:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7520 00000100:00100000:2.0:1746129817.245795:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054210432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.245800:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.245808:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 9 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245815:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 9 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245824:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013186e200/0x48868a4e439540ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555e9 expref: 9 pid: 1140 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.245831:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.245843:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054210432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.245864:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7520 00000100:00100000:0.0:1746129817.245928:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053969408:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129817.245941:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.246173:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054208512:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 9489us (10187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.246179:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15086 00000100:00100000:1.0:1746129817.246211:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053970304:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.246234:0:20441:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.246322:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.246380:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.246391:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211072 00000100:00100000:2.0:1746129817.246393:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211072 00010000:00010000:2.0:1746129817.246403:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 8 pid: 8436 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.246419:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210560 00000100:00100000:2.0:1746129817.246421:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210560 00010000:00010000:2.0:1746129817.246427:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.246494:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053969920:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.246505:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.246548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.246783:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210816 00000100:00100000:2.0:1746129817.246786:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210816 00010000:00010000:2.0:1746129817.246798:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.246812:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7521 00000100:00100000:2.0:1746129817.246816:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054211072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.246823:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.246830:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 8 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.246837:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 8 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.246865:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4c4600/0x48868a4e4395406f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555bf expref: 8 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.246873:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.246875:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.246877:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.246888:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.246901:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.246948:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7522 00000100:00100000:3.0:1746129817.246951:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7523 00000100:00100000:0.0:1746129817.246953:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054210560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129817.246956:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054210816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.246959:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.246967:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.246970:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.246974:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.246978:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.246984:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c207a00/0x48868a4e43953f03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554ed expref: 8 pid: 20441 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.246986:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.246991:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.246992:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.246994:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.246995:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c206000/0x48868a4e43954006 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355564 expref: 9 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.247000:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247003:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129817.247010:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.247082:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1962:x1830949054211072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 264us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.247087:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7521 00000100:00100000:2.0:1746129817.247111:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.247119:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210688 00000100:00100000:2.0:1746129817.247121:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210688 00010000:00010000:2.0:1746129817.247129:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.247139:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7524 00000100:00100000:2.0:1746129817.247143:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949054210688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.247148:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.247154:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.247162:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.247163:0:20441:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.247172:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b534d600/0x48868a4e43953fdc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35553a expref: 13 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746129817.247174:0:20441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.247179:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129817.247200:0:20441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.247203:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1964:x1830949054210688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (91us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129817.247207:0:20441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.247208:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7524 00010000:00010000:1.0:1746129817.247212:0:20441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.247218:0:20441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129817.247220:0:20441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.247226:0:20441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.247230:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129817.247235:0:20441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.247237:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210944 00000100:00100000:2.0:1746129817.247239:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210944 00010000:00010000:1.0:1746129817.247240:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e43954117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.247246:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 8 pid: 7976 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.247257:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7525 00000100:00100000:2.0:1746129817.247260:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054210944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.247265:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.247271:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 8 pid: 7976 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.247278:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 8 pid: 7976 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.247282:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054209152:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 8716us (10019us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129817.247287:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e43953f0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3554f4 expref: 8 pid: 7976 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.247288:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15091 00010000:00010000:2.0:1746129817.247293:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.247295:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.247297:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.247303:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.247317:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.247328:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054210944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.247332:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7525 00000100:00100000:0.0:1746129817.247699:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054210560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 744us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.247702:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054210816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 746us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.247704:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7522 00000100:00100000:3.0:1746129817.247706:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7523 00010000:00010000:3.0:1746129817.247719:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247721:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247725:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247726:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247738:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247738:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247743:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247743:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247749:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247753:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247754:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12b400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129817.247756:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247758:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013094ac00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129817.247760:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247761:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247765:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247769:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247772:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.247777:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013094ac00/0x48868a4e43954109 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.247778:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a12b400/0x48868a4e43954102 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.247801:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054208896:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 9647us (10598us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.247801:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054208768:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 11507us (12316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.247805:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15088 00000100:00100000:2.0:1746129817.247896:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.247915:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054210304 00000100:00100000:2.0:1746129817.247918:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054210304 00002000:00100000:2.0:1746129817.247940:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4251647) req@ffff88009faf7100 x1830949054210304/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.247947:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf7100 with x1830949054210304 ext(4194304->4251647) 00010000:00010000:2.0:1746129817.247952:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 8 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.247960:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 8 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.247965:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009faf7100 00000100:00100000:2.0:1746129817.247980:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1823 00000100:00100000:2.0:1746129817.247984:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054210304:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129817.248113:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211200 00000100:00100000:0.0:1746129817.248116:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211200 00010000:00010000:0.0:1746129817.248127:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 10 pid: 8436 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746129817.248141:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7526 00000100:00100000:0.0:1746129817.248146:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054211200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.248152:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.248158:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 10 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.248165:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 10 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.248176:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ea00/0x48868a4e4395405a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555aa expref: 10 pid: 8436 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.248184:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.248208:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054211200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.248216:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7526 00000100:00100000:3.0:1746129817.248287:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15089 00000100:00100000:2.0:1746129817.254317:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054210304:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6323us (8649us total) trans 21474841236 rc 0/0 00000100:00100000:2.0:1746129817.254327:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1823 00002000:00100000:2.0:1746129817.254337:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4251647) req@ffff88009faf7100 x1830949054210304/t21474841236(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.254351:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf7100 with x1830949054210304 ext(4194304->4251647) 00010000:00010000:2.0:1746129817.254359:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.254372:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.254378:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009faf7100 00000100:00100000:0.0:1746129817.258609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.258665:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211328 00000100:00100000:2.0:1746129817.258674:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211328 00010000:00010000:2.0:1746129817.258704:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.258741:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7527 00000100:00100000:2.0:1746129817.258748:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054211328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.258759:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.258776:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.258786:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.258804:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4251647) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555b8 expref: 9 pid: 1140 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.258834:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.258836:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.258840:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.258875:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.258894:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129817.258904:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.258911:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.258927:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.258934:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.258939:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054211328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 191us (337us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129817.258940:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.258945:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7527 00010000:00010000:0.0:1746129817.258946:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013094ba00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129817.258948:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.258954:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.258964:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.258974:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e43954110 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.259115:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1964:x1830949054209024:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 20721us (21883us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.259122:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15090 00000100:00100000:0.0:1746129817.261354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.261408:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211584 00000100:00100000:1.0:1746129817.261413:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211584 00000100:00100000:1.0:1746129817.261455:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10936 00000100:00100000:1.0:1746129817.261461:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31414:x1830949054211584:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:1.0:1746129817.261498:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129817.261518:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439540d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3555f7 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.261546:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129817.261550:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129817.261577:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129817.261590:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.261596:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.261602:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.261607:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129817.261627:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.261640:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 284 pid: 14314 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.261651:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053970432:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.261928:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.261937:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 8 pid: 15044 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.261945:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053970560:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.262223:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.262230:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.262237:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053970688:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.262258:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135d2cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.263814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.264396:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053970432:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.264406:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd44000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053970560:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129817.264475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.264585:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211840 00000100:00100000:1.0:1746129817.264590:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211840 00010000:00010000:1.0:1746129817.264615:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 9 pid: 15044 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.264642:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211712 00000100:00100000:1.0:1746129817.264644:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211712 00010000:00010000:1.0:1746129817.264652:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.264682:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7528 00000100:00100000:1.0:1746129817.264687:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054211840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129817.264698:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129817.264702:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 9 pid: 15044 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.264710:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 9 pid: 15044 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.264726:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800945cfa00/0x48868a4e43954037 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355587 expref: 9 pid: 15044 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.264737:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129817.264742:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129817.264748:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.264777:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7529 00000100:00100000:3.0:1746129817.264785:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054211712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.264792:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.264796:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.264809:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.264821:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135676000/0x48868a4e4395403e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35558e expref: 285 pid: 14314 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.265311:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054211840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 622us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.265318:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7528 00000100:00100000:1.0:1746129817.265343:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053970688:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.265370:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.265652:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.265657:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.265662:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.265694:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1961:x1830949054211712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 910us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.265700:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7529 00000100:00100000:0.0:1746129817.266108:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.266211:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054211968 00000100:00100000:2.0:1746129817.266216:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054211968 00010000:00010000:2.0:1746129817.266230:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.266245:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7530 00000100:00100000:2.0:1746129817.266250:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949054211968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.266256:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.266260:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.266268:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.266280:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094880a00/0x48868a4e43954030 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355580 expref: 284 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.266303:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129817.266306:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.266312:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.266318:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.266507:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.266538:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949054211968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 286us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.266543:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7530 00010000:00010000:0.0:1746129817.266589:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.266595:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:1.0:1746129817.267924:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3460, 88 off291208 00000004:00080000:1.0:1746129817.267933:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326084155ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.267987:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3472, 88 off292176 00000004:00080000:1.0:1746129817.267994:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326145894ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268014:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3473, 88 off292264 00000004:00080000:1.0:1746129817.268017:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326168823ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268028:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3461, 88 off291296 00000004:00080000:1.0:1746129817.268030:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326182457ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268037:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3462, 88 off291384 00000004:00080000:1.0:1746129817.268039:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326191087ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268045:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3474, 88 off292352 00000004:00080000:1.0:1746129817.268047:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326199360ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268053:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3475, 88 off292440 00000004:00080000:1.0:1746129817.268056:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326207782ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268062:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3476, 88 off292528 00000004:00080000:1.0:1746129817.268064:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326216449ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268070:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3463, 88 off291472 00000004:00080000:1.0:1746129817.268073:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326224707ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268082:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3477, 88 off292616 00000004:00080000:1.0:1746129817.268085:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326237262ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268092:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3464, 88 off291560 00000004:00080000:1.0:1746129817.268094:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326246525ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268363:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3478, 88 off292704 00000004:00080000:1.0:1746129817.268368:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326520147ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129817.268444:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3465, 88 off291648 00000004:00080000:1.0:1746129817.268448:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326599883ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268468:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3466, 88 off291736 00000004:00080000:1.0:1746129817.268470:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326622669ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268476:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3467, 88 off291824 00000004:00080000:1.0:1746129817.268478:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326630593ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268484:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3468, 88 off291912 00000004:00080000:1.0:1746129817.268486:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763326638540ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129817.268494:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3479, 88 off292792 00000004:00080000:1.0:1746129817.268496:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763326648477ns, next at 716792379979ns, rc = 0 00000004:00010000:1.0:1746129817.289452:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009284f100 reply state ffff8800b4096400 transno 8589944921 ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129817.289464:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746129817.289562:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31414:x1830949054211584:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 28097us (28209us total) trans 8589944921 rc 0/0 00000100:00100000:1.0:1746129817.289570:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10936 00000001:00080000:0.0:1746129817.289638:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944920 is committed 00000001:00080000:0.0:1746129817.289656:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944921 is committed 00000004:00080000:0.0:1746129817.289660:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2647 committed 00000004:00080000:0.0:1746129817.289665:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2641 committed 00000004:00080000:0.0:1746129817.289670:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2640 committed 00000004:00080000:0.0:1746129817.289671:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2639 committed 00000004:00080000:0.0:1746129817.289673:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2638 committed 00000004:00080000:0.0:1746129817.289674:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2646 committed 00000004:00080000:0.0:1746129817.289675:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2637 committed 00000004:00080000:0.0:1746129817.289677:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2645 committed 00000004:00080000:0.0:1746129817.289678:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2636 committed 00000004:00080000:0.0:1746129817.289679:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2644 committed 00000004:00080000:0.0:1746129817.289682:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2643 committed 00000004:00080000:0.0:1746129817.289683:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2642 committed 00000004:00080000:0.0:1746129817.289685:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2635 committed 00000004:00080000:0.0:1746129817.289686:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2634 committed 00000004:00080000:0.0:1746129817.289687:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2641 committed 00000004:00080000:0.0:1746129817.289689:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2640 committed 00000004:00080000:0.0:1746129817.289690:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2633 committed 00000001:00080000:0.0:1746129817.289694:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944918 is committed 00000001:00080000:0.0:1746129817.289700:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944917 is committed 00000100:00100000:0.0:1746129817.289824:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053970816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.289882:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.289905:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.289919:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.289932:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129817.289936:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.289947:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.289955:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.289965:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.289978:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053970944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.289990:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.289998:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053971456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290008:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.290016:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129817.290019:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053971072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290029:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.290036:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053971584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290048:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.290065:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053970816 00000100:00100000:0.0:1746129817.290070:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053970816 00000100:00100000:0.0:1746129817.290095:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971328 00000100:00100000:0.0:1746129817.290096:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971328 00000100:00100000:0.0:1746129817.290105:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971200 00000100:00100000:0.0:1746129817.290106:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971200 00000100:00100000:0.0:1746129817.290114:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971712 00000100:00100000:0.0:1746129817.290115:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971712 00000100:00100000:0.0:1746129817.290122:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053970944 00000100:00100000:0.0:1746129817.290123:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053970944 00000100:00100000:0.0:1746129817.290129:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971456 00000100:00100000:0.0:1746129817.290130:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971456 00000100:00100000:0.0:1746129817.290135:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971072 00000100:00100000:0.0:1746129817.290136:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971072 00000100:00100000:0.0:1746129817.290140:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971584 00000100:00100000:0.0:1746129817.290141:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971584 00000100:00100000:0.0:1746129817.290147:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15092 00000100:00100000:0.0:1746129817.290152:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053970816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290315:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053970816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (432us total) trans 21474841237 rc 0/0 00000100:00100000:0.0:1746129817.290320:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15092 00000100:00100000:0.0:1746129817.290330:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15093 00000100:00100000:0.0:1746129817.290334:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053971328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290396:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053971328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (476us total) trans 21474841238 rc 0/0 00000100:00100000:0.0:1746129817.290401:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15093 00000100:00100000:0.0:1746129817.290408:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15094 00000100:00100000:0.0:1746129817.290411:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053971200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290463:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053971200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (515us total) trans 21474841239 rc 0/0 00000100:00100000:0.0:1746129817.290467:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15094 00000100:00100000:0.0:1746129817.290474:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15095 00000100:00100000:0.0:1746129817.290477:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949053971712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290543:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053971712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (576us total) trans 21474841240 rc 0/0 00000100:00100000:0.0:1746129817.290547:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15095 00000100:00100000:0.0:1746129817.290554:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15096 00000100:00100000:0.0:1746129817.290557:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053970944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290618:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053970944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (626us total) trans 21474841241 rc 0/0 00000100:00100000:0.0:1746129817.290621:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15096 00000100:00100000:0.0:1746129817.290628:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15097 00000100:00100000:0.0:1746129817.290631:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053971456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290682:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053971456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (673us total) trans 21474841242 rc 0/0 00000100:00100000:0.0:1746129817.290686:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15097 00000100:00100000:0.0:1746129817.290692:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15098 00000100:00100000:0.0:1746129817.290695:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053971072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290749:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053971072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (719us total) trans 21474841243 rc 0/0 00000100:00100000:0.0:1746129817.290753:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15098 00000100:00100000:0.0:1746129817.290759:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15099 00000100:00100000:0.0:1746129817.290762:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949053971584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129817.290808:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129817.290811:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129817.290812:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129817.290814:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129817.290816:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129817.290831:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3298:x1830949053971584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (782us total) trans 21474841244 rc 0/0 00000100:00100000:0.0:1746129817.290836:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15099 00000004:00080000:0.0:1746129817.290893:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d880/2, rc 0, transno 21474841243 00000100:00100000:0.0:1746129817.290901:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053971072:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129817.290908:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38a80/2, rc 0, transno 21474841244 00000100:00100000:0.0:1746129817.290910:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053971584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129817.290916:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d180/2, rc 0, transno 21474841241 00000100:00100000:0.0:1746129817.290918:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053970944:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129817.290923:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5491500/2, rc 0, transno 21474841242 00000100:00100000:0.0:1746129817.290925:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053971456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290951:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.290968:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129817.290981:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c041c00/2, rc 0, transno 21474841239 00000100:00100000:0.0:1746129817.290984:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971200:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129817.290989:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39180/2, rc 0, transno 21474841240 00000100:00100000:0.0:1746129817.290991:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129817.290996:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284fb80/2, rc 0, transno 21474841237 00000100:00100000:0.0:1746129817.290999:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053970816:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129817.291004:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c043100/2, rc 0, transno 21474841238 00000100:00100000:0.0:1746129817.291006:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.291017:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971840 00000100:00100000:0.0:1746129817.291019:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971840 00000100:00100000:0.0:1746129817.291031:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15100 00000100:00100000:0.0:1746129817.291035:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949053971840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.291104:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949053971840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (135us total) trans 21474841245 rc 0/0 00000100:00100000:0.0:1746129817.291109:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15100 00000004:00080000:0.0:1746129817.291124:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130506680/2, rc 0, transno 21474841245 00000100:00100000:0.0:1746129817.291127:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053971840:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129817.291452:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.291461:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.291467:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.291473:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093befe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.291476:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.291482:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.291497:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.291499:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129817.291503:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.291508:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e4395411e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00080000:3.0:1746129817.291606:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129817.291692:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.291717:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.291729:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.291741:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.291750:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129817.291753:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.291763:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.291770:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.291779:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.291792:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972224 00000100:00100000:2.0:1746129817.291795:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972224 00000100:00100000:2.0:1746129817.291812:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972736 00000100:00100000:2.0:1746129817.291814:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972736 00000100:00100000:2.0:1746129817.291821:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972352 00000100:00100000:2.0:1746129817.291822:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972352 00000100:00100000:2.0:1746129817.291828:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972864 00000100:00100000:2.0:1746129817.291829:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972864 00000100:00100000:2.0:1746129817.291836:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15101 00000100:00100000:2.0:1746129817.291840:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053972224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.291957:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3296:x1830949053972224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (239us total) trans 17179874048 rc 0/0 00000100:00100000:2.0:1746129817.291961:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15101 00000100:00100000:2.0:1746129817.291971:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15102 00000100:00100000:2.0:1746129817.291974:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053972736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.292035:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3296:x1830949053972736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (293us total) trans 17179874049 rc 0/0 00000100:00100000:2.0:1746129817.292040:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15102 00000100:00100000:2.0:1746129817.292047:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15103 00000100:00100000:2.0:1746129817.292051:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053972352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.292108:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3296:x1830949053972352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (344us total) trans 17179874050 rc 0/0 00000100:00100000:2.0:1746129817.292113:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15103 00000100:00100000:2.0:1746129817.292121:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15104 00000100:00100000:2.0:1746129817.292124:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949053972864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.292207:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3296:x1830949053972864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (426us total) trans 17179874051 rc 0/0 00000100:00100000:2.0:1746129817.292213:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15104 00000004:00080000:2.0:1746129817.292240:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf4380/2, rc 0, transno 17179874050 00000100:00100000:2.0:1746129817.292243:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129817.292249:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf6d80/2, rc 0, transno 17179874051 00000100:00100000:2.0:1746129817.292251:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972864:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129817.292255:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf6300/2, rc 0, transno 17179874048 00000100:00100000:2.0:1746129817.292258:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129817.292263:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf6a00/2, rc 0, transno 17179874049 00000100:00100000:2.0:1746129817.292265:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053972736:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746129817.292393:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129817.292509:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053972096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.292533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.292560:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053972608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.292569:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972096 00000100:00100000:1.0:1746129817.292572:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972096 00000100:00100000:0.0:1746129817.292575:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.292587:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746129817.292588:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972608 00000100:00100000:1.0:1746129817.292590:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972608 00000100:00100000:0.0:1746129817.292591:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053971968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.292599:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15105 00000100:00100000:0.0:1746129817.292602:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.292603:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3299:x1830949053972096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.292610:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053972480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.292621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.292634:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053971968 00000100:00100000:0.0:1746129817.292636:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053971968 00000100:00100000:0.0:1746129817.292648:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053972480 00000100:00100000:0.0:1746129817.292650:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053972480 00000100:00100000:0.0:1746129817.292659:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15106 00000100:00100000:0.0:1746129817.292663:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949053972608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.292685:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949053972096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (151us total) trans 17179874052 rc 0/0 00000100:00100000:1.0:1746129817.292690:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15105 00000100:00100000:1.0:1746129817.292699:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15107 00000100:00100000:1.0:1746129817.292702:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3299:x1830949053971968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.292739:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949053972608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (162us total) trans 17179874053 rc 0/0 00000100:00100000:0.0:1746129817.292745:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15106 00000100:00100000:0.0:1746129817.292754:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15108 00000100:00100000:0.0:1746129817.292758:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949053972480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.292767:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949053971968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (164us total) trans 17179874054 rc 0/0 00000100:00100000:1.0:1746129817.292772:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15107 00000004:00080000:1.0:1746129817.292788:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf5880/2, rc 0, transno 17179874054 00000100:00100000:1.0:1746129817.292791:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053971968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129817.292796:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf4a80/2, rc 0, transno 17179874052 00000100:00100000:1.0:1746129817.292799:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053972096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129817.292803:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf7800/2, rc 0, transno 17179874053 00000100:00100000:1.0:1746129817.292805:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053972608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.292819:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949053972480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (197us total) trans 17179874055 rc 0/0 00000100:00100000:0.0:1746129817.292824:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15108 00000004:00080000:1.0:1746129817.292828:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faf5c00/2, rc 0, transno 17179874055 00000100:00100000:1.0:1746129817.292830:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053972480:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.294213:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.294271:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212096 00000100:00100000:1.0:1746129817.294275:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212096 00000100:00100000:1.0:1746129817.294436:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10937 00000100:00100000:1.0:1746129817.294443:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31414:x1830949054212096:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.294457:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.294470:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35560c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.294509:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.294520:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.294533:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129817.294536:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129817.294539:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef800, rc 0) 00000100:00100000:1.0:1746129817.295225:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054212096:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 780us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.295230:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10937 00000100:00100000:0.0:1746129817.297927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.297981:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212224 00000100:00100000:1.0:1746129817.297988:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212224 00000100:00100000:1.0:1746129817.298033:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10938 00000100:00100000:1.0:1746129817.298040:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054212224:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.298055:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.298069:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee800/0x48868a4e4395412c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355613 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.298136:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954133 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129817.298145:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954133 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129817.298153:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954133 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129817.298173:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 16777217 00000004:00200000:1.0:1746129817.298176:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129817.298199:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954133 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129817.298218:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee800/0x48868a4e4395412c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355613 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.298229:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954133 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355613 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.298240:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:1.0:1746129817.298242:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129817.298245:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093beec00, rc 0) 00000100:00100000:1.0:1746129817.298291:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054212224:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 252us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.298296:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10938 00000100:00100000:3.0:1746129817.304716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.304733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.304741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.304748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.304756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.304760:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212352 00000100:00100000:2.0:1746129817.304768:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212352 00000100:00100000:2.0:1746129817.304796:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212480 00000100:00100000:2.0:1746129817.304797:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212480 00000100:00100000:2.0:1746129817.304805:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212736 00000100:00100000:2.0:1746129817.304806:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212736 00000100:00100000:3.0:1746129817.304813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.304823:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212992 00000100:00100000:3.0:1746129817.304825:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212608 00000100:00100000:2.0:1746129817.304825:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212992 00000100:00100000:3.0:1746129817.304828:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212608 00000100:00100000:2.0:1746129817.304834:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054212864 00000100:00100000:2.0:1746129817.304835:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054212864 00000100:00100000:3.0:1746129817.304843:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15109 00000100:00100000:2.0:1746129817.304859:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15110 00000100:00100000:3.0:1746129817.304860:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054212352:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:2.0:1746129817.304865:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054212480:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129817.304872:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.304872:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.304883:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35561a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.304884:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355621 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129817.304899:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d393, atime: 0x6813d391, ctime: 0x6813d393, blocks: 0x7e7 00002000:00010000:2.0:1746129817.304899:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d397, atime: 0x6813d397, ctime: 0x6813d397, blocks: 0x821 00010000:00010000:3.0:1746129817.304910:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.304910:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.304911:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.304912:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.304917:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.304917:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.304929:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.304930:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.304936:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335000, rc 0) 00010000:00010000:2.0:1746129817.304936:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af200, rc 0) 00000100:00100000:3.0:1746129817.304965:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054212352:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 118us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.304969:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15109 00000100:00100000:2.0:1746129817.304970:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054212480:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 106us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.304975:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15110 00000100:00100000:3.0:1746129817.304981:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15111 00000100:00100000:3.0:1746129817.304983:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054212736:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129817.304986:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129817.304986:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15112 00000100:00100000:2.0:1746129817.304990:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054212992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129817.304991:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35562f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.304995:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746129817.304998:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d395, atime: 0x6813d395, ctime: 0x6813d395, blocks: 0x821 00010000:00010000:2.0:1746129817.305001:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35563d expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.305002:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.305003:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.305005:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.305010:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746129817.305010:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d399, atime: 0x6813d396, ctime: 0x6813d399, blocks: 0x1029 00010000:00010000:3.0:1746129817.305014:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb58a00, rc 0) 00010000:00010000:2.0:1746129817.305016:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.305018:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.305021:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129817.305022:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054212736:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 38us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.305027:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15111 00010000:00010000:2.0:1746129817.305028:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129817.305033:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15113 00000100:00100000:3.0:1746129817.305035:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054212608:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129817.305035:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4aec00, rc 0) 00010000:00010000:3.0:1746129817.305038:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.305043:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355628 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.305048:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054212992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 58us (298us total) trans 0 rc 0/0 00002000:00010000:3.0:1746129817.305049:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d397, atime: 0x6813d397, ctime: 0x6813d397, blocks: 0x821 00010000:00010000:3.0:1746129817.305054:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129817.305055:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15112 00010000:00010000:3.0:1746129817.305056:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.305059:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129817.305065:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15114 00010000:00010000:3.0:1746129817.305067:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129817.305069:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054212864:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129817.305073:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eb58600, rc 0) 00010000:00010000:2.0:1746129817.305074:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.305082:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355636 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.305087:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054212608:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 50us (329us total) trans 0 rc 0/0 00002000:00010000:2.0:1746129817.305090:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d399, atime: 0x6813d399, ctime: 0x6813d399, blocks: 0x15e5 00000100:00100000:3.0:1746129817.305092:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15113 00010000:00010000:2.0:1746129817.305096:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.305097:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.305101:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.305108:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.305114:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af800, rc 0) 00000100:00100000:2.0:1746129817.305126:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054212864:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 57us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.305130:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15114 00000100:00100000:0.0:1746129817.311540:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.311609:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.311670:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054213376 00000100:00100000:2.0:1746129817.311677:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054213376 00000100:00100000:3.0:1746129817.311689:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054213504 00000100:00100000:3.0:1746129817.311693:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054213504 00000100:00100000:2.0:1746129817.311722:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6724 00000100:00100000:2.0:1746129817.311729:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054213376:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:3.0:1746129817.311740:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6725 00000100:00100000:3.0:1746129817.311746:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054213504:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129817.311754:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.311763:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.311767:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.311769:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.311771:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.311772:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.311773:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.311775:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.311783:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.311783:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.312963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.313000:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054213760 00000100:00100000:0.0:1746129817.313001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.313004:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054213760 00000100:00100000:1.0:1746129817.313026:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054214016 00000100:00100000:1.0:1746129817.313027:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054214016 00000100:00100000:1.0:1746129817.313039:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6726 00000100:00100000:1.0:1746129817.313044:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054213760:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:0.0:1746129817.313044:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6727 00000100:00100000:0.0:1746129817.313051:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054214016:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129817.313058:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.313066:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.313067:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.313067:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.313070:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.313075:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.313076:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.313077:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.313079:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.313087:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.316228:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.316382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.317417:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054214272 00000100:00100000:1.0:1746129817.317426:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054214272 00000100:00100000:1.0:1746129817.317467:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054214528 00000100:00100000:1.0:1746129817.317470:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054214528 00000100:00100000:1.0:1746129817.317502:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6728 00000100:00100000:1.0:1746129817.317509:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054214272:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129817.317535:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.317547:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.317548:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.317552:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.317562:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.318328:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6729 00000100:00100000:2.0:1746129817.318337:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013061f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054214528:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129817.318355:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.318365:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.318366:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.318369:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.318376:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.319510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.319532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.319557:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054214784 00000100:00100000:1.0:1746129817.319561:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054214784 00000100:00100000:1.0:1746129817.319608:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215040 00000100:00100000:1.0:1746129817.319611:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215040 00000100:00100000:1.0:1746129817.319627:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6730 00000100:00100000:1.0:1746129817.319633:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054214784:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:2.0:1746129817.319634:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6731 00000100:00100000:2.0:1746129817.319641:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054215040:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129817.319653:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.319658:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.319662:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.319663:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.319666:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.319667:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.319668:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.319670:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.319676:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.319678:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327025:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327038:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327045:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327051:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eca6000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129817.327055:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327061:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327076:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.327082:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6000/0x48868a4e43954179 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327095:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327105:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327111:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327117:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4afe00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129817.327119:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327125:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327135:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.327145:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4afe00/0x48868a4e43954164 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.327157:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054214016:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 14102us (14151us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.327167:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6727 00000100:00100000:3.0:1746129817.327176:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054213376:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 15448us (15642us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.327183:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6724 00010000:00010000:1.0:1746129817.332629:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.332647:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.332654:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.332660:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129817.332664:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.332670:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.334840:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.334884:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954172 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.334982:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054213760:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 21934us (22018us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.334992:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6726 00010000:00010000:3.0:1746129817.338295:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.338309:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.338315:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.338321:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013094ba00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129817.338325:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.338332:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.338348:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.338353:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013094ba00/0x48868a4e4395416b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.338424:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054213504:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 26674us (26811us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.338432:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6725 00010000:00010000:2.0:1746129817.344412:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.344428:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.344434:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.344440:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4aee00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129817.344443:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.344450:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.344465:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.344470:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4aee00/0x48868a4e43954187 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.345183:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013061f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054214528:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 26843us (28797us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.345203:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6729 00010000:00010000:0.0:1746129817.345474:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.345482:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.345488:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.345494:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093befe00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129817.345496:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.345503:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.345513:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.345518:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e43954180 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.345577:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054214272:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 28068us (29354us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129817.345582:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6728 00010000:00010000:2.0:1746129817.348636:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.348648:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.348653:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.348657:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4ae400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129817.348659:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.348664:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.348674:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.348678:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4ae400/0x48868a4e43954195 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.348724:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054215040:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 29081us (29186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.348730:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6731 00010000:00010000:1.0:1746129817.353628:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.353644:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.353652:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.353658:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1ee00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129817.353661:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.353668:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.353687:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.353692:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395418e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.354955:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054214784:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 35314us (35439us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.354967:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6730 00000100:00100000:0.0:1746129817.360511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.360604:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215296 00000100:00100000:2.0:1746129817.360612:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215296 00000100:00100000:2.0:1746129817.360991:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10939 00000100:00100000:2.0:1746129817.360999:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054215296:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129817.361046:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.361069:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954133 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355613 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.361085:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:2.0:1746129817.361090:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129817.361120:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.361131:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.361140:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00010000:2.0:1746129817.361313:0:14313:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a01bb800 reply state ffff88009cb5d000 transno 8589944922 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129817.361603:0:14313:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129817.362216:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31414:x1830949054215296:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 1215us (1710us total) trans 8589944922 rc 0/0 00000100:00100000:2.0:1746129817.362222:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10939 00000100:00100000:0.0:1746129817.364148:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129817.364151:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.364161:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.364168:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.364173:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bef000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.364176:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.364182:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.364203:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.364206:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.364210:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.364214:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395419c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129817.364549:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215424 00000100:00100000:1.0:1746129817.364557:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215424 00000100:00100000:1.0:1746129817.364599:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15115 00000100:00100000:1.0:1746129817.364606:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054215424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.364622:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.364635:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355644 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.364663:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.364670:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.364672:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.364675:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.364699:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.364708:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.364717:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053972992:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.364801:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.366045:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053972992:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.366068:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.366079:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd52e00, rc 0) 00000100:00100000:1.0:1746129817.366120:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054215424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1513us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.366129:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15115 00000100:00100000:0.0:1746129817.367047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.367105:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215552 00000100:00100000:2.0:1746129817.367110:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215552 00010000:00010000:2.0:1746129817.367130:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:2.0:1746129817.367147:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7531 00000100:00100000:2.0:1746129817.367152:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054215552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.367161:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.367179:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.367198:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.367215:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094335000/0x48868a4e43954141 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35561a expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.367225:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.367226:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.367231:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.367237:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.367258:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.367266:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053973120:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.367316:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.370487:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.370730:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053973120:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.370745:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.370781:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054215552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3627us (3735us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.370789:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7531 00000100:00100000:1.0:1746129817.371171:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215680 00000100:00100000:1.0:1746129817.371177:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215680 00000100:00100000:1.0:1746129817.371216:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15116 00000100:00100000:1.0:1746129817.371221:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054215680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.371233:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.371246:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35564b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.371365:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.371372:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.371373:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.371376:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.371400:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.371409:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.371420:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053973248:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.371489:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.373168:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053973248:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.373202:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.373214:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd53e00, rc 0) 00000100:00100000:1.0:1746129817.373241:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054215680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2019us (2760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.373248:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15116 00000100:00100000:0.0:1746129817.373700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.373779:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215808 00000100:00100000:3.0:1746129817.373786:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215808 00010000:00010000:3.0:1746129817.373806:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.373844:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7532 00000100:00100000:3.0:1746129817.373917:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054215808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.373928:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.373948:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.373957:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.373974:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af200/0x48868a4e4395413a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355621 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.373999:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.374001:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.374007:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.374014:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.374034:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.374043:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053973376:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.374099:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.375298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.375338:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054215936 00000100:00100000:1.0:1746129817.375343:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054215936 00000100:00100000:3.0:1746129817.375379:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053973376:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.375389:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.375423:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054215808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1509us (1723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.375429:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7532 00000100:00100000:1.0:1746129817.375586:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15117 00000100:00100000:1.0:1746129817.375594:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054215936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.375605:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.375615:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355652 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.375634:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.375640:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.375642:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.375645:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.375661:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.375670:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.375679:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053973504:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.375728:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.378401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.378476:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216064 00000100:00100000:3.0:1746129817.378483:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216064 00010000:00010000:3.0:1746129817.378505:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 10 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.378525:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7533 00000100:00100000:3.0:1746129817.378534:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054216064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.378544:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.378560:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 10 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.378570:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 10 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.378587:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.378588:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.378593:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.378599:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.378623:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.378631:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053973632:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.378684:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26000 going to sleep for 11 seconds 00010000:00010000:1.0:1746129817.378750:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012eb58600/0x48868a4e43954156 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355628 expref: 10 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.378763:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053973504:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.378780:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.378787:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd52800, rc 0) 00000100:00100000:1.0:1746129817.379068:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054215936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3212us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.379076:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15117 00000100:00100000:0.0:1746129817.380654:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.380880:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053973632:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.380893:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.380919:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054216064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2388us (2523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.380926:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7533 00000100:00100000:1.0:1746129817.380973:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216192 00000100:00100000:1.0:1746129817.380979:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216192 00000100:00100000:1.0:1746129817.381017:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15118 00000100:00100000:1.0:1746129817.381025:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054216192:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.381037:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.381050:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355659 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.381070:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.381081:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.381083:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.381086:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.381105:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.381115:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.381124:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053973760:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.381169:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.385233:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053973760:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.385260:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.385340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129817.385407:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd53200, rc 0) 00000100:00100000:1.0:1746129817.385448:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054216192:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4423us (4797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.385456:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15118 00000100:00100000:3.0:1746129817.385597:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216320 00000100:00100000:3.0:1746129817.385602:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216320 00010000:00010000:3.0:1746129817.385624:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.385654:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7534 00000100:00100000:3.0:1746129817.385660:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054216320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.385670:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.385686:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.385695:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.385718:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eb58a00/0x48868a4e43954148 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35562f expref: 9 pid: 4589 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.385743:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.385744:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.385751:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.385758:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.385783:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.385792:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053973888:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.386090:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.388373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.388453:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216448 00000100:00100000:1.0:1746129817.388458:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216448 00000100:00100000:1.0:1746129817.388503:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15119 00000100:00100000:1.0:1746129817.388510:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054216448:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.388523:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.388536:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355660 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.388607:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053973888:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.388620:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.388649:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054216320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2988us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.388656:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7534 00010000:00010000:1.0:1746129817.388899:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.388907:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.388908:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.388911:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.388934:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.388944:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.388953:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053974016:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.389006:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.391450:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053974016:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.391477:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.391491:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd52200, rc 0) 00000100:00100000:1.0:1746129817.391532:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054216448:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3022us (3164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.391540:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15119 00000100:00100000:0.0:1746129817.392739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.393721:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216576 00000100:00100000:3.0:1746129817.393727:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216576 00010000:00010000:3.0:1746129817.393762:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.393801:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7535 00000100:00100000:3.0:1746129817.393808:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054216576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.393819:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.393836:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.393870:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.393890:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4af800/0x48868a4e4395415d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355636 expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.393959:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.393961:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.393967:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.393974:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.394045:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.394054:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053974144:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.394126:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.395352:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053974144:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.395363:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.395364:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.395508:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054216576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1698us (2770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.395516:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7535 00000100:00100000:1.0:1746129817.395606:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216704 00000100:00100000:1.0:1746129817.395612:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216704 00000100:00100000:1.0:1746129817.395646:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15120 00000100:00100000:1.0:1746129817.395757:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054216704:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129817.395770:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.395782:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355667 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.395799:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.395808:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.395810:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.395813:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.395831:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.395841:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746129817.395868:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053974272:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.395926:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129dbf000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.397179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.397201:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949053974272:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.397225:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.397238:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd53800, rc 0) 00000100:00100000:1.0:1746129817.397276:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054216704:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1623us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.397283:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15120 00000100:00100000:3.0:1746129817.397327:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216832 00000100:00100000:3.0:1746129817.397332:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216832 00010000:00010000:3.0:1746129817.397347:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.397375:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7536 00000100:00100000:3.0:1746129817.397381:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054216832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.397558:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.397576:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.397587:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.397603:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4aec00/0x48868a4e4395414f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35563d expref: 9 pid: 1877 timeout: 863 lvb_type: 1 00010000:00010000:3.0:1746129817.397613:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.397615:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.397620:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.397632:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.397654:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.397662:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053974400:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.397726:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.399466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.399770:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054216960 00000100:00100000:1.0:1746129817.399774:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054216960 00000100:00100000:3.0:1746129817.399782:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949053974400:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.399794:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129817.399815:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15121 00000100:00100000:3.0:1746129817.399820:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054216832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2439us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.399821:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054216960:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:3.0:1746129817.399827:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7536 00000100:00100000:0.0:1746129817.400264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.400278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.400289:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217216 00000100:00100000:0.0:1746129817.400289:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.400292:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217216 00000100:00100000:0.0:1746129817.400301:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217472 00000100:00100000:0.0:1746129817.400303:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217472 00000100:00100000:2.0:1746129817.400308:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217088 00000100:00100000:2.0:1746129817.400310:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217088 00000100:00100000:0.0:1746129817.400317:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15122 00000100:00100000:0.0:1746129817.400322:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054217216:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129817.400496:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15123 00002000:00010000:0.0:1746129817.400497:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129817.400500:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129815 -> 1746129817 00000100:00100000:2.0:1746129817.400502:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054217472:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129817.400502:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129815 -> 1746129817 00002000:00010000:0.0:1746129817.400504:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129815 -> 1746129818 00002000:00010000:0.0:1746129817.400505:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129817.400515:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15124 00000100:00100000:2.0:1746129817.400519:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054217088:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:0.0:1746129817.400526:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054217216:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 204us (263us total) trans 17179874056 rc 0/0 00000100:00100000:0.0:1746129817.400534:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15122 00000100:00100000:0.0:1746129817.400559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.400569:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217344 00000100:00100000:0.0:1746129817.400571:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217344 00002000:00010000:2.0:1746129817.400583:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746129817.400583:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15125 00002000:00010000:2.0:1746129817.400585:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129815 -> 1746129817 00002000:00010000:2.0:1746129817.400587:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129815 -> 1746129817 00000100:00100000:0.0:1746129817.400587:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054217344:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129817.400589:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129815 -> 1746129818 00002000:00010000:2.0:1746129817.400590:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129817.400606:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054217088:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 86us (316us total) trans 17179874057 rc 0/0 00000100:00100000:2.0:1746129817.400611:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15124 00000100:00100000:0.0:1746129817.400646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:1.0:1746129817.400782:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129817.400785:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129811 -> 1746129817 00002000:00010000:1.0:1746129817.400786:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129809 -> 1746129817 00002000:00010000:1.0:1746129817.400788:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129811 -> 1746129818 00002000:00010000:1.0:1746129817.400790:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746129817.400809:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054216960:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 988us (1348us total) trans 21474841246 rc 0/0 00000100:00100000:1.0:1746129817.400814:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15121 00000100:00100000:1.0:1746129817.400823:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217600 00000100:00100000:1.0:1746129817.400825:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217600 00000100:00100000:1.0:1746129817.400836:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15126 00000100:00100000:1.0:1746129817.400840:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054217600:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129817.400915:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129817.400917:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.400920:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129814 -> 1746129817 00002000:00010000:1.0:1746129817.400922:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129817 -> 1746129818 00002000:00010000:1.0:1746129817.400923:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129817.400939:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054217600:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 98us (293us total) trans 17179874058 rc 0/0 00000100:00100000:1.0:1746129817.400944:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15126 00002000:00010000:3.0:1746129817.401439:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:3.0:1746129817.401442:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:3.0:1746129817.401444:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:3.0:1746129817.401445:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129817 -> 1746129818 00002000:00010000:3.0:1746129817.401447:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:3.0:1746129817.401477:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054217472:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 975us (1197us total) trans 21474841247 rc 0/0 00000100:00100000:3.0:1746129817.401483:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15123 00002000:00010000:0.0:1746129817.401499:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129817.401501:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129813 -> 1746129817 00002000:00010000:0.0:1746129817.401503:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129813 -> 1746129817 00002000:00010000:0.0:1746129817.401504:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129813 -> 1746129818 00002000:00010000:0.0:1746129817.401506:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129817.401521:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054217344:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 933us (961us total) trans 21474841248 rc 0/0 00000100:00100000:0.0:1746129817.401526:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15125 00000100:00100000:0.0:1746129817.403951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.404556:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217856 00000100:00100000:3.0:1746129817.404563:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217856 00000100:00100000:3.0:1746129817.404610:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4549 00000100:00100000:3.0:1746129817.404617:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054217856:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:3.0:1746129817.404661:0:14316:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6400/0x48868a4e439540e6 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355605 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.404699:0:14316:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.404708:0:14316:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.404714:0:14316:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.404737:0:14316:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.404746:0:14316:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 9 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.404756:0:14316:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949053974528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.404891:0:14316:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.407285:0:14316:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949053974528:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.407304:0:14316:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129817.407543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.407609:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054217984 00000100:00100000:3.0:1746129817.407615:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054217984 00010000:00010000:3.0:1746129817.407637:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.408235:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7537 00000100:00100000:3.0:1746129817.408243:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054217984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.408254:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.408259:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.408269:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.408285:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43954125 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35560c expref: 10 pid: 14315 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.408303:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.408307:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.408314:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.408320:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.408583:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.408616:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054217984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 374us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.408622:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7537 00010000:00010000:2.0:1746129817.408986:0:14316:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129817.408994:0:14316:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000040:00080000:0.0:1746129817.409987:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3469, 88 off292000 00000004:00080000:0.0:1746129817.409994:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468145123ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410042:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3480, 88 off292880 00000004:00080000:0.0:1746129817.410046:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468197667ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410065:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3481, 88 off292968 00000004:00080000:0.0:1746129817.410068:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468220313ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410075:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3470, 88 off292088 00000004:00080000:0.0:1746129817.410078:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468229739ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410084:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3471, 88 off292176 00000004:00080000:0.0:1746129817.410088:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468240145ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410094:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3482, 88 off293056 00000004:00080000:0.0:1746129817.410096:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468248555ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410103:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3483, 88 off293144 00000004:00080000:0.0:1746129817.410105:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468256987ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410111:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3484, 88 off293232 00000004:00080000:0.0:1746129817.410113:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468265550ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410120:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3472, 88 off292264 00000004:00080000:0.0:1746129817.410122:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468274265ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410150:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3485, 88 off293320 00000004:00080000:0.0:1746129817.410153:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468304835ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410269:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3473, 88 off292352 00000004:00080000:0.0:1746129817.410273:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468424682ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410423:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3486, 88 off293408 00000004:00080000:0.0:1746129817.410427:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468579427ns, next at 716792379979ns, rc = 0 00000040:00080000:0.0:1746129817.410438:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3474, 88 off292440 00000004:00080000:0.0:1746129817.410440:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468592012ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410446:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3475, 88 off292528 00000004:00080000:0.0:1746129817.410448:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468600399ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410454:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3476, 88 off292616 00000004:00080000:0.0:1746129817.410456:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468608569ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410462:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3477, 88 off292704 00000004:00080000:0.0:1746129817.410464:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763468616465ns, next at 731767308185ns, rc = 0 00000040:00080000:0.0:1746129817.410470:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3487, 88 off293496 00000004:00080000:0.0:1746129817.410472:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763468624562ns, next at 716792379979ns, rc = 0 00000004:00010000:0.0:1746129817.435012:0:14316:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c560050 reply state ffff88009a1a4c00 transno 8589944923 ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129817.435031:0:14316:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746129817.435041:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:0.0:1746129817.435044:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129817.435052:0:14316:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca6400/0x48868a4e439540e6 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355605 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.435165:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31414:x1830949054217856:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 30547us (31219us total) trans 8589944923 rc 0/0 00000100:00100000:0.0:1746129817.435173:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4549 00000001:00080000:0.0:1746129817.435257:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944923 is committed 00000004:00080000:0.0:1746129817.435262:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2655 committed 00000004:00080000:0.0:1746129817.435268:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2650 committed 00010000:00010000:3.0:1746129817.435269:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00000004:00080000:0.0:1746129817.435273:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2649 committed 00000004:00080000:0.0:1746129817.435275:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2648 committed 00000004:00080000:0.0:1746129817.435276:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2647 committed 00000004:00080000:0.0:1746129817.435277:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2654 committed 00000004:00080000:0.0:1746129817.435278:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2646 committed 00010000:00010000:3.0:1746129817.435280:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 00000004:00080000:0.0:1746129817.435280:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2653 committed 00000004:00080000:0.0:1746129817.435281:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2645 committed 00000004:00080000:0.0:1746129817.435282:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2652 committed 00000004:00080000:0.0:1746129817.435283:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2651 committed 00000004:00080000:0.0:1746129817.435284:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2650 committed 00010000:00010000:3.0:1746129817.435286:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00000004:00080000:0.0:1746129817.435286:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2644 committed 00000004:00080000:0.0:1746129817.435287:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2643 committed 00000004:00080000:0.0:1746129817.435288:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2649 committed 00000004:00080000:0.0:1746129817.435290:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2648 committed 00010000:00010000:3.0:1746129817.435291:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013094ac00 already unused, calling callback (ffffffffa1371690) 00000004:00080000:0.0:1746129817.435291:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2642 committed 00010000:00010000:3.0:1746129817.435294:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.435300:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.435394:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88012e29a500) 00010000:00010000:3.0:1746129817.435396:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129817.435399:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129817.435403:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013094ac00/0x48868a4e439541cd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129817.435413:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053974912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.435446:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.435467:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.435481:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.435494:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.435506:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.435515:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053976448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.435523:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053974656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.435524:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.435533:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129817.435537:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129817.435543:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053974912 00000100:00100000:1.0:1746129817.435548:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.435549:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053974912 00000100:00100000:0.0:1746129817.435558:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975424 00000100:00100000:0.0:1746129817.435560:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975424 00000100:00100000:1.0:1746129817.435565:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975168:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129817.435571:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975936 00000100:00100000:2.0:1746129817.435573:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975936 00000100:00100000:0.0:1746129817.435575:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976448 00000100:00100000:0.0:1746129817.435577:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976448 00000100:00100000:1.0:1746129817.435578:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.435585:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053974656 00000100:00100000:2.0:1746129817.435586:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053974656 00000100:00100000:1.0:1746129817.435590:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.435595:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975168 00000100:00100000:0.0:1746129817.435597:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975168 00000100:00100000:2.0:1746129817.435599:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15127 00000100:00100000:1.0:1746129817.435601:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129817.435604:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053974912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.435606:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975680 00000100:00100000:0.0:1746129817.435607:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975680 00000100:00100000:1.0:1746129817.435609:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053976192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.435615:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15128 00000100:00100000:0.0:1746129817.435619:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830949053975424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.435620:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.435627:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746129817.435631:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053974784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.435641:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.435647:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.435647:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976192 00000100:00100000:0.0:1746129817.435649:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976192 00000100:00100000:1.0:1746129817.435657:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.435658:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053974784 00000100:00100000:0.0:1746129817.435659:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053974784 00000100:00100000:1.0:1746129817.435662:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.435665:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975296 00000100:00100000:0.0:1746129817.435667:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975296 00000100:00100000:1.0:1746129817.435672:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.435674:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15129 00000100:00100000:0.0:1746129817.435677:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3296:x1830949053975936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.435678:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053976320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129817.435687:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.435702:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975808 00000100:00100000:1.0:1746129817.435705:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975808 00000100:00100000:1.0:1746129817.435716:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976320 00000100:00100000:1.0:1746129817.435718:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976320 00000100:00100000:1.0:1746129817.435724:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15130 00000100:00100000:1.0:1746129817.435728:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3296:x1830949053976448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129817.435740:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:2.0:1746129817.435743:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:2.0:1746129817.435745:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:2.0:1746129817.435746:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:2.0:1746129817.435748:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:2.0:1746129817.435768:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053974912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (322us total) trans 21474841249 rc 0/0 00000100:00100000:2.0:1746129817.435773:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15127 00000100:00100000:2.0:1746129817.435783:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15131 00000100:00100000:2.0:1746129817.435787:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053974656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.435815:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053976448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (289us total) trans 17179874059 rc 0/0 00000100:00100000:1.0:1746129817.435819:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15130 00000100:00100000:1.0:1746129817.435828:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15132 00000100:00100000:1.0:1746129817.435832:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053975168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129817.435845:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129817.435863:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:2.0:1746129817.435865:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:2.0:1746129817.435866:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:2.0:1746129817.435868:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746129817.435887:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3298:x1830949053974656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (338us total) trans 21474841250 rc 0/0 00000100:00100000:2.0:1746129817.435891:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15131 00000100:00100000:2.0:1746129817.435899:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15133 00000100:00100000:2.0:1746129817.435903:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053975680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129817.435913:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129817.435916:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00000100:00100000:1.0:1746129817.435918:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3298:x1830949053975168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (339us total) trans 21474841251 rc 0/0 00002000:00010000:0.0:1746129817.435918:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.435920:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:0.0:1746129817.435921:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129817.435923:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15132 00000100:00100000:1.0:1746129817.435931:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15134 00000100:00100000:1.0:1746129817.435935:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3298:x1830949053976192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.435940:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3296:x1830949053975936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 262us (432us total) trans 17179874060 rc 0/0 00000100:00100000:0.0:1746129817.435945:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15129 00000100:00100000:0.0:1746129817.435955:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15135 00000100:00100000:0.0:1746129817.435959:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053974784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129817.435962:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129817.435964:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:2.0:1746129817.435966:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:2.0:1746129817.435968:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:2.0:1746129817.435970:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129817.435986:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053975680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (383us total) trans 17179874061 rc 0/0 00000100:00100000:2.0:1746129817.435990:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15133 00000100:00100000:1.0:1746129817.435992:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053976192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (372us total) trans 17179874062 rc 0/0 00000100:00100000:1.0:1746129817.435996:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15134 00000100:00100000:2.0:1746129817.436001:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15136 00000100:00100000:1.0:1746129817.436003:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15137 00000100:00100000:2.0:1746129817.436005:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949053975296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.436007:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053975808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.436033:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15138 00000100:00100000:2.0:1746129817.436037:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3298:x1830949053976320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129817.436045:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129817.436047:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.436049:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.436050:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:0.0:1746129817.436052:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746129817.436061:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129817.436063:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.436065:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.436067:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:1.0:1746129817.436069:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129817.436070:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+47:3298:x1830949053974784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (426us total) trans 21474841252 rc 0/0 00000100:00100000:0.0:1746129817.436074:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15135 00000100:00100000:1.0:1746129817.436085:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053975808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (412us total) trans 17179874063 rc 0/0 00000100:00100000:1.0:1746129817.436091:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15137 00000100:00100000:2.0:1746129817.436096:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3298:x1830949053976320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (408us total) trans 17179874064 rc 0/0 00000100:00100000:2.0:1746129817.436100:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15138 00000004:00080000:1.0:1746129817.436145:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645ca80/2, rc 0, transno 21474841252 00000100:00100000:1.0:1746129817.436153:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053974784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129817.436156:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3298:x1830949053975296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (498us total) trans 21474841253 rc 0/0 00000004:00080000:1.0:1746129817.436160:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f800/2, rc 0, transno 21474841253 00000100:00100000:2.0:1746129817.436161:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15136 00000100:00100000:1.0:1746129817.436162:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.436168:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061d180/2, rc 0, transno 17179874063 00002000:00010000:0.0:1746129817.436169:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746129817.436171:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975808:0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129817.436171:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129817.436172:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129817.436174:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129817.436175:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:1.0:1746129817.436176:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061c000/2, rc 0, transno 17179874064 00000100:00100000:1.0:1746129817.436179:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053976320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129817.436196:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645d180/2, rc 0, transno 21474841250 00000100:00100000:1.0:1746129817.436199:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053974656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.436205:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053975424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 585us (723us total) trans 21474841254 rc 0/0 00000004:00080000:1.0:1746129817.436206:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04df80/2, rc 0, transno 21474841251 00000100:00100000:1.0:1746129817.436209:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.436210:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15128 00000004:00080000:1.0:1746129817.436214:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061c380/2, rc 0, transno 17179874061 00000100:00100000:1.0:1746129817.436216:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053975680:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129817.436221:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061dc00/2, rc 0, transno 17179874062 00000100:00100000:1.0:1746129817.436223:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053976192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.436225:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129817.436239:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975040 00000100:00100000:3.0:1746129817.436242:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975040 00000100:00100000:0.0:1746129817.436242:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.436246:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746129817.436251:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053976704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129817.436255:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15139 00000100:00100000:0.0:1746129817.436257:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129817.436259:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+47:3296:x1830949053975040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.436269:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.436269:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053976064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.436281:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.436290:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053976576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.436300:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129817.436387:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061e680/2, rc 0, transno 17179874060 00000100:00100000:0.0:1746129817.436392:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129817.436396:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830949053975040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (169us total) trans 21474841255 rc 0/0 00000004:00080000:0.0:1746129817.436399:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284df80/2, rc 0, transno 17179874059 00000100:00100000:3.0:1746129817.436401:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15139 00000100:00100000:0.0:1746129817.436402:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053976448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.436408:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f100/2, rc 0, transno 21474841249 00000100:00100000:3.0:1746129817.436410:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053975552 00000100:00100000:0.0:1746129817.436410:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053974912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129817.436412:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053975552 00000004:00080000:0.0:1746129817.436416:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04ce00/2, rc 0, transno 21474841254 00000100:00100000:0.0:1746129817.436417:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129817.436422:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976704 00000004:00080000:0.0:1746129817.436422:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04c700/2, rc 0, transno 21474841255 00000100:00100000:0.0:1746129817.436423:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129817.436424:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976704 00000100:00100000:3.0:1746129817.436431:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976064 00000100:00100000:0.0:1746129817.436432:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053976576 00000100:00100000:3.0:1746129817.436433:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976064 00000100:00100000:0.0:1746129817.436433:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053976576 00000100:00100000:3.0:1746129817.436442:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15140 00000100:00100000:0.0:1746129817.436444:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15141 00000100:00100000:3.0:1746129817.436445:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949053975552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.436447:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3299:x1830949053976704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129817.436516:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3296:x1830949053975552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (258us total) trans 21474841256 rc 0/0 00000100:00100000:0.0:1746129817.436519:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3299:x1830949053976704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (249us total) trans 21474841257 rc 0/0 00000100:00100000:3.0:1746129817.436521:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15140 00000100:00100000:0.0:1746129817.436523:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15141 00000100:00100000:3.0:1746129817.436530:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15142 00000100:00100000:0.0:1746129817.436533:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15143 00000100:00100000:3.0:1746129817.436535:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053976064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.436536:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949053976576:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.436547:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04d880/2, rc 0, transno 21474841256 00000004:00080000:1.0:1746129817.436549:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5490a80/2, rc 0, transno 21474841257 00000100:00100000:0.0:1746129817.436549:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053975552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.436553:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053976704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.436671:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053976576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (370us total) trans 17179874066 rc 0/0 00000100:00100000:3.0:1746129817.436672:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949053976064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (388us total) trans 17179874065 rc 0/0 00000100:00100000:0.0:1746129817.436674:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15143 00000100:00100000:3.0:1746129817.436677:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15142 00000004:00080000:1.0:1746129817.436735:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013061ce00/2, rc 0, transno 17179874065 00000100:00100000:1.0:1746129817.436738:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013061ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053976064:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129817.436744:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f800/2, rc 0, transno 17179874066 00000100:00100000:1.0:1746129817.436745:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053976576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.437495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.437610:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054218112 00000100:00100000:2.0:1746129817.437614:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054218112 00000100:00100000:2.0:1746129817.437644:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10940 00000100:00100000:2.0:1746129817.437649:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31414:x1830949054218112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129817.437660:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.437673:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35566e expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.437711:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.437725:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.437738:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.437740:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129817.437742:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013186fe00, rc 0) 00000100:00100000:2.0:1746129817.437777:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31414:x1830949054218112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 128us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.437782:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10940 00000100:00100000:0.0:1746129817.439543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.439647:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054218368 00000100:00100000:2.0:1746129817.439653:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054218368 00000100:00100000:2.0:1746129817.439866:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4550 00000100:00100000:2.0:1746129817.439873:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31414:x1830949054218368:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129817.440066:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31414:x1830949054218368:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 192us (525us total) trans 8589944924 rc 0/0 00000100:00100000:2.0:1746129817.440072:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4550 00000100:00100000:0.0:1746129817.454410:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.454502:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054218624 00000100:00100000:2.0:1746129817.454510:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054218624 00000100:00100000:2.0:1746129817.455128:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10941 00000100:00100000:2.0:1746129817.455136:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31426:x1830949054218624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.455380:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.455395:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fc00/0x48868a4e439541db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355675 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.455541:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.455553:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.455561:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.455572:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.455577:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.455582:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456861:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456871:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456881:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129817.456889:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129817.456950:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456955:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456961:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456968:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bef600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.456971:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456976:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456985:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129817.456987:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.456990:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.456994:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439541e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457001:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457004:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457008:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457012:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.457014:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457018:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457023:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f581700) 00010000:00010000:2.0:1746129817.457025:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.457027:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457031:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e439541e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.457076:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fc00/0x48868a4e439541db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.457087:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.457093:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.457094:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129817.457096:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef800, rc 0) 00000100:00100000:2.0:1746129817.457149:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31426:x1830949054218624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2014us (2744us total) trans 8589944925 rc 0/0 00000100:00100000:2.0:1746129817.457156:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10941 00000100:00100000:0.0:1746129817.457386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.458177:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054218880 00000100:00100000:3.0:1746129817.458192:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054218880 00000100:00100000:3.0:1746129817.458221:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10942 00000100:00100000:3.0:1746129817.458226:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31421:x1830949054218880:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.458240:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.458248:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af200/0x48868a4e439541fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35567c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.458305:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458311:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458317:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458329:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458334:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458338:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458396:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458402:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458408:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129817.458415:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.458459:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458464:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458468:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458473:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4af800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.458475:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458480:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458487:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129817.458489:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.458492:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458496:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af800/0x48868a4e43954205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458508:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458513:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458518:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458522:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4aec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.458524:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458529:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458534:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009360d800) 00010000:00010000:3.0:1746129817.458536:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.458538:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458542:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aec00/0x48868a4e4395420c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.458569:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4af200/0x48868a4e439541fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.458579:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.458584:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.458586:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129817.458588:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4aee00, rc 0) 00000100:00100000:3.0:1746129817.459328:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31421:x1830949054218880:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1100us (1941us total) trans 8589944926 rc 0/0 00000100:00100000:3.0:1746129817.459335:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10942 00000100:00100000:0.0:1746129817.462380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.462466:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054219008 00000100:00100000:2.0:1746129817.462473:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054219008 00000100:00100000:2.0:1746129817.462521:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15144 00000100:00100000:2.0:1746129817.462528:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:31426:x1830949054219008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.462542:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.462556:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355683 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.462579:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.462589:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.462590:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.462593:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.462617:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.462627:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.462637:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053976832:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.462721:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.463947:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.464030:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054219264 00000100:00100000:3.0:1746129817.464035:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054219264 00000100:00100000:3.0:1746129817.464077:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10943 00000100:00100000:3.0:1746129817.464084:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31425:x1830949054219264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.464097:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.464108:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094334c00/0x48868a4e43954228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35568a expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.464423:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136921600/0x48868a4e4395422f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.464434:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136921600/0x48868a4e4395422f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.464442:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136921600/0x48868a4e4395422f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129817.464452:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.464545:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094334c00/0x48868a4e43954228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35568a expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.464558:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136921600/0x48868a4e4395422f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35568a expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.464564:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.464566:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129817.464569:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136921600, rc 0) 00000100:00100000:3.0:1746129817.464612:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054219264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 528us (667us total) trans 8589944927 rc 0/0 00000100:00100000:3.0:1746129817.464618:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10943 00000100:00100000:0.0:1746129817.467125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.467225:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.467289:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054219648 00000100:00100000:1.0:1746129817.467296:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054219648 00000100:00100000:1.0:1746129817.467340:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15145 00000100:00100000:3.0:1746129817.467342:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054219520 00000100:00100000:3.0:1746129817.467346:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054219520 00000100:00100000:1.0:1746129817.467347:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31425:x1830949054219648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129817.467361:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.467373:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355698 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.467380:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10944 00000100:00100000:3.0:1746129817.467386:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31422:x1830949054219520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129817.467394:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.467397:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.467399:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 9 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.467407:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136921400/0x48868a4e43954244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355691 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.467409:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 9 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.467418:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013094a400, rc 0) 00000100:00100000:1.0:1746129817.467452:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31425:x1830949054219648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.467457:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15145 00010000:00010000:3.0:1746129817.467474:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.468180:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.468206:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.468213:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.468239:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.468248:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 9 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.468259:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053976960:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.468705:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.468713:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 284 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.468721:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053977088:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.469386:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a26d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.469750:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053976832:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.469771:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 13 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.469783:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befc00, rc 0) 00000100:00100000:2.0:1746129817.469821:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31426:x1830949054219008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7293us (7448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.469828:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15144 00000100:00100000:0.0:1746129817.470332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.470364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.470430:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220032 00000100:00100000:1.0:1746129817.470436:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220032 00010000:00010000:1.0:1746129817.470456:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.470493:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7538 00000100:00100000:1.0:1746129817.470499:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054220032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129817.470509:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129817.470526:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.470535:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.470553:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52e00/0x48868a4e439541a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355644 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.470566:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.470568:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.470573:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.470580:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.470586:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.470587:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129817.470590:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.470596:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.470617:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.470626:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053977216:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129817.470672:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 12 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.470678:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054219904 00000100:00100000:1.0:1746129817.470680:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053977344:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.470681:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054219904 00000100:00100000:1.0:1746129817.470696:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.470700:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10945 00000100:00100000:2.0:1746129817.470706:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31421:x1830949054219904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.470719:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.470952:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746129817.470965:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136921600/0x48868a4e4395422f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35568a expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.470981:0:14315:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 9 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.470989:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.470993:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.470999:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.471004:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129817.471011:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954252 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35569f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.471042:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129817.471144:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129817.471258:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.471264:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.471280:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.471292:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 7 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.471300:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053977472:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.471344:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.471684:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220160 00000100:00100000:3.0:1746129817.471687:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220160 00010000:00010000:3.0:1746129817.471700:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 285 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.471726:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7539 00000100:00100000:3.0:1746129817.471731:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054220160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.471739:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.471743:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 285 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.471754:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 285 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.471764:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.471767:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.471773:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.471778:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.471783:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.471787:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.471794:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.471827:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054220160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.471832:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7539 00010000:00010000:3.0:1746129817.471881:0:14313:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from blocking AST (req@ffff88009284ca80 x1830949053976960) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 1/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 10 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.471889:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4aee00/0x48868a4e43954213 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35567c expref: 10 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.471904:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053976960:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.471913:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e439541f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355675 expref: 284 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.471920:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053977088:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.471929:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.471932:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.471936:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.471941:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.471947:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.471952:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129817.471965:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.472062:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136921400/0x48868a4e43954244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.472073:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.472078:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.472081:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129817.472083:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335000, rc 0) 00000100:00100000:3.0:1746129817.472103:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31422:x1830949054219520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4717us (4986us total) trans 8589944928 rc 0/0 00000100:00100000:3.0:1746129817.472108:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10944 00000100:00100000:1.0:1746129817.473010:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053977216:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129817.473540:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053977344:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129817.473554:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129817.473589:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054220032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3090us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.473596:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7538 00000100:00100000:0.0:1746129817.474468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.474513:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220288 00000100:00100000:3.0:1746129817.474517:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220288 00000100:00100000:3.0:1746129817.474554:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10946 00000100:00100000:3.0:1746129817.474560:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31426:x1830949054220288:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.474573:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.474584:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556a6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.474621:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.474627:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.474639:0:14313:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.474924:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.474934:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.474936:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129817.474938:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.474947:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20800, rc 0) 00000100:00100000:3.0:1746129817.475117:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31426:x1830949054220288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 556us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.475123:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10946 00000100:00100000:0.0:1746129817.475152:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.475260:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220416 00000100:00100000:3.0:1746129817.475263:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220416 00000100:00100000:3.0:1746129817.475290:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10947 00000100:00100000:3.0:1746129817.475295:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054220416:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.475302:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.475308:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556ad expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.475328:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.475335:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.475342:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.475344:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129817.475346:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.475350:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20400, rc 0) 00000100:00100000:3.0:1746129817.476004:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31425:x1830949054220416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 706us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.476009:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10947 00000100:00100000:1.0:1746129817.476298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.476304:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053977472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.476319:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129817.476338:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220544 00000100:00100000:0.0:1746129817.476341:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220544 00010000:00010000:0.0:1746129817.476362:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746129817.476377:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7540 00000100:00100000:0.0:1746129817.476381:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054220544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.476388:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.476393:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.476401:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.476416:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013186fe00/0x48868a4e439541d4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35566e expref: 8 pid: 14313 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.476426:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129817.476429:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.476436:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.476441:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129817.476448:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.476472:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.476501:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054220544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.476506:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7540 00010000:00010000:2.0:1746129817.476580:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.476586:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000040:00080000:2.0:1746129817.478525:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3478, 88 off292792 00000004:00080000:2.0:1746129817.478533:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536684552ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478591:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3488, 88 off293584 00000004:00080000:2.0:1746129817.478595:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536747053ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478607:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3489, 88 off293672 00000004:00080000:2.0:1746129817.478609:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536761244ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478617:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3479, 88 off292880 00000004:00080000:2.0:1746129817.478619:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536771175ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478625:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3480, 88 off292968 00000004:00080000:2.0:1746129817.478628:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536779695ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478634:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3490, 88 off293760 00000004:00080000:2.0:1746129817.478637:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536789119ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478644:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3491, 88 off293848 00000004:00080000:2.0:1746129817.478646:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536798370ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478653:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3492, 88 off293936 00000004:00080000:2.0:1746129817.478655:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536807090ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478661:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3481, 88 off293056 00000004:00080000:2.0:1746129817.478664:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536816003ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478671:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3493, 88 off294024 00000004:00080000:2.0:1746129817.478674:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536825925ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478680:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3482, 88 off293144 00000004:00080000:2.0:1746129817.478682:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536834574ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478689:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3494, 88 off294112 00000004:00080000:2.0:1746129817.478691:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536842735ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129817.478697:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3483, 88 off293232 00000004:00080000:2.0:1746129817.478699:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536851165ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478705:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3484, 88 off293320 00000004:00080000:2.0:1746129817.478707:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536859464ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478713:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3485, 88 off293408 00000004:00080000:2.0:1746129817.478716:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536868359ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478722:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3486, 88 off293496 00000004:00080000:2.0:1746129817.478725:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763536876787ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129817.478731:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3495, 88 off294200 00000004:00080000:2.0:1746129817.478734:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763536885804ns, next at 716792379979ns, rc = 0 00010000:00010000:2.0:1746129817.502946:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.502960:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.502963:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129817.502967:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.502976:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.502983:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.502989:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.502996:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.503002:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.503035:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.503047:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053977600:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.503118:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.503125:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053977728:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.503142:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000001:00080000:0.0:1746129817.503283:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944929 is committed 00000004:00080000:0.0:1746129817.503288:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2663 committed 00000004:00080000:0.0:1746129817.503301:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2659 committed 00000004:00080000:0.0:1746129817.503310:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2658 committed 00000004:00080000:0.0:1746129817.503312:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2657 committed 00000004:00080000:0.0:1746129817.503314:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2656 committed 00000004:00080000:0.0:1746129817.503316:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2662 committed 00000004:00080000:0.0:1746129817.503317:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2655 committed 00000004:00080000:0.0:1746129817.503319:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2661 committed 00000004:00080000:0.0:1746129817.503320:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2654 committed 00000004:00080000:0.0:1746129817.503322:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2660 committed 00000004:00080000:0.0:1746129817.503324:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2659 committed 00000004:00080000:0.0:1746129817.503325:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2658 committed 00000004:00080000:0.0:1746129817.503327:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2653 committed 00000004:00080000:0.0:1746129817.503328:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2652 committed 00000004:00080000:0.0:1746129817.503330:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2657 committed 00000004:00080000:0.0:1746129817.503331:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2656 committed 00000004:00080000:0.0:1746129817.503332:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2651 committed 00000001:00080000:0.0:1746129817.503337:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944925 is committed 00000001:00080000:0.0:1746129817.503339:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944924 is committed 00000001:00080000:0.0:1746129817.503343:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944928 is committed 00000100:00100000:1.0:1746129817.503536:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053978240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503568:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503584:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053978752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503597:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503611:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129817.503615:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053977856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503629:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503640:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053978368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503653:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503668:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053977984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503681:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503689:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053978496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503699:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503708:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129817.503711:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053978112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503721:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503729:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053978624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.503740:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.503759:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978240 00000100:00100000:1.0:1746129817.503763:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978240 00000100:00100000:1.0:1746129817.503789:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978752 00000100:00100000:1.0:1746129817.503791:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978752 00000100:00100000:1.0:1746129817.503800:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053977856 00000100:00100000:1.0:1746129817.503801:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053977856 00000100:00100000:1.0:1746129817.503809:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978368 00000100:00100000:1.0:1746129817.503811:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978368 00000100:00100000:1.0:1746129817.503818:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053977984 00000100:00100000:1.0:1746129817.503819:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053977984 00000100:00100000:1.0:1746129817.503825:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978496 00000100:00100000:1.0:1746129817.503826:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978496 00000100:00100000:1.0:1746129817.503831:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978112 00000100:00100000:1.0:1746129817.503832:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978112 00000100:00100000:1.0:1746129817.503836:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978624 00000100:00100000:1.0:1746129817.503838:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978624 00000100:00100000:1.0:1746129817.503863:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15146 00000100:00100000:1.0:1746129817.503870:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053978240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.504048:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053978240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (480us total) trans 21474841258 rc 0/0 00000100:00100000:1.0:1746129817.504055:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15146 00000100:00100000:1.0:1746129817.504067:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15147 00000100:00100000:1.0:1746129817.504071:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053978752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.504142:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053978752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (543us total) trans 21474841259 rc 0/0 00000100:00100000:1.0:1746129817.504147:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15147 00000100:00100000:1.0:1746129817.504157:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15148 00000100:00100000:1.0:1746129817.504161:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053977856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129817.504239:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129817.504242:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.504244:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.504246:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:1.0:1746129817.504248:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746129817.504266:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053977856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (636us total) trans 21474841260 rc 0/0 00000100:00100000:1.0:1746129817.504271:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15148 00000100:00100000:1.0:1746129817.504283:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15149 00000100:00100000:1.0:1746129817.504287:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3298:x1830949053978368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.504357:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3298:x1830949053978368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (703us total) trans 21474841261 rc 0/0 00000100:00100000:1.0:1746129817.504363:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15149 00000100:00100000:1.0:1746129817.504373:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15150 00000100:00100000:1.0:1746129817.504376:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053977984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129817.504437:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129817.504440:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.504441:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.504443:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:1.0:1746129817.504445:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129817.504464:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053977984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (782us total) trans 21474841262 rc 0/0 00000100:00100000:1.0:1746129817.504469:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15150 00000100:00100000:1.0:1746129817.504477:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15151 00000100:00100000:1.0:1746129817.504481:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053978496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.504545:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053978496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (843us total) trans 21474841263 rc 0/0 00000100:00100000:1.0:1746129817.504549:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15151 00000100:00100000:1.0:1746129817.504558:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15152 00000100:00100000:1.0:1746129817.504562:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053978112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129817.504621:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:1.0:1746129817.504624:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.504625:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:1.0:1746129817.504627:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:1.0:1746129817.504628:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:1.0:1746129817.504645:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053978112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (922us total) trans 21474841264 rc 0/0 00000100:00100000:1.0:1746129817.504649:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15152 00000100:00100000:1.0:1746129817.504658:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15153 00000100:00100000:1.0:1746129817.504662:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3296:x1830949053978624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129817.504723:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129817.504725:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129817.504727:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129817.504728:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129817.504730:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129817.504746:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830949053978624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1004us total) trans 21474841265 rc 0/0 00000100:00100000:1.0:1746129817.504750:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15153 00000004:00080000:1.0:1746129817.504787:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b480/2, rc 0, transno 21474841264 00000100:00100000:0.0:1746129817.505139:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053978880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505167:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505204:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505220:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505233:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129817.505237:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505251:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505260:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505271:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505285:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505299:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505308:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505322:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505332:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129817.505335:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505348:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505356:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505368:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129817.505384:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053978880 00000100:00100000:0.0:1746129817.505388:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053978880 00000100:00100000:0.0:1746129817.505456:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979392 00000100:00100000:0.0:1746129817.505459:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979392 00000100:00100000:0.0:1746129817.505467:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979264 00000100:00100000:0.0:1746129817.505469:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979264 00000100:00100000:0.0:1746129817.505475:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979776 00000100:00100000:0.0:1746129817.505476:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979776 00000100:00100000:0.0:1746129817.505481:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979136 00000100:00100000:0.0:1746129817.505482:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979136 00000100:00100000:0.0:1746129817.505487:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979648 00000100:00100000:0.0:1746129817.505488:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979648 00000100:00100000:0.0:1746129817.505493:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979008 00000100:00100000:0.0:1746129817.505495:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979008 00000100:00100000:0.0:1746129817.505500:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15154 00000100:00100000:0.0:1746129817.505504:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3299:x1830949053978880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129817.505595:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129817.505597:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.505599:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.505601:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:0.0:1746129817.505603:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129817.505624:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053978880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (457us total) trans 17179874067 rc 0/0 00000100:00100000:0.0:1746129817.505632:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15154 00000100:00100000:0.0:1746129817.505724:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979520 00000100:00100000:0.0:1746129817.505727:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979520 00000100:00100000:0.0:1746129817.505736:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15155 00000100:00100000:0.0:1746129817.505740:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053979392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505812:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053979392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (590us total) trans 17179874068 rc 0/0 00000100:00100000:0.0:1746129817.505816:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15155 00000100:00100000:0.0:1746129817.505825:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15156 00000100:00100000:0.0:1746129817.505829:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053979264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505914:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053979264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (661us total) trans 17179874069 rc 0/0 00000100:00100000:0.0:1746129817.505919:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15156 00000100:00100000:0.0:1746129817.505927:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15157 00000100:00100000:0.0:1746129817.505932:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3299:x1830949053979776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.505997:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3299:x1830949053979776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (724us total) trans 17179874070 rc 0/0 00000100:00100000:0.0:1746129817.506002:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15157 00000100:00100000:0.0:1746129817.506010:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15158 00000100:00100000:0.0:1746129817.506014:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053979136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129817.506071:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129817.506073:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.506075:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.506076:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:0.0:1746129817.506078:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129817.506099:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053979136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (799us total) trans 17179874071 rc 0/0 00000100:00100000:0.0:1746129817.506104:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15158 00000100:00100000:0.0:1746129817.506113:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15159 00000100:00100000:0.0:1746129817.506116:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053979648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.506180:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053979648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (856us total) trans 17179874072 rc 0/0 00000100:00100000:0.0:1746129817.506198:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15159 00000100:00100000:0.0:1746129817.506207:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15160 00000100:00100000:0.0:1746129817.506211:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053979008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129817.506271:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129817.506274:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.506275:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129817 -> 1746129817 00002000:00010000:0.0:1746129817.506277:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129818 -> 1746129818 00002000:00010000:0.0:1746129817.506278:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129817.506296:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053979008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (947us total) trans 17179874073 rc 0/0 00000100:00100000:0.0:1746129817.506300:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15160 00000100:00100000:0.0:1746129817.506309:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15161 00000100:00100000:0.0:1746129817.506312:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949053979520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129817.506381:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949053979520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1011us total) trans 17179874074 rc 0/0 00000100:00100000:0.0:1746129817.506386:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15161 00000100:00100000:0.0:1746129817.506443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.506508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00080000:0.0:1746129817.506537:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ca80/2, rc 0, transno 17179874073 00000100:00100000:0.0:1746129817.506542:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506549:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ce00/2, rc 0, transno 17179874074 00000100:00100000:0.0:1746129817.506551:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506556:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284e300/2, rc 0, transno 17179874071 00000100:00100000:0.0:1746129817.506559:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506564:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c000/2, rc 0, transno 17179874072 00000100:00100000:0.0:1746129817.506566:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053979648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506580:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c380/2, rc 0, transno 17179874069 00000100:00100000:0.0:1746129817.506583:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979264:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506589:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3100/2, rc 0, transno 17179874070 00000100:00100000:0.0:1746129817.506591:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979776:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506597:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284c700/2, rc 0, transno 17179874067 00000100:00100000:0.0:1746129817.506599:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053978880:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129817.506604:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284f480/2, rc 0, transno 17179874068 00000100:00100000:0.0:1746129817.506606:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129817.506731:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220672 00000100:00100000:2.0:1746129817.506735:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220672 00000100:00100000:2.0:1746129817.506751:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220800 00000100:00100000:2.0:1746129817.506754:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220800 00000100:00100000:2.0:1746129817.506764:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4551 00000100:00100000:2.0:1746129817.506769:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31426:x1830949054220672:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129817.506836:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31426:x1830949054220672:12345-192.168.204.31@tcp:49:cat.0 Request processed in 66us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.506841:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4551 00000100:00100000:2.0:1746129817.506875:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4552 00000100:00100000:2.0:1746129817.506880:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054220800:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:2.0:1746129817.506913:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054220800:12345-192.168.204.31@tcp:49:cat.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.506918:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4552 00000100:00100000:2.0:1746129817.506939:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053977600:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.506947:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053977728:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.506969:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e43954252 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 9 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129817.506983:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.506998:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef000, rc 0) 00000100:00100000:2.0:1746129817.507015:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31421:x1830949054219904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 36309us (36684us total) trans 8589944929 rc 0/0 00000100:00100000:2.0:1746129817.507021:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10945 00000100:00100000:1.0:1746129817.507224:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053978112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507239:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130507800/2, rc 0, transno 21474841265 00000100:00100000:1.0:1746129817.507242:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053978624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507249:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39c00/2, rc 0, transno 21474841262 00000100:00100000:1.0:1746129817.507252:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053977984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507258:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130504380/2, rc 0, transno 21474841263 00000100:00100000:1.0:1746129817.507260:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053978496:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507287:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38380/2, rc 0, transno 21474841260 00000100:00100000:1.0:1746129817.507290:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053977856:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507295:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39500/2, rc 0, transno 21474841261 00000100:00100000:1.0:1746129817.507297:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053978368:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507302:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39f80/2, rc 0, transno 21474841258 00000100:00100000:1.0:1746129817.507304:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053978240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129817.507309:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130504e00/2, rc 0, transno 21474841259 00000100:00100000:1.0:1746129817.507311:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130504e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053978752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129817.508673:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129817.508709:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129817.508970:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053979904 00000100:00100000:1.0:1746129817.508975:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053979904 00000100:00100000:1.0:1746129817.509000:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15162 00000100:00100000:1.0:1746129817.509006:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3299:x1830949053979904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129817.509454:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3299:x1830949053979904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 447us (743us total) trans 21474841266 rc 0/0 00000100:00100000:1.0:1746129817.509459:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15162 00000004:00080000:3.0:1746129817.509541:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01b8000/2, rc 0, transno 21474841266 00000100:00100000:3.0:1746129817.509546:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053979904:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129817.515531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.515569:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.515606:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.515677:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054221440 00000100:00100000:3.0:1746129817.515684:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054221440 00002000:00100000:3.0:1746129817.515721:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a01bb100 x1830949054221440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.515730:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb100 with x1830949054221440 ext(0->1048575) 00002000:00010000:3.0:1746129817.515735:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bb100 00000100:00100000:3.0:1746129817.515747:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054221312 00000100:00100000:3.0:1746129817.515749:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054221312 00002000:00100000:3.0:1746129817.515759:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a01bad80 x1830949054221312/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.515766:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bad80 with x1830949054221312 ext(0->1048575) 00002000:00010000:3.0:1746129817.515768:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bad80 00000100:00100000:3.0:1746129817.515778:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6732 00000100:00100000:3.0:1746129817.515784:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054221440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129817.517400:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6733 00000100:00100000:0.0:1746129817.517409:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054221312:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.517690:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054220928 00000100:00100000:1.0:1746129817.517695:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054220928 00000100:00100000:1.0:1746129817.517719:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15163 00000100:00100000:1.0:1746129817.517724:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31421:x1830949054220928:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129817.517732:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.517745:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556b4 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.517764:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.517771:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129817.517772:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129817.517776:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3837952->4067327] (req 3837952->4067327) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.517801:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.517812:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.517823:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053980032:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129817.517885:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.523445:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.523468:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054221568 00000100:00100000:0.0:1746129817.523474:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054221568 00010000:00010000:0.0:1746129817.523498:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746129817.523532:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7541 00000100:00100000:0.0:1746129817.523538:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054221568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.523552:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.523569:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.523580:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.523598:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.523600:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.523605:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.523612:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.523635:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.523644:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980160:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129817.523701:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28300 going to sleep for 11 seconds 00010000:00010000:1.0:1746129817.523862:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd53800/0x48868a4e439541c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355667 expref: 11 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.523875:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130507480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053980032:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129817.523894:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.523901:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff99600, rc 0) 00000100:00100000:1.0:1746129817.523921:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31421:x1830949054220928:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6198us (8398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.523927:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15163 00000100:00100000:3.0:1746129817.528096:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054221440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12303us (12517us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.528108:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6732 00002000:00100000:3.0:1746129817.528118:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a01bb100 x1830949054221440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.528128:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb100 with x1830949054221440 ext(0->1048575) 00002000:00010000:3.0:1746129817.528133:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bb100 00000100:00100000:1.0:1746129817.530269:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054221312:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12856us (14656us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.530278:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6733 00002000:00100000:1.0:1746129817.530286:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a01bad80 x1830949054221312/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.530295:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bad80 with x1830949054221312 ext(0->1048575) 00002000:00010000:1.0:1746129817.530299:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bad80 00000100:00100000:2.0:1746129817.530382:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980160:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.530399:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.530416:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054221568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6878us (6977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.530424:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7541 00000100:00100000:1.0:1746129817.531056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.531074:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054221824 00000100:00100000:1.0:1746129817.531079:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054221824 00002000:00100000:1.0:1746129817.531108:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->3842047) req@ffff880130507480 x1830949054221824/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.531116:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507480 with x1830949054221824 ext(3837952->3842047) 00002000:00010000:1.0:1746129817.531119:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507480 00000100:00100000:1.0:1746129817.533296:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6734 00000100:00100000:1.0:1746129817.533311:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054221824:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.533466:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054221824:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 160us (2411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.533472:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6734 00002000:00100000:1.0:1746129817.533479:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->3842047) req@ffff880130507480 x1830949054221824/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.533486:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507480 with x1830949054221824 ext(3837952->3842047) 00002000:00010000:1.0:1746129817.533491:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507480 00000100:00100000:0.0:1746129817.540263:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.540318:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.540332:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054222080 00000100:00100000:1.0:1746129817.540341:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054222080 00002000:00100000:1.0:1746129817.540376:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (4063232->4067327) req@ffff8800a01b9c00 x1830949054222080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.540385:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9c00 with x1830949054222080 ext(4063232->4067327) 00002000:00010000:1.0:1746129817.540389:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b9c00 00000100:00100000:2.0:1746129817.540614:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054222208 00000100:00100000:2.0:1746129817.540619:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054222208 00000100:00100000:2.0:1746129817.540644:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15164 00000100:00100000:2.0:1746129817.540651:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31425:x1830949054222208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.540663:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.540677:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556bb expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.540702:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.540708:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.540709:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.540712:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.540738:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.540748:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.540764:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053980288:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.540822:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.541651:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6735 00000100:00100000:1.0:1746129817.541659:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054222080:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.541972:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054222080:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 314us (1715us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.541979:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6735 00002000:00100000:1.0:1746129817.541986:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (4063232->4067327) req@ffff8800a01b9c00 x1830949054222080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.541995:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9c00 with x1830949054222080 ext(4063232->4067327) 00002000:00010000:1.0:1746129817.541998:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b9c00 00000100:00100000:3.0:1746129817.542370:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053980288:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.542391:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.542403:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fca00, rc 0) 00000100:00100000:3.0:1746129817.542423:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31425:x1830949054222208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1773us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.542428:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15164 00000100:00100000:0.0:1746129817.545235:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.545334:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054222336 00000100:00100000:2.0:1746129817.545342:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054222336 00010000:00010000:2.0:1746129817.545368:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.545391:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7542 00000100:00100000:2.0:1746129817.545397:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054222336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.545407:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.545425:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.545436:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.545453:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd53e00/0x48868a4e439541aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35564b expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.545482:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.545484:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.545490:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.545498:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.545525:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 8 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.545536:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980416:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.545632:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.546626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.546668:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054222464 00000100:00100000:3.0:1746129817.546673:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054222464 00000100:00100000:3.0:1746129817.546708:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15165 00000100:00100000:3.0:1746129817.546713:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31426:x1830949054222464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.546724:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.546733:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556c2 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.546744:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.546745:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.546749:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.546759:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.546766:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8c27c00, rc 0) 00000100:00100000:3.0:1746129817.546800:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31426:x1830949054222464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.546805:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15165 00000100:00100000:2.0:1746129817.547703:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980416:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.547716:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.547738:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054222336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2341us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.547746:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7542 00000100:00100000:0.0:1746129817.548278:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.548734:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054222720 00000100:00100000:1.0:1746129817.548739:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054222720 00000100:00100000:1.0:1746129817.548777:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4553 00000100:00100000:1.0:1746129817.548784:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31421:x1830949054222720:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129817.548990:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31421:x1830949054222720:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 206us (712us total) trans 8589944930 rc 0/0 00000100:00100000:1.0:1746129817.548996:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4553 00000100:00100000:0.0:1746129817.551141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.551205:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054222976 00000100:00100000:1.0:1746129817.551211:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054222976 00002000:00100000:1.0:1746129817.551241:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009fd47800 x1830949054222976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.551250:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47800 with x1830949054222976 ext(1048576->2097151) 00002000:00010000:1.0:1746129817.551254:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd47800 00000100:00100000:1.0:1746129817.552062:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6736 00000100:00100000:1.0:1746129817.552075:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054222976:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129817.552416:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.552475:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054223232 00000100:00100000:2.0:1746129817.552480:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054223232 00002000:00100000:2.0:1746129817.552498:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009fd46680 x1830949054223232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.552506:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46680 with x1830949054223232 ext(1048576->2097151) 00002000:00010000:2.0:1746129817.552510:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd46680 00000100:00100000:2.0:1746129817.552521:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6737 00000100:00100000:2.0:1746129817.552526:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054223232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.563018:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054223232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10480us (10591us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.563033:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6737 00002000:00100000:2.0:1746129817.563043:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009fd46680 x1830949054223232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.563058:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46680 with x1830949054223232 ext(1048576->2097151) 00002000:00010000:2.0:1746129817.563063:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd46680 00000100:00100000:2.0:1746129817.566228:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054222976:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14149us (15082us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.566237:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6736 00002000:00100000:2.0:1746129817.566769:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009fd47800 x1830949054222976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.566778:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd47800 with x1830949054222976 ext(1048576->2097151) 00002000:00010000:2.0:1746129817.566783:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fd47800 00000100:00100000:0.0:1746129817.569342:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.570838:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054223360 00000100:00100000:3.0:1746129817.570870:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054223360 00000100:00100000:3.0:1746129817.570925:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15166 00000100:00100000:3.0:1746129817.570934:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31426:x1830949054223360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.570951:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.570968:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556c9 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.570991:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.570997:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.570999:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.571002:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.571030:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.571039:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 8 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.571049:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053980544:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.571125:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.575035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.575342:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054223488 00000100:00100000:2.0:1746129817.575349:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054223488 00000100:00100000:2.0:1746129817.575391:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15167 00000100:00100000:2.0:1746129817.575398:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31425:x1830949054223488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.575412:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.575425:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556d0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.575445:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.575450:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.575458:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.575467:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fd600, rc 0) 00000100:00100000:2.0:1746129817.576414:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054223488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1011us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.576426:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15167 00000100:00100000:1.0:1746129817.576677:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.576713:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054223616 00000100:00100000:2.0:1746129817.576717:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054223616 00000100:00100000:2.0:1746129817.576737:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15168 00000100:00100000:2.0:1746129817.576741:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31422:x1830949054223616:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.576749:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.576763:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556d7 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.576777:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.576783:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.576784:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.576786:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.576806:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.576815:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 9 pid: 10930 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.576825:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053980672:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.576896:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.576968:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053980544:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.576986:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.577334:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8c27200, rc 0) 00000100:00100000:3.0:1746129817.577366:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31426:x1830949054223360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6434us (8032us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.577372:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15166 00000100:00100000:0.0:1746129817.579153:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.579203:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054223744 00000100:00100000:2.0:1746129817.579209:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054223744 00010000:00010000:2.0:1746129817.579230:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.579260:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7543 00000100:00100000:2.0:1746129817.579266:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054223744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.579279:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.579297:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.579305:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.579324:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd52800/0x48868a4e439541b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355652 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.579346:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.579347:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.579352:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.579359:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.579365:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.579366:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.579369:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.579375:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.579394:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.579401:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980800:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.579461:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.579467:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980928:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.579480:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.580612:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.580890:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053980672:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.580907:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2580480->3145727] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.580917:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fc400, rc 0) 00000100:00100000:3.0:1746129817.580949:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31422:x1830949054223616:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4206us (4272us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.580955:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15168 00000100:00100000:2.0:1746129817.581023:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054223872 00000100:00100000:2.0:1746129817.581028:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054223872 00002000:00100000:2.0:1746129817.581051:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->4067327) req@ffff88009fd46a00 x1830949054223872/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.581059:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46a00 with x1830949054223872 ext(3837952->4067327) 00010000:00010000:2.0:1746129817.581064:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 10 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.581075:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 10 pid: 10930 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.581081:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd46a00 00000100:00100000:2.0:1746129817.581104:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1824 00000100:00100000:2.0:1746129817.581109:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054223872:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129817.582692:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980800:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.582701:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053980928:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.582712:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.582745:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054223744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3479us (3595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.582752:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7543 00000100:00100000:2.0:1746129817.585450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.585541:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054224128 00000100:00100000:3.0:1746129817.585548:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054224128 00002000:00100000:3.0:1746129817.585595:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f6a6300 x1830949054224128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.585603:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6300 with x1830949054224128 ext(1048576->2097151) 00002000:00010000:3.0:1746129817.585616:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a6300 00000100:00100000:3.0:1746129817.585641:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6738 00000100:00100000:3.0:1746129817.585651:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054224128:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.586495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.586788:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054224384 00000100:00100000:0.0:1746129817.586794:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054224384 00002000:00100000:0.0:1746129817.586815:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880130506d80 x1830949054224384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.586822:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949054224384 ext(1048576->2097151) 00002000:00010000:0.0:1746129817.586827:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506d80 00000100:00100000:0.0:1746129817.587236:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6739 00000100:00100000:0.0:1746129817.587243:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054224384:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129817.588518:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054223872:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 7406us (7905us total) trans 17179874075 rc 0/0 00000100:00100000:3.0:1746129817.588526:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1824 00002000:00100000:3.0:1746129817.588534:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->4067327) req@ffff88009fd46a00 x1830949054223872/t17179874075(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.588544:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fd46a00 with x1830949054223872 ext(3837952->4067327) 00010000:00010000:3.0:1746129817.588551:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 14 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.588562:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 14 pid: 10930 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.588568:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fd46a00 00000100:00100000:3.0:1746129817.593384:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054224128:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7729us (7934us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.593395:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6738 00002000:00100000:3.0:1746129817.593404:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f6a6300 x1830949054224128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.593412:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a6300 with x1830949054224128 ext(1048576->2097151) 00002000:00010000:3.0:1746129817.593417:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a6300 00000100:00100000:0.0:1746129817.595696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.596570:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054224512 00000100:00100000:2.0:1746129817.596578:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054224512 00010000:00010000:2.0:1746129817.596610:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 14 pid: 10930 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.596635:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7544 00000100:00100000:2.0:1746129817.596641:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054224512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.596653:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129817.596669:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129817 -> 1746129818 00010000:00010000:2.0:1746129817.596674:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 14 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.596686:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 14 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.596705:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99600/0x48868a4e43954275 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3837952->4067327) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556b4 expref: 14 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.596739:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.596741:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.596746:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.596753:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.596780:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.596795:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053981056:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.596867:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.598758:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054224384:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11508us (12257us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.598768:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6739 00002000:00100000:2.0:1746129817.598776:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880130506d80 x1830949054224384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.598790:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506d80 with x1830949054224384 ext(1048576->2097151) 00002000:00010000:2.0:1746129817.598795:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506d80 00000100:00100000:0.0:1746129817.600952:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.601189:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054224640 00000100:00100000:3.0:1746129817.601197:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054224640 00000100:00100000:3.0:1746129817.601229:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15169 00000100:00100000:3.0:1746129817.601235:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31426:x1830949054224640:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.601250:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.601262:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556de expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.601285:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.601292:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.601293:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.601296:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.601318:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.601327:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.601336:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053981184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.601382:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.604199:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053981056:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.604216:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.604251:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054224512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7609us (8562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.604263:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7544 00000100:00100000:1.0:1746129817.604525:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.605026:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054224896 00000100:00100000:3.0:1746129817.605031:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054224896 00002000:00100000:3.0:1746129817.605062:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2580480->2584575) req@ffff880130506300 x1830949054224896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.605070:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506300 with x1830949054224896 ext(2580480->2584575) 00002000:00010000:3.0:1746129817.605075:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506300 00000100:00100000:3.0:1746129817.605103:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6740 00000100:00100000:3.0:1746129817.605109:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054224896:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129817.605253:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054224896:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 143us (727us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129817.605259:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6740 00002000:00100000:3.0:1746129817.605265:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2580480->2584575) req@ffff880130506300 x1830949054224896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.605272:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130506300 with x1830949054224896 ext(2580480->2584575) 00002000:00010000:3.0:1746129817.605274:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130506300 00000100:00100000:0.0:1746129817.605997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.606051:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054225024 00000100:00100000:2.0:1746129817.606055:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054225024 00000100:00100000:2.0:1746129817.606088:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15170 00000100:00100000:2.0:1746129817.606094:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31425:x1830949054225024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.606103:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.606120:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556e5 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.606139:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.606144:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.606153:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 10 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.606162:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013067c200, rc 0) 00000100:00100000:2.0:1746129817.606204:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054225024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 109us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.606209:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15170 00000100:00100000:3.0:1746129817.608488:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053981184:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.608517:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.608529:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd53800, rc 0) 00000100:00100000:3.0:1746129817.608574:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31426:x1830949054224640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7337us (7731us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.608581:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15169 00000100:00100000:0.0:1746129817.609315:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.609615:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054225152 00000100:00100000:2.0:1746129817.609621:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054225152 00010000:00010000:2.0:1746129817.609643:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.609676:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7545 00000100:00100000:2.0:1746129817.609682:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054225152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.609694:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.609714:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.609724:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.609744:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd53200/0x48868a4e439541b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355659 expref: 10 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.609768:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.609770:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.609775:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.609782:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.609788:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.609789:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.609792:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.609798:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.609821:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 9 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.609836:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053981312:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.611270:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.611283:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053981440:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.612822:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.613361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.613423:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054225280 00000100:00100000:3.0:1746129817.613429:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054225280 00000100:00100000:3.0:1746129817.613572:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15171 00000100:00100000:3.0:1746129817.613580:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31422:x1830949054225280:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.613593:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.613606:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556ec expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.613629:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.613635:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.613636:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.613639:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->3321855] (req 3145728->3321855) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.613661:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.613671:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.613680:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053981568:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.613719:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.613741:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053981312:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.613748:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053981440:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.613763:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.613778:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054225152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4096us (4464us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.613784:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7545 00000100:00100000:0.0:1746129817.616315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.616513:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053981568:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.616531:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->3321855] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.616543:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8c26400, rc 0) 00000100:00100000:2.0:1746129817.616571:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:31422:x1830949054225280:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2993us (3213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.616577:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15171 00000100:00100000:3.0:1746129817.616651:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054225536 00000100:00100000:3.0:1746129817.616655:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054225536 00002000:00100000:3.0:1746129817.616683:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a55a5180 x1830949054225536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.616690:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5180 with x1830949054225536 ext(1048576->2097151) 00002000:00010000:3.0:1746129817.616693:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a5180 00000100:00100000:3.0:1746129817.617011:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6741 00000100:00100000:3.0:1746129817.617017:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054225536:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129817.619934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.620596:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.620657:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054225920 00000100:00100000:1.0:1746129817.620666:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054225920 00002000:00100000:1.0:1746129817.620702:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a55a6300 x1830949054225920/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129817.620703:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054225792 00000100:00100000:2.0:1746129817.620707:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054225792 00002000:00100000:1.0:1746129817.620711:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a6300 with x1830949054225920 ext(1048576->2097151) 00002000:00010000:1.0:1746129817.620716:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a6300 00010000:00010000:2.0:1746129817.620727:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746129817.620733:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6742 00000100:00100000:1.0:1746129817.620739:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054225920:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129817.620748:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7546 00000100:00100000:2.0:1746129817.620753:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054225792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.620762:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.620777:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.620789:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.620808:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439541bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355660 expref: 9 pid: 8435 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.620825:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.620827:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.620832:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.620839:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.620901:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.620913:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053981696:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.620969:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.629060:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053981696:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.629081:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.629140:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054225792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8386us (8544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.629150:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7546 00000100:00100000:0.0:1746129817.630073:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.630124:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054226176 00000100:00100000:2.0:1746129817.630131:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054226176 00002000:00100000:2.0:1746129817.630162:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3317760->3321855) req@ffff88009207d180 x1830949054226176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.630178:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d180 with x1830949054226176 ext(3317760->3321855) 00002000:00010000:2.0:1746129817.630193:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207d180 00000100:00100000:1.0:1746129817.630494:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054225920:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9753us (10566us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.630502:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6742 00002000:00100000:1.0:1746129817.630507:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a55a6300 x1830949054225920/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.630515:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a6300 with x1830949054225920 ext(1048576->2097151) 00002000:00010000:1.0:1746129817.630518:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a6300 00000100:00100000:1.0:1746129817.630533:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6743 00000100:00100000:1.0:1746129817.630540:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054226176:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.630657:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054226176:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 118us (585us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.630661:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6743 00002000:00100000:1.0:1746129817.630665:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3317760->3321855) req@ffff88009207d180 x1830949054226176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.630671:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d180 with x1830949054226176 ext(3317760->3321855) 00002000:00010000:1.0:1746129817.630673:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207d180 00000100:00100000:3.0:1746129817.634608:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054225536:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17583us (18289us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.634621:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6741 00002000:00100000:3.0:1746129817.634631:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a55a5180 x1830949054225536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.634640:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a55a5180 with x1830949054225536 ext(1048576->2097151) 00002000:00010000:3.0:1746129817.634646:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a55a5180 00000100:00100000:1.0:1746129817.641969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.642018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.642076:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054226304 00000100:00100000:0.0:1746129817.642083:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054226304 00000100:00100000:2.0:1746129817.642098:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054226432 00000100:00100000:2.0:1746129817.642102:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054226432 00000100:00100000:0.0:1746129817.642131:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15172 00000100:00100000:0.0:1746129817.642137:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054226304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129817.642153:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129817.642166:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800920fce00/0x48868a4e439542b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556f3 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.642237:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053981824:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129817.642299:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15173 00000100:00100000:0.0:1746129817.642301:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.642306:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054226432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.642314:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.642322:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f7c00/0x48868a4e439542bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3556fa expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.642347:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053981952:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129817.642370:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510840 going to sleep for 11 seconds 00002000:00010000:2.0:1746129817.643342:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime: 1746129817 -> 1746129818 00002000:00010000:2.0:1746129817.643347:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129817 -> 1746129818 00000100:00100000:2.0:1746129817.643362:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053981824:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129817.643381:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800920fce00/0x48868a4e439542b4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556f3 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.643391:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920fce00/0x48868a4e439542b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556f3 expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.643403:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fce00, rc 0) 00000100:00100000:2.0:1746129817.643437:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054226304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1300us (1476us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129817.643444:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15172 00002000:00010000:3.0:1746129817.643528:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129817 -> 1746129818 00000100:00100000:3.0:1746129817.643542:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053981952:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129817.643557:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f7c00/0x48868a4e439542bb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556fa expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.643578:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f7c00/0x48868a4e439542bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556fa expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.643590:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b7f7c00, rc 0) 00000100:00100000:3.0:1746129817.643608:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054226432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1303us (1590us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129817.643613:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15173 00000100:00100000:0.0:1746129817.645518:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.645593:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054226560 00000100:00100000:3.0:1746129817.645598:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054226560 00000100:00100000:3.0:1746129817.645685:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15174 00000100:00100000:3.0:1746129817.645692:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31425:x1830949054226560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.645704:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.645716:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355701 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.645741:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.645747:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.645749:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.645752:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.645774:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.645784:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 14 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.645793:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053982080:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.645907:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.647517:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053982080:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.647546:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.647561:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd52200, rc 0) 00000100:00100000:3.0:1746129817.647613:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31425:x1830949054226560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1920us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.647622:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15174 00000100:00100000:0.0:1746129817.647787:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.647827:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054226688 00000100:00100000:3.0:1746129817.647834:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054226688 00002000:00100000:3.0:1746129817.647910:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3321855) req@ffff880095242680 x1830949054226688/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.647919:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242680 with x1830949054226688 ext(3145728->3321855) 00010000:00010000:3.0:1746129817.647925:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.647936:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 15 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.647942:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095242680 00000100:00100000:3.0:1746129817.647957:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1825 00000100:00100000:3.0:1746129817.647963:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054226688:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129817.651318:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054226688:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3342us (3519us total) trans 21474841267 rc 0/0 00000100:00100000:3.0:1746129817.651332:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1825 00002000:00100000:3.0:1746129817.651342:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3321855) req@ffff880095242680 x1830949054226688/t21474841267(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.651352:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242680 with x1830949054226688 ext(3145728->3321855) 00010000:00010000:3.0:1746129817.651362:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 17 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.651378:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 17 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:3.0:1746129817.651385:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095242680 00000100:00100000:1.0:1746129817.655758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.657505:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.657522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.657581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.657605:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054226944 00000100:00100000:0.0:1746129817.657606:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054227328 00000100:00100000:1.0:1746129817.657614:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054226944 00000100:00100000:0.0:1746129817.657614:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054227328 00002000:00100000:1.0:1746129817.657655:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880130504a80 x1830949054226944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.657655:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3321856->4194303) req@ffff880130505500 x1830949054227328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.657664:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504a80 with x1830949054226944 ext(2097152->3145727) 00002000:00100000:0.0:1746129817.657664:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505500 with x1830949054227328 ext(3321856->4194303) 00010000:00010000:1.0:1746129817.657673:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.657673:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.657687:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:0.0:1746129817.657694:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130505500 00000100:00100000:0.0:1746129817.657710:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054227456 00000100:00100000:0.0:1746129817.657712:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054227456 00002000:00100000:0.0:1746129817.657725:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3710975) req@ffff880130507100 x1830949054227456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 504/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.657731:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507100 with x1830949054227456 ext(2097152->3710975) 00002000:00010000:0.0:1746129817.657733:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507100 00000100:00100000:0.0:1746129817.657742:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054227712 00000100:00100000:0.0:1746129817.657744:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054227712 00002000:00100000:0.0:1746129817.657751:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3710976->4194303) req@ffff880130504000 x1830949054227712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.657756:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504000 with x1830949054227712 ext(3710976->4194303) 00002000:00010000:0.0:1746129817.657758:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504000 00000100:00100000:0.0:1746129817.657768:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1826 00000100:00100000:0.0:1746129817.657775:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949054227328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.657877:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6744 00000100:00100000:3.0:1746129817.657884:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054227456:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.658392:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6745 00000100:00100000:2.0:1746129817.658402:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054227712:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129817.659000:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746129817.659009:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130504a80 00000100:00100000:1.0:1746129817.659025:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1827 00000100:00100000:1.0:1746129817.659032:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054226944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.664141:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054227712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5729us (6547us total) trans 0 rc 483328/483328 00000100:00100000:3.0:1746129817.664153:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6745 00002000:00100000:3.0:1746129817.664164:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3710976->4194303) req@ffff880130504000 x1830949054227712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.664173:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504000 with x1830949054227712 ext(3710976->4194303) 00002000:00010000:3.0:1746129817.664189:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130504000 00000100:00100000:2.0:1746129817.670723:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130505500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054227328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12933us (13211us total) trans 0 rc 872448/872448 00000100:00100000:2.0:1746129817.670737:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1826 00002000:00100000:2.0:1746129817.670751:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3321856->4194303) req@ffff880130505500 x1830949054227328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.670761:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130505500 with x1830949054227328 ext(3321856->4194303) 00010000:00010000:2.0:1746129817.670772:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.670790:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.670797:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130505500 00000100:00100000:3.0:1746129817.676878:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054227456:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18982us (19342us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.676878:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130504a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054226944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17835us (21120us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.676891:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1827 00000100:00100000:3.0:1746129817.676895:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6744 00002000:00100000:3.0:1746129817.676903:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3710975) req@ffff880130507100 x1830949054227456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 504/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.676903:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880130504a80 x1830949054226944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.676913:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507100 with x1830949054227456 ext(2097152->3710975) 00002000:00100000:1.0:1746129817.676913:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130504a80 with x1830949054226944 ext(2097152->3145727) 00002000:00010000:3.0:1746129817.676919:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130507100 00010000:00010000:1.0:1746129817.676923:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 17 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.676939:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 17 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746129817.676946:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130504a80 00000100:00100000:0.0:1746129817.681331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.681553:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054227840 00000100:00100000:3.0:1746129817.681567:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054227840 00000100:00100000:3.0:1746129817.681830:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15175 00000100:00100000:3.0:1746129817.681839:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31426:x1830949054227840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.681895:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.681914:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355708 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.681946:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.681950:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.681954:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.681966:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.681977:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4f600, rc 0) 00000100:00100000:3.0:1746129817.682039:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31426:x1830949054227840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 201us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.682045:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15175 00000100:00100000:0.0:1746129817.682745:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.682977:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054227968 00000100:00100000:3.0:1746129817.682982:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054227968 00010000:00010000:3.0:1746129817.683002:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.683024:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7547 00000100:00100000:3.0:1746129817.683029:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054227968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.683037:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.683055:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.683064:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.683079:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c26400/0x48868a4e439542ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3321855) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ec expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.683099:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.683100:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.683105:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.683111:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.683115:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.683115:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.683117:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.683120:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.683143:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.683152:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053982208:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.683337:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.683345:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053982336:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.683373:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.685362:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053982208:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.685375:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053982336:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.685393:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.685478:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054227968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2446us (2734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.685492:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7547 00000100:00100000:1.0:1746129817.689646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.689706:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054228224 00000100:00100000:1.0:1746129817.689710:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.689716:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054228224 00002000:00100000:2.0:1746129817.689752:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faf6680 x1830949054228224/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.689760:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf6680 with x1830949054228224 ext(2097152->3145727) 00002000:00010000:2.0:1746129817.689765:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf6680 00000100:00100000:2.0:1746129817.689824:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054228480 00000100:00100000:2.0:1746129817.689827:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054228480 00002000:00100000:2.0:1746129817.689841:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800936dc700 x1830949054228480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.689866:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830949054228480 ext(3145728->4194303) 00002000:00010000:2.0:1746129817.689869:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:3.0:1746129817.689962:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6746 00000100:00100000:3.0:1746129817.689976:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054228224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.689984:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6747 00000100:00100000:2.0:1746129817.689992:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054228480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.698738:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054228480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8734us (9015us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.698752:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6747 00002000:00100000:2.0:1746129817.698764:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800936dc700 x1830949054228480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.698773:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830949054228480 ext(3145728->4194303) 00002000:00010000:2.0:1746129817.698779:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:3.0:1746129817.701769:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054228224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11784us (12121us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129817.701782:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6746 00002000:00100000:3.0:1746129817.701794:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faf6680 x1830949054228224/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.701803:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faf6680 with x1830949054228224 ext(2097152->3145727) 00002000:00010000:3.0:1746129817.701809:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faf6680 00000100:00100000:1.0:1746129817.706071:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.706143:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054228864 00000100:00100000:3.0:1746129817.706154:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054228864 00000100:00100000:1.0:1746129817.706156:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.706217:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054228736 00000100:00100000:2.0:1746129817.706221:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054228736 00002000:00100000:3.0:1746129817.706488:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800936df800 x1830949054228864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129817.706488:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15176 00002000:00100000:3.0:1746129817.706498:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830949054228864 ext(4194304->4931583) 00000100:00100000:2.0:1746129817.706500:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31425:x1830949054228736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129817.706513:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.706542:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35570f expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.706568:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.706575:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.706577:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129817.706580:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.706606:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.706616:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 21 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.706626:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053982464:192.168.204.31@tcp:104: 00002000:00010000:3.0:1746129817.706667:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:3.0:1746129817.706700:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6748 00000100:00100000:3.0:1746129817.706707:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054228864:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.706729:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.708996:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053982464:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.709018:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 12 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.709033:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e8c00, rc 0) 00000100:00100000:2.0:1746129817.709089:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31425:x1830949054228736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2593us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.709095:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15176 00000100:00100000:0.0:1746129817.712129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.712203:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054228992 00000100:00100000:2.0:1746129817.712214:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054228992 00002000:00100000:2.0:1746129817.712251:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2580480->3145727) req@ffff880095240700 x1830949054228992/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.712260:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240700 with x1830949054228992 ext(2580480->3145727) 00010000:00010000:2.0:1746129817.712268:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 22 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.712282:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 22 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.712289:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240700 00000100:00100000:2.0:1746129817.712390:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1828 00000100:00100000:2.0:1746129817.712397:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054228992:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129817.715284:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054228864:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8570us (9219us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129817.715294:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6748 00002000:00100000:3.0:1746129817.715303:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800936df800 x1830949054228864/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.715312:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df800 with x1830949054228864 ext(4194304->4931583) 00002000:00010000:3.0:1746129817.715317:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936df800 00000100:00100000:0.0:1746129817.719494:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.719607:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054229120 00000100:00100000:3.0:1746129817.719615:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054229120 00000100:00100000:3.0:1746129817.719647:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15177 00000100:00100000:3.0:1746129817.719654:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054229120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.719667:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.719680:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e439542d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355716 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.719722:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053982592:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129817.719777:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.721376:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054228992:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8976us (9255us total) trans 17179874076 rc 0/0 00000100:00100000:2.0:1746129817.721386:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1828 00002000:00100000:2.0:1746129817.721509:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2580480->3145727) req@ffff880095240700 x1830949054228992/t17179874076(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.721520:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240700 with x1830949054228992 ext(2580480->3145727) 00010000:00010000:2.0:1746129817.721527:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 26 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.721539:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 26 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:2.0:1746129817.721546:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240700 00000100:00100000:3.0:1746129817.721562:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053982592:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129817.721581:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e439542d7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355716 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.721592:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e439542d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355716 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.721604:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4fc00, rc 0) 00000100:00100000:3.0:1746129817.721623:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054229120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1970us (2137us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129817.721629:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15177 00000100:00100000:0.0:1746129817.724517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.724569:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054229248 00000100:00100000:3.0:1746129817.724577:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054229248 00010000:00010000:3.0:1746129817.724605:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 24 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.724637:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7548 00000100:00100000:3.0:1746129817.724654:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054229248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.724735:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.724751:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 24 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.724761:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 24 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.724784:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fc400/0x48868a4e43954298 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2580480->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d7 expref: 24 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.724798:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.724800:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.724807:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 11 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.724813:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 11 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.724838:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 11 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.724867:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053982720:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.724938:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.725471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.725590:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054229376 00000100:00100000:3.0:1746129817.725594:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054229376 00000100:00100000:3.0:1746129817.725614:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15178 00000100:00100000:3.0:1746129817.725618:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054229376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.725628:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.725637:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35571d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.725649:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.725650:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.725653:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.725662:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.725669:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb8000, rc 0) 00000100:00100000:3.0:1746129817.725701:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054229376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 82us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.725707:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15178 00000100:00100000:3.0:1746129817.726669:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053982720:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.726680:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.727317:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054229248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2661us (2804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.727325:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7548 00000100:00100000:0.0:1746129817.732806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.732887:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054229632 00000100:00100000:3.0:1746129817.732895:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054229632 00000100:00100000:3.0:1746129817.732947:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4554 00000100:00100000:3.0:1746129817.732954:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31426:x1830949054229632:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129817.733145:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31426:x1830949054229632:12345-192.168.204.31@tcp:35:cat.0 Request processed in 190us (345us total) trans 8589944931 rc 0/0 00000100:00100000:3.0:1746129817.733151:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4554 00000100:00100000:0.0:1746129817.736712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.736742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.736784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.736874:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054229888 00000100:00100000:2.0:1746129817.736881:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054229888 00002000:00100000:2.0:1746129817.736917:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095240380 x1830949054229888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.736926:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949054229888 ext(2097152->3145727) 00002000:00010000:2.0:1746129817.736932:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095240380 00000100:00100000:2.0:1746129817.736945:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054230400 00000100:00100000:2.0:1746129817.736948:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054230400 00002000:00100000:2.0:1746129817.736959:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880095242d80 x1830949054230400/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.736966:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949054230400 ext(3145728->4194303) 00002000:00010000:2.0:1746129817.736968:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242d80 00000100:00100000:2.0:1746129817.736975:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054230144 00000100:00100000:2.0:1746129817.736977:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054230144 00002000:00100000:2.0:1746129817.736984:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ec380 x1830949054230144/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.736990:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ec380 with x1830949054230144 ext(3145728->4194303) 00002000:00010000:2.0:1746129817.736992:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ec380 00000100:00100000:2.0:1746129817.737001:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6749 00000100:00100000:2.0:1746129817.737007:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054229888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129817.737273:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6750 00000100:00100000:0.0:1746129817.737279:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054230400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129817.737575:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6751 00000100:00100000:1.0:1746129817.737584:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054230144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.746169:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054229888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9153us (9455us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.746169:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054230400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8882us (9417us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.746190:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6750 00000100:00100000:3.0:1746129817.746198:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6749 00002000:00100000:1.0:1746129817.746200:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880095242d80 x1830949054230400/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.746205:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095240380 x1830949054229888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.746208:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949054230400 ext(3145728->4194303) 00002000:00100000:3.0:1746129817.746212:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949054229888 ext(2097152->3145727) 00002000:00010000:1.0:1746129817.746213:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242d80 00002000:00010000:3.0:1746129817.746216:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095240380 00000100:00100000:1.0:1746129817.748720:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054230144:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11130us (11928us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.748731:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6751 00002000:00100000:1.0:1746129817.748739:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ec380 x1830949054230144/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.748747:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ec380 with x1830949054230144 ext(3145728->4194303) 00002000:00010000:1.0:1746129817.748753:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ec380 00000100:00100000:0.0:1746129817.762270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.762334:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054230656 00000100:00100000:1.0:1746129817.762341:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054230656 00002000:00100000:1.0:1746129817.762381:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f6efb80 x1830949054230656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.762389:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6efb80 with x1830949054230656 ext(4194304->4931583) 00002000:00010000:1.0:1746129817.762395:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6efb80 00000100:00100000:1.0:1746129817.762428:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6752 00000100:00100000:1.0:1746129817.762435:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054230656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129817.766610:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.766662:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054230912 00000100:00100000:2.0:1746129817.766669:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054230912 00000100:00100000:2.0:1746129817.766717:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10948 00000100:00100000:2.0:1746129817.766725:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31431:x1830949054230912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.766744:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.766757:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e439542e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355724 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.766927:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.766939:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.766949:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.766959:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.766964:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.766969:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767692:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767701:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767707:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129817.767721:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129817.767783:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767788:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767793:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767797:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3de200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.767800:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767805:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767814:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129817.767817:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.767819:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767823:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e439542ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767864:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767869:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767873:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767877:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3de600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.767879:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767883:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767889:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02500) 00010000:00010000:2.0:1746129817.767891:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.767893:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767897:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e439542f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.767935:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3df200/0x48868a4e439542e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 287 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.767944:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.767949:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.767951:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129817.767953:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b539b600, rc 0) 00000100:00100000:2.0:1746129817.767991:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31431:x1830949054230912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1267us (1388us total) trans 8589944932 rc 0/0 00000100:00100000:2.0:1746129817.767997:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10948 00000100:00100000:0.0:1746129817.770492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.770673:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054231168 00000100:00100000:3.0:1746129817.770680:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054231168 00000100:00100000:3.0:1746129817.770707:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10949 00000100:00100000:3.0:1746129817.770712:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31433:x1830949054231168:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.770727:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.770737:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9800/0x48868a4e43954308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35572b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.770928:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.770939:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.770946:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.770956:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.770961:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.770965:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129817.771052:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054230656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8617us (8789us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129817.771061:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6752 00002000:00100000:1.0:1746129817.771070:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f6efb80 x1830949054230656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.771077:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6efb80 with x1830949054230656 ext(4194304->4931583) 00002000:00010000:1.0:1746129817.771082:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6efb80 00010000:00010000:3.0:1746129817.771337:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771345:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771352:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129817.771356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00200000:3.0:1746129817.771359:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.771424:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771429:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771435:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771442:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb9000 already unused, calling callback (ffffffffa1371690) 00000100:00100000:2.0:1746129817.771445:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054231424 00010000:00010000:3.0:1746129817.771446:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129817.771449:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054231424 00010000:00010000:3.0:1746129817.771451:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771460:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129817.771463:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.771466:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771471:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9000/0x48868a4e4395430f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129817.771481:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4555 00010000:00010000:3.0:1746129817.771483:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129817.771487:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31431:x1830949054231424:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:3.0:1746129817.771488:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771492:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771496:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.771498:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771503:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771508:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29a500) 00010000:00010000:3.0:1746129817.771510:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.771513:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.771516:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43954316 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129817.771577:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31431:x1830949054231424:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 90us (221us total) trans 8589944934 rc 0/0 00000100:00100000:2.0:1746129817.771583:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4555 00010000:00010000:3.0:1746129817.771656:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9800/0x48868a4e43954308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.771667:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.771672:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.771674:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129817.771676:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb8e00, rc 0) 00000100:00100000:3.0:1746129817.771707:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c088380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31433:x1830949054231168:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 994us (1220us total) trans 8589944933 rc 0/0 00000100:00100000:3.0:1746129817.771713:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10949 00000100:00100000:0.0:1746129817.776277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.777803:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054231680 00000100:00100000:2.0:1746129817.777812:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054231680 00000100:00100000:2.0:1746129817.777909:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4556 00000100:00100000:2.0:1746129817.777919:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31425:x1830949054231680:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129817.778130:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31425:x1830949054231680:12345-192.168.204.31@tcp:35:cat.0 Request processed in 210us (1860us total) trans 8589944935 rc 0/0 00000100:00100000:2.0:1746129817.778140:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4556 00000100:00100000:0.0:1746129817.861841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.861977:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054231808 00000100:00100000:2.0:1746129817.861985:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054231808 00000100:00100000:2.0:1746129817.862291:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15179 00000100:00100000:2.0:1746129817.862300:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31431:x1830949054231808:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129817.862315:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.862331:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355732 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.862356:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.862365:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 10 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.862371:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.862372:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.862375:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [192512->983039] (req 192512->983039) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.862402:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 10 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.862412:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 10 pid: 7975 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.862422:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053982848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.862789:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.862798:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.862806:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053982976:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.862826:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.863997:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053982848:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.864006:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053982976:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.864025:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [192512->983039] (req 192512->983039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.864036:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3de800, rc 0) 00000100:00100000:2.0:1746129817.864071:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31431:x1830949054231808:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1773us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.864078:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15179 00000100:00100000:0.0:1746129817.864963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.865246:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054231936 00000100:00100000:3.0:1746129817.865253:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054231936 00010000:00010000:3.0:1746129817.865276:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 11 pid: 7975 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.865296:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7549 00000100:00100000:3.0:1746129817.865302:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054231936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.865312:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.865329:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 11 pid: 7975 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.865344:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 11 pid: 7975 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.865361:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013094a400/0x48868a4e4395423d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355698 expref: 11 pid: 7975 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.865425:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.865449:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054231936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 147us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.865455:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7549 00000100:00100000:2.0:1746129817.866295:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.866348:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054232064 00000100:00100000:0.0:1746129817.866352:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054232064 00010000:00010000:0.0:1746129817.866367:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746129817.866390:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7550 00000100:00100000:0.0:1746129817.866396:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054232064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129817.866402:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129817.866417:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.866426:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.866442:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e43954221 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355683 expref: 18 pid: 10930 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.866504:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.866506:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.866513:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.866525:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.866550:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.866560:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053983104:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129817.867046:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.868193:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949053983104:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.868206:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.868231:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054232064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1835us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.868237:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7550 00000100:00100000:0.0:1746129817.868590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.868659:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054232320 00000100:00100000:1.0:1746129817.868664:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054232320 00002000:00100000:1.0:1746129817.868692:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (192512->196607) req@ffff880094a4e300 x1830949054232320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.868701:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e300 with x1830949054232320 ext(192512->196607) 00002000:00010000:1.0:1746129817.868705:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e300 00000100:00100000:1.0:1746129817.868886:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6753 00000100:00100000:1.0:1746129817.868893:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054232320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.869193:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054232320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 300us (603us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.869199:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6753 00002000:00100000:1.0:1746129817.869205:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (192512->196607) req@ffff880094a4e300 x1830949054232320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.869212:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e300 with x1830949054232320 ext(192512->196607) 00002000:00010000:1.0:1746129817.869215:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e300 00000100:00100000:0.0:1746129817.873826:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.873991:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054232576 00000100:00100000:1.0:1746129817.873998:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054232576 00002000:00100000:1.0:1746129817.874030:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (978944->983039) req@ffff880094a4d500 x1830949054232576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.874037:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4d500 with x1830949054232576 ext(978944->983039) 00002000:00010000:1.0:1746129817.874041:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4d500 00000100:00100000:1.0:1746129817.874140:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6754 00000100:00100000:1.0:1746129817.874148:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054232576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.874294:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054232576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 148us (474us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.874300:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6754 00002000:00100000:1.0:1746129817.874305:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (978944->983039) req@ffff880094a4d500 x1830949054232576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.874386:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4d500 with x1830949054232576 ext(978944->983039) 00002000:00010000:1.0:1746129817.874389:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4d500 00000100:00100000:0.0:1746129817.899227:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.899297:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054232832 00000100:00100000:3.0:1746129817.899305:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054232832 00000100:00100000:3.0:1746129817.899356:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10950 00000100:00100000:3.0:1746129817.899364:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31439:x1830949054232832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.899385:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.899400:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9e00/0x48868a4e43954332 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355739 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.899487:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899497:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899505:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899514:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899519:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899524:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899594:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8800/0x48868a4e43954347 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899600:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8800/0x48868a4e43954347 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899605:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8800/0x48868a4e43954347 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129817.899611:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.899669:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899674:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899679:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899683:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb9a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.899686:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899691:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899700:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129817.899703:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.899706:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899710:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9a00/0x48868a4e43954339 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899739:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899744:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899748:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899751:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.899753:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899758:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899763:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29ae00) 00010000:00010000:3.0:1746129817.899765:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.899767:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899770:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8600/0x48868a4e43954340 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.899799:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb9e00/0x48868a4e43954332 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355739 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.899811:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8800/0x48868a4e43954347 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355739 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.899816:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.899818:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129817.899820:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb8800, rc 0) 00000100:00100000:3.0:1746129817.899896:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31439:x1830949054232832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 532us (677us total) trans 8589944936 rc 0/0 00000100:00100000:3.0:1746129817.899902:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10950 00000100:00100000:0.0:1746129817.902563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.903591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.903672:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233088 00000100:00100000:3.0:1746129817.903679:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233088 00000100:00100000:3.0:1746129817.903715:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15180 00000100:00100000:3.0:1746129817.903721:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054233088:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.903740:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129817.903742:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054232960 00000100:00100000:2.0:1746129817.903746:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054232960 00010000:00010000:3.0:1746129817.903753:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43954355 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355740 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.903770:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00100000:2.0:1746129817.903775:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054232960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.903782:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129817.903794:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053983232:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129817.903796:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8800/0x48868a4e43954347 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355739 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.903812:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.903815:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.903834:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054232960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 59us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.903839:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 724 00000100:00100000:3.0:1746129817.903867:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00002000:00010000:3.0:1746129817.905025:0:1877:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129817 -> 1746129818 00002000:00010000:3.0:1746129817.905028:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129817 -> 1746129818 00000100:00100000:3.0:1746129817.905047:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053983232:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129817.905064:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43954355 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355740 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.905078:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb9800/0x48868a4e43954355 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355740 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.905086:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb9800, rc 0) 00000100:00100000:3.0:1746129817.905124:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054233088:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1403us (1533us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129817.905130:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15180 00000100:00100000:0.0:1746129817.906516:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.906637:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233216 00000100:00100000:3.0:1746129817.906642:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233216 00000100:00100000:3.0:1746129817.906666:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15181 00000100:00100000:3.0:1746129817.906672:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31439:x1830949054233216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.906682:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.906694:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355747 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.906717:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.906724:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.906725:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129817.906728:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.906748:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 16 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.906761:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 16 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.906771:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053983360:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.906815:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.908598:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053983360:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.908617:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.908630:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb8400, rc 0) 00000100:00100000:3.0:1746129817.908655:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31439:x1830949054233216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1983us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.908662:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15181 00000100:00100000:0.0:1746129817.909160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.909465:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233344 00000100:00100000:1.0:1746129817.909470:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233344 00002000:00100000:1.0:1746129817.909500:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (192512->983039) req@ffff880094a4c000 x1830949054233344/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.909509:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c000 with x1830949054233344 ext(192512->983039) 00010000:00010000:1.0:1746129817.909515:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 17 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.909525:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 17 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746129817.909531:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a4c000 00000100:00100000:1.0:1746129817.909552:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1829 00000100:00100000:1.0:1746129817.909558:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054233344:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129817.910954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.910994:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233472 00000100:00100000:3.0:1746129817.910999:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233472 00000100:00100000:3.0:1746129817.911125:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15182 00000100:00100000:3.0:1746129817.911132:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31433:x1830949054233472:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.911142:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.911155:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35574e expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.911190:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.911203:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 23 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.911209:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.911210:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.911213:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.911236:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 23 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.911245:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 23 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:3.0:1746129817.911256:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053983488:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.912022:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.912030:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.912084:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053983616:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.912122:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.914299:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053983488:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.914316:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053983616:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.914704:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2805760->3145727] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.914720:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4fc00, rc 0) 00000100:00100000:3.0:1746129817.914769:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31433:x1830949054233472:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3636us (3816us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.914776:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15182 00000100:00100000:0.0:1746129817.917240:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.917281:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233728 00000100:00100000:2.0:1746129817.917287:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233728 00010000:00010000:2.0:1746129817.917313:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746129817.917347:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.917495:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233600 00000100:00100000:2.0:1746129817.917498:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233600 00000100:00100000:0.0:1746129817.917506:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7551 00010000:00010000:2.0:1746129817.917511:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 24 pid: 7975 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746129817.917515:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054233728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129817.917526:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7552 00010000:00010000:0.0:1746129817.917526:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129817.917531:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054233600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.917536:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.917544:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 24 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.917544:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746129817.917555:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.917741:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 24 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746129817.917762:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8c00/0x48868a4e439542d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35570f expref: 13 pid: 7975 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.917766:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8000/0x48868a4e439542de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35571d expref: 24 pid: 7975 timeout: 863 lvb_type: 1 00010000:00010000:2.0:1746129817.917780:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.917782:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.917862:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.917870:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.917878:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129817.917909:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054233728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 396us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.917916:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7551 00010000:00010000:2.0:1746129817.918052:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.918063:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053983744:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.918318:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.919575:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.919873:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053983744:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129817.919886:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.919911:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054233600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2379us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.919918:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7552 00000100:00100000:3.0:1746129817.920000:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054233984 00000100:00100000:3.0:1746129817.920004:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054233984 00002000:00100000:3.0:1746129817.920029:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2805760->2809855) req@ffff880094a4ed80 x1830949054233984/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.920036:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ed80 with x1830949054233984 ext(2805760->2809855) 00002000:00010000:3.0:1746129817.920040:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4ed80 00000100:00100000:3.0:1746129817.920051:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6755 00000100:00100000:3.0:1746129817.920056:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054233984:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129817.920147:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054233984:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 90us (576us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129817.920152:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6755 00002000:00100000:3.0:1746129817.920157:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2805760->2809855) req@ffff880094a4ed80 x1830949054233984/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.920162:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ed80 with x1830949054233984 ext(2805760->2809855) 00002000:00010000:3.0:1746129817.920165:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4ed80 00000100:00100000:1.0:1746129817.921097:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054233344:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 11537us (11936us total) trans 21474841268 rc 0/0 00000100:00100000:1.0:1746129817.921105:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1829 00002000:00100000:1.0:1746129817.921111:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (192512->983039) req@ffff880094a4c000 x1830949054233344/t21474841268(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/448 e 0 to 0 dl 1746129828 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.921118:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c000 with x1830949054233344 ext(192512->983039) 00010000:00010000:1.0:1746129817.921124:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746129817.921136:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746129817.921146:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a4c000 00000100:00100000:0.0:1746129817.927880:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.927976:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.928120:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054234240 00000100:00100000:2.0:1746129817.928127:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054234240 00010000:00010000:2.0:1746129817.928156:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:2.0:1746129817.928192:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7553 00000100:00100000:2.0:1746129817.928198:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054234240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129817.928210:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.928227:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.928238:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.928257:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a3de800/0x48868a4e4395432b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 192512->983039) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355732 expref: 19 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.928285:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.928287:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.928293:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.928300:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.928327:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.928338:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053983872:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129817.928402:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.928878:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054234112 00000100:00100000:3.0:1746129817.928883:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054234112 00000100:00100000:3.0:1746129817.928917:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15183 00000100:00100000:3.0:1746129817.928924:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31433:x1830949054234112:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.928935:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.928946:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355755 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.928962:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.928970:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.928976:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.928977:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.928980:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3809279] (req 3145728->3809279) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.928996:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.929004:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.929012:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053984000:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.929077:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.929096:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 12 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.929103:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053984128:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.929119:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.932286:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053984000:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.933518:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053983872:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.933529:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053984128:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129817.933536:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129817.933547:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3809279] (req 3145728->3809279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.933562:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4f000, rc 0) 00000100:00100000:2.0:1746129817.933584:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054234240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5385us (5607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.933585:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31433:x1830949054234112:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4663us (5746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.933592:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15183 00000100:00100000:2.0:1746129817.933593:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7553 00000100:00100000:0.0:1746129817.937067:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.937116:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.937206:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054234624 00000100:00100000:1.0:1746129817.937206:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054234496 00000100:00100000:2.0:1746129817.937213:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054234624 00000100:00100000:1.0:1746129817.937213:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054234496 00010000:00010000:2.0:1746129817.937241:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 13 pid: 1877 timeout: 863 lvb_type: 0 00002000:00100000:1.0:1746129817.937247:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880094a4f480 x1830949054234496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.937256:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4f480 with x1830949054234496 ext(0->1048575) 00002000:00010000:1.0:1746129817.937260:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4f480 00000100:00100000:2.0:1746129817.937265:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7554 00000100:00100000:2.0:1746129817.937272:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054234624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129817.937275:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6756 00000100:00100000:1.0:1746129817.937280:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054234496:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:2.0:1746129817.937282:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129817.937300:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 13 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.937309:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 13 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.937327:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd52200/0x48868a4e439542c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355701 expref: 13 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:2.0:1746129817.937351:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129817.937617:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054234624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 344us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.937626:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7554 00000100:00100000:0.0:1746129817.940253:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.940377:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054234752 00000100:00100000:3.0:1746129817.940383:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054234752 00010000:00010000:3.0:1746129817.940406:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00000100:00100000:3.0:1746129817.940945:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7555 00000100:00100000:3.0:1746129817.940954:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054234752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.940969:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.940988:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.940999:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.941019:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f600/0x48868a4e439542c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355708 expref: 18 pid: 1877 timeout: 863 lvb_type: 0 00010000:00010000:3.0:1746129817.941669:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.941673:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.941680:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.941688:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.941718:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129817.941729:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053984256:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129817.942092:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.946406:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053984256:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129817.946425:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.946461:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054234752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5508us (6215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.946471:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7555 00000100:00100000:1.0:1746129817.946564:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054234496:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9282us (9745us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.946572:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6756 00002000:00100000:1.0:1746129817.946581:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880094a4f480 x1830949054234496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.946590:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4f480 with x1830949054234496 ext(0->1048575) 00002000:00010000:1.0:1746129817.946594:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4f480 00000100:00100000:0.0:1746129817.952925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.953033:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054235008 00000100:00100000:1.0:1746129817.953041:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054235008 00002000:00100000:1.0:1746129817.953074:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3805184->3809279) req@ffff880094a4dc00 x1830949054235008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.953089:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4dc00 with x1830949054235008 ext(3805184->3809279) 00002000:00010000:1.0:1746129817.953094:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4dc00 00000100:00100000:1.0:1746129817.953474:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6757 00000100:00100000:1.0:1746129817.953485:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054235008:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129817.953713:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054235008:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 228us (795us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129817.953719:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6757 00002000:00100000:1.0:1746129817.953724:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3805184->3809279) req@ffff880094a4dc00 x1830949054235008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/4536 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.953732:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4dc00 with x1830949054235008 ext(3805184->3809279) 00002000:00010000:1.0:1746129817.953735:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4dc00 00000100:00100000:0.0:1746129817.960122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.960223:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054235136 00000100:00100000:2.0:1746129817.960231:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054235136 00000100:00100000:2.0:1746129817.960711:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10951 00000100:00100000:2.0:1746129817.960722:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31442:x1830949054235136:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129817.960779:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.960795:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e43954371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35575c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.960844:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.960929:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.960941:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.960953:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.960958:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.960963:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.961045:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.961053:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.961060:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.961083:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.961092:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 286 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129817.961102:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053984384:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129817.961247:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129817.966277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.966435:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054235904 00000100:00100000:3.0:1746129817.966444:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054235904 00000100:00100000:1.0:1746129817.966444:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.966475:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.966480:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10952 00000100:00100000:3.0:1746129817.966486:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31443:x1830949054235904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129817.966504:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.966517:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78400/0x48868a4e4395438d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355763 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.966613:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966623:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966631:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966642:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966648:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966653:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966726:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543a2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966733:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966738:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543a2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129817.966748:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.966803:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966808:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966813:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966817:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa78800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.966820:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966824:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966832:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129817.966834:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.966837:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966841:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e43954394 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966870:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966875:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966878:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129817.966883:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053984384:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.966886:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129817.966887:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966891:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966896:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02700) 00010000:00010000:3.0:1746129817.966898:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129817.966900:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129817.966904:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395439b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129817.966918:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129817.966918:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054235392 00000100:00100000:0.0:1746129817.966921:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054235392 00000100:00100000:2.0:1746129817.966932:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054235648 00000100:00100000:2.0:1746129817.966934:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054235648 00010000:00010000:3.0:1746129817.966935:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78400/0x48868a4e4395438d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355763 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.966946:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355763 expref: 290 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129817.966947:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4557 00010000:00010000:3.0:1746129817.966951:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00000100:00100000:0.0:1746129817.966951:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31433:x1830949054235392:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:3.0:1746129817.966953:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00000100:00100000:2.0:1746129817.966953:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4558 00010000:00010000:3.0:1746129817.966955:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129817.966957:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:23993:x1830949054235648:12345-192.168.204.31@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746129817.966959:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.966963:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79a00, rc 0) 00000100:00100000:3.0:1746129817.966998:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31443:x1830949054235904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 513us (728us total) trans 8589944937 rc 0/0 00000100:00100000:3.0:1746129817.967004:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10952 00000100:00100000:0.0:1746129817.967041:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31433:x1830949054235392:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 89us (596us total) trans 8589944938 rc 0/0 00000100:00100000:0.0:1746129817.967046:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4557 00000100:00100000:2.0:1746129817.967315:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:23993:x1830949054235648:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 357us (839us total) trans 8589944939 rc 0/0 00000100:00100000:2.0:1746129817.967320:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4558 00000100:00100000:0.0:1746129817.968588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.968635:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054236032 00000100:00100000:3.0:1746129817.968640:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054236032 00010000:00010000:3.0:1746129817.968655:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 290 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129817.968684:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7556 00000100:00100000:3.0:1746129817.968689:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:1964:x1830949054236032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.968697:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.968701:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 290 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129817.968710:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 290 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129817.968722:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094335000/0x48868a4e4395424b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355691 expref: 290 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129817.968730:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.968734:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.968740:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.968744:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.968761:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.968786:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1964:x1830949054236032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.968791:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7556 00010000:00010000:2.0:1746129817.968960:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.968967:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129817.968992:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129817.968996:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129817.969005:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969011:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969018:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969022:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969026:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969030:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3de200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.969033:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969037:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969044:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129817.969046:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.969048:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969052:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de200/0x48868a4e43954378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969060:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969064:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969067:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969071:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012a3de800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129817.969073:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969076:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969080:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02700) 00010000:00010000:2.0:1746129817.969081:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129817.969083:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969086:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de800/0x48868a4e4395437f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129817.969107:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012a3de600/0x48868a4e43954371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.969115:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.969120:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129817.969122:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129817.969124:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c90000, rc 0) 00000100:00100000:2.0:1746129817.969156:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31442:x1830949054235136:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 8436us (9041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.969163:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10951 00000100:00100000:0.0:1746129817.969733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.969905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.969928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.969959:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.970038:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054236288 00000100:00100000:2.0:1746129817.970042:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054236288 00000100:00100000:3.0:1746129817.970103:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054236160 00000100:00100000:3.0:1746129817.970108:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054236160 00000100:00100000:2.0:1746129817.970110:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054236544 00000100:00100000:2.0:1746129817.970113:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054236544 00000100:00100000:1.0:1746129817.970143:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054236416 00000100:00100000:1.0:1746129817.970146:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054236416 00000100:00100000:3.0:1746129817.970149:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15184 00000100:00100000:3.0:1746129817.970156:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054236288:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129817.970163:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15185 00010000:00010000:3.0:1746129817.970168:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129817.970169:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054236544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129817.970189:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.970198:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35576a expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129817.970198:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e439543b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355778 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.970211:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.970213:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129817.970220:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129817.970232:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053984512:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129817.970233:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.970241:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79800, rc 0) 00000100:00100000:1.0:1746129817.970275:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.970343:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054236288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 187us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129817.970516:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15186 00000100:00100000:3.0:1746129817.970523:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15184 00000100:00100000:1.0:1746129817.970524:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054236416:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129817.970559:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 725 00000100:00100000:3.0:1746129817.970563:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:1961:x1830949054236160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.970570:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.970581:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355763 expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.970591:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.970593:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.970606:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1961:x1830949054236160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.970611:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 725 00010000:00010000:1.0:1746129817.970683:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129817.970690:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e439543be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355771 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129817.970714:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053984640:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129817.970736:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129817.970865:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.971301:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.971326:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.971352:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.971359:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054236928 00000100:00100000:3.0:1746129817.971363:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054236928 00002000:00100000:3.0:1746129817.971383:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ba1aa00 x1830949054236928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.971391:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1aa00 with x1830949054236928 ext(2097152->3145727) 00002000:00010000:3.0:1746129817.971394:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1aa00 00000100:00100000:2.0:1746129817.971397:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054237056 00000100:00100000:2.0:1746129817.971401:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054237056 00000100:00100000:3.0:1746129817.971404:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054237440 00000100:00100000:3.0:1746129817.971406:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054237440 00000100:00100000:0.0:1746129817.971407:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054237312 00000100:00100000:0.0:1746129817.971409:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054237312 00002000:00100000:3.0:1746129817.971416:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3485696->4194303) req@ffff88012ba1a680 x1830949054237440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.971417:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3809280->4194303) req@ffff88012ba19c00 x1830949054237056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129817.971419:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3485695) req@ffff880092adb480 x1830949054237312/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 504/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.971423:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19c00 with x1830949054237056 ext(3809280->4194303) 00002000:00100000:0.0:1746129817.971425:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb480 with x1830949054237312 ext(2097152->3485695) 00002000:00010000:2.0:1746129817.971426:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19c00 00002000:00100000:3.0:1746129817.971427:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a680 with x1830949054237440 ext(3485696->4194303) 00002000:00010000:0.0:1746129817.971428:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adb480 00002000:00010000:3.0:1746129817.971429:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1a680 00000100:00100000:0.0:1746129817.971442:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6758 00000100:00100000:3.0:1746129817.971445:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6759 00000100:00100000:0.0:1746129817.971447:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054236928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.971452:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054237056:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129817.971455:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6760 00000100:00100000:2.0:1746129817.971461:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054237312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.971487:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6761 00000100:00100000:3.0:1746129817.971491:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054237440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129817.974433:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.974457:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054237696 00000100:00100000:0.0:1746129817.974462:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054237696 00000100:00100000:0.0:1746129817.974503:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15187 00000100:00100000:0.0:1746129817.974511:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054237696:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129817.974524:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129817.974537:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35577f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.974555:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.974557:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.974564:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129817.974577:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129817.974590:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9d200, rc 0) 00000100:00100000:0.0:1746129817.974621:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054237696:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 111us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.974626:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15187 00000100:00100000:2.0:1746129817.975127:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949053984640:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129817.975140:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053984512:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129817.975151:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e439543be lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355771 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.975156:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e439543b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355778 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.975162:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1abc00/0x48868a4e439543be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355771 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129817.975165:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e439543b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355778 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.975170:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1abc00, rc 0) 00000100:00100000:2.0:1746129817.975205:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054236416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4682us (5244us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129817.975211:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15186 00010000:00010000:1.0:1746129817.975675:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa200, rc 0) 00000100:00100000:1.0:1746129817.975694:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054236544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5525us (5765us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129817.975700:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15185 00000100:00100000:1.0:1746129817.975730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.975760:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054237824 00000100:00100000:1.0:1746129817.975763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.975765:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054237824 00000100:00100000:2.0:1746129817.976009:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054238080 00000100:00100000:2.0:1746129817.976012:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054238080 00000100:00100000:0.0:1746129817.976018:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15188 00000100:00100000:0.0:1746129817.976025:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054237824:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129817.976026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.976027:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15189 00000100:00100000:2.0:1746129817.976032:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054238080:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129817.976033:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.976039:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129817.976040:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355786 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.976048:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355794 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.976052:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.976054:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.976057:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129817.976058:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.976059:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.976063:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129817.976069:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.976073:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 10 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129817.976076:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8feda00, rc 0) 00010000:00010000:2.0:1746129817.976079:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b530a200, rc 0) 00000100:00100000:0.0:1746129817.976092:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054237824:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 68us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.976097:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054238080:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 64us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129817.976097:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15188 00000100:00100000:1.0:1746129817.976099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.976102:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15189 00000100:00100000:2.0:1746129817.976156:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054237952 00000100:00100000:0.0:1746129817.976156:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054238336 00000100:00100000:2.0:1746129817.976159:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054237952 00000100:00100000:0.0:1746129817.976159:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054238336 00000100:00100000:2.0:1746129817.976185:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15190 00000100:00100000:2.0:1746129817.976190:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054237952:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:0.0:1746129817.976193:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15191 00000100:00100000:1.0:1746129817.976195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129817.976196:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129817.976198:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054238336:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129817.976203:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35578d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129817.976204:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129817.976209:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec800/0x48868a4e439543e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557a2 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129817.976216:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.976217:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129817.976220:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.976228:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129817.976235:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b530a800, rc 0) 00000100:00100000:0.0:1746129817.976238:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053984768:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129817.976258:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054238208 00000100:00100000:3.0:1746129817.976262:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054238208 00000100:00100000:2.0:1746129817.976264:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054237952:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129817.976269:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15190 00000100:00100000:2.0:1746129817.976279:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15192 00000100:00100000:0.0:1746129817.976280:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129817.976283:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054238208:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129817.976288:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129817.976292:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b530b000/0x48868a4e439543e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35579b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.976311:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053984896:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129817.976329:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.981370:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054237440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9868us (10033us total) trans 0 rc 708608/708608 00000100:00100000:3.0:1746129817.981381:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6761 00002000:00100000:3.0:1746129817.981390:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3485696->4194303) req@ffff88012ba1a680 x1830949054237440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 708608/708608 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.981399:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1a680 with x1830949054237440 ext(3485696->4194303) 00002000:00010000:3.0:1746129817.981403:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1a680 00000100:00100000:3.0:1746129817.983064:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054237056:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11606us (11763us total) trans 0 rc 385024/385024 00000100:00100000:3.0:1746129817.983073:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6759 00002000:00100000:3.0:1746129817.983080:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3809280->4194303) req@ffff88012ba19c00 x1830949054237056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 385024/385024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129817.983089:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19c00 with x1830949054237056 ext(3809280->4194303) 00002000:00010000:3.0:1746129817.983103:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19c00 00000100:00100000:1.0:1746129817.983475:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054236928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12027us (12609us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129817.983485:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6758 00002000:00100000:1.0:1746129817.983490:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ba1aa00 x1830949054236928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129817.983497:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1aa00 with x1830949054236928 ext(2097152->3145727) 00002000:00010000:1.0:1746129817.983500:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1aa00 00000100:00100000:2.0:1746129817.983734:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053984768:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129817.983762:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec800/0x48868a4e439543e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557a2 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129817.983767:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053984896:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129817.983779:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fec800/0x48868a4e439543e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557a2 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.983781:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b530b000/0x48868a4e439543e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35579b expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.983789:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b530b000/0x48868a4e439543e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35579b expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129817.983799:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b530b000, rc 0) 00010000:00010000:2.0:1746129817.983800:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fec800, rc 0) 00000100:00100000:3.0:1746129817.983828:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054238208:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7543us (7631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129817.983834:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15192 00000100:00100000:2.0:1746129817.984028:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054238336:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7828us (8000us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129817.984033:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15191 00000100:00100000:2.0:1746129817.984931:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054237312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13468us (13575us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.984938:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6760 00002000:00100000:2.0:1746129817.984945:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3485695) req@ffff880092adb480 x1830949054237312/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 504/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.984952:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb480 with x1830949054237312 ext(2097152->3485695) 00002000:00010000:2.0:1746129817.984956:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adb480 00000100:00100000:0.0:1746129817.986673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129817.987752:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.987933:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054238592 00000100:00100000:2.0:1746129817.987941:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054238592 00002000:00100000:2.0:1746129817.987975:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012b8e4700 x1830949054238592/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.987983:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4700 with x1830949054238592 ext(0->1048575) 00002000:00010000:2.0:1746129817.987987:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e4700 00000100:00100000:2.0:1746129817.988005:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6762 00000100:00100000:3.0:1746129817.988009:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054238848 00000100:00100000:2.0:1746129817.988011:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949054238592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129817.988013:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054238848 00000100:00100000:3.0:1746129817.988036:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10953 00000100:00100000:3.0:1746129817.988040:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31442:x1830949054238848:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129817.988049:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.988065:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e439543ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557a9 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.988132:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.988145:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.988152:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.988185:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.988194:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 8 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129817.988204:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053985024:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129817.988262:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129817.993893:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053985024:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129817.993914:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129817.994466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.994655:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054238976 00000100:00100000:3.0:1746129817.994660:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054238976 00010000:00010000:3.0:1746129817.994683:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 9 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129817.994716:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7557 00000100:00100000:3.0:1746129817.994722:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054238976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129817.994737:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129817.994742:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 9 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129817.994753:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 9 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129817.994772:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c90000/0x48868a4e43954386 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35575c expref: 9 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129817.994795:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.994799:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.994808:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.994814:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.994827:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129817.994982:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054238976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 259us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129817.994989:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7557 00010000:00010000:3.0:1746129817.995009:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.995015:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129817.995317:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.995423:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e439543ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557a9 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.995435:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557a9 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.995440:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.995442:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129817.995444:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79a00, rc 0) 00000100:00100000:3.0:1746129817.995465:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31442:x1830949054238848:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7424us (7716us total) trans 8589944940 rc 0/0 00000100:00100000:3.0:1746129817.995470:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10953 00000100:00100000:2.0:1746129817.995789:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949054238592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7777us (9121us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129817.995797:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6762 00002000:00100000:2.0:1746129817.995805:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012b8e4700 x1830949054238592/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.995813:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4700 with x1830949054238592 ext(0->1048575) 00002000:00010000:2.0:1746129817.995816:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e4700 00000100:00100000:1.0:1746129817.998581:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129817.998615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129817.998692:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054239488 00000100:00100000:2.0:1746129817.998700:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054239488 00002000:00100000:2.0:1746129817.998734:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880094d8df80 x1830949054239488/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/0 e 0 to 0 dl 1746129828 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129817.998743:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8df80 with x1830949054239488 ext(4194304->4931583) 00002000:00010000:2.0:1746129817.998747:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8df80 00000100:00100000:3.0:1746129817.998841:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054239232 00000100:00100000:3.0:1746129817.998871:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054239232 00000100:00100000:3.0:1746129817.998895:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10954 00000100:00100000:3.0:1746129817.998902:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31442:x1830949054239232:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129817.998917:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.998920:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129817.998939:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79a00/0x48868a4e439543f6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557a9 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.998951:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.998955:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129817.998963:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78400/0x48868a4e43954404 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557b0 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129817.999125:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6763 00000100:00100000:2.0:1746129817.999131:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054239488:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129817.999440:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.999451:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129817.999459:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129817.999467:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129817.999811:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78400/0x48868a4e43954404 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.999822:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129817.999828:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129817.999830:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129817.999832:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78800, rc 0) 00000100:00100000:0.0:1746129817.999885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129817.999887:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31442:x1830949054239232:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 986us (1315us total) trans 8589944941 rc 0/0 00000100:00100000:3.0:1746129817.999893:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10954 00000100:00100000:3.0:1746129817.999908:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054239744 00000100:00100000:3.0:1746129817.999911:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054239744 00000100:00100000:3.0:1746129817.999932:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10955 00000100:00100000:3.0:1746129817.999937:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31446:x1830949054239744:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129817.999950:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129817.999957:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43954419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557b7 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.000005:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000011:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000016:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000024:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000029:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000034:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000100:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000107:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.000113:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.000135:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.000149:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 8 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.000158:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053985152:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.000210:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.004427:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053985152:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.004447:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.004497:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.004655:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054239872 00000100:00100000:3.0:1746129818.004661:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054239872 00000100:00080000:3.0:1746129818.004680:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129818.004718:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10956 00000100:00100000:3.0:1746129818.004724:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31442:x1830949054239872:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129818.004750:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.004813:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240000 00000100:00100000:2.0:1746129818.004816:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240000 00010000:00010000:3.0:1746129818.004838:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129818.004859:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15193 00000100:00080000:3.0:1746129818.004865:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746129818.004866:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054240000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.004873:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.004881:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e43954435 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557be expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.004882:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130efb000/0x48868a4e4395443c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557c5 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.004918:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985280:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129818.004921:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e43954435 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557be expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.004931:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e43954435 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557be expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.004944:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.004947:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129818.004949:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78600, rc 0) 00000100:00100000:3.0:1746129818.004970:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31442:x1830949054239872:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 246us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.004973:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.004975:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10956 00000100:00100000:2.0:1746129818.005720:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054239488:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6586us (7102us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129818.005728:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6763 00002000:00100000:2.0:1746129818.005735:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880094d8df80 x1830949054239488/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:558/0 lens 488/440 e 0 to 0 dl 1746129828 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.005743:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8df80 with x1830949054239488 ext(4194304->4931583) 00002000:00010000:2.0:1746129818.005746:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8df80 00000100:00100000:1.0:1746129818.005928:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.005961:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.005964:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240128 00000100:00100000:3.0:1746129818.005967:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240128 00000100:00100000:3.0:1746129818.006108:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15194 00000100:00100000:3.0:1746129818.006113:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054240128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.006121:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.006130:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e43954443 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557cc expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.006154:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053985408:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.006196:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.006207:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240256 00000100:00100000:3.0:1746129818.006209:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240256 00010000:00010000:3.0:1746129818.006221:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 10 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.006241:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7558 00000100:00100000:3.0:1746129818.006245:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054240256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.006252:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.006257:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 10 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.006265:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 10 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.006278:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78800/0x48868a4e4395440b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b0 expref: 10 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.006289:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.006292:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.006298:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.006303:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.006315:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746129818.006601:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129818.007196:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054240256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 948us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.007203:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7558 00010000:00010000:3.0:1746129818.007225:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007231:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129818.007243:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129818.007317:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007323:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007328:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007333:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.007336:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007342:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007349:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.007352:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129818.007354:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007359:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79200/0x48868a4e4395442e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007369:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007374:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007379:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007382:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.007384:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007388:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007393:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129818.007395:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.007397:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007401:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79e00/0x48868a4e43954420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007407:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007410:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007415:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007418:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa78000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.007420:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007424:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007427:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29ad00) 00010000:00010000:3.0:1746129818.007429:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.007431:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007434:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e43954427 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.007465:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43954419 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b7 expref: 290 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.007472:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43954419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557b7 expref: 290 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.007478:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78e00, rc 0) 00000100:00100000:2.0:1746129818.008343:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985280:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.008360:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130efb000/0x48868a4e4395443c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557c5 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008370:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130efb000/0x48868a4e4395443c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557c5 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008384:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130efb000, rc 0) 00000100:00100000:2.0:1746129818.008401:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054240000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3536us (3651us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.008406:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15193 00000100:00100000:2.0:1746129818.008433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.008444:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240384 00000100:00100000:2.0:1746129818.008448:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240384 00000100:00100000:2.0:1746129818.008466:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15195 00000100:00100000:2.0:1746129818.008472:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054240384:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129818.008493:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008505:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008512:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008518:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008525:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.008526:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.008528:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008547:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008556:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 17 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.008566:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985536:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.008603:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008609:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 10 pid: 3624 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.008615:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985664:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.008634:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008640:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 10 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.008645:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985792:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.008656:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.008685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.008694:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240512 00000100:00100000:2.0:1746129818.008696:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240512 00000100:00100000:2.0:1746129818.008717:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15196 00000100:00100000:2.0:1746129818.008721:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054240512:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129818.008735:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008744:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008750:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.008755:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008759:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.008761:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.008762:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008774:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.008780:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.008787:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053985920:192.168.204.31@tcp:104: 00000100:00080000:0.0:1746129818.008832:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129818.009120:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31446:x1830949054239744:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9180us (9233us total) trans 8589944942 rc 301/301 00000100:00100000:3.0:1746129818.009126:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10955 00010000:00010000:2.0:1746129818.012043:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.012057:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 10 pid: 3624 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.012063:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949053985408:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.012069:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053986048:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.012088:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e43954443 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557cc expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.012099:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa79c00/0x48868a4e43954443 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557cc expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.012107:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79c00, rc 0) 00000100:00100000:3.0:1746129818.012335:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054240128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6220us (6405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129818.012342:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15194 00000100:00100000:2.0:1746129818.012345:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985536:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.012353:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985664:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.012360:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949053985792:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.012375:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.012413:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.012421:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 11 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.012429:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053986176:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.012445:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.016097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.016137:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.016163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.016205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.016219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.016719:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.016763:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240640 00000100:00100000:2.0:1746129818.016763:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240768 00000100:00100000:1.0:1746129818.016763:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241024 00000100:00100000:3.0:1746129818.016769:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240640 00000100:00100000:2.0:1746129818.016769:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240768 00000100:00100000:1.0:1746129818.016769:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241024 00000100:00100000:3.0:1746129818.016798:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241152 00000100:00100000:3.0:1746129818.016800:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241152 00000100:00100000:2.0:1746129818.016804:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15197 00000100:00100000:1.0:1746129818.016808:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15198 00000100:00100000:2.0:1746129818.016810:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054240640:12345-192.168.204.31@tcp:1:mirror_io.0 00000100:00100000:1.0:1746129818.016812:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054240768:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129818.016844:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.016844:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.016872:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.016872:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.016879:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.016879:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.016885:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.016886:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.016890:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.016891:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.016892:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.016892:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.016895:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.016895:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.016917:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.016917:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 11 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.016926:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.016926:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 11 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.016936:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053986432:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.016936:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053986304:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.016990:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.016997:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 12 pid: 7975 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.017004:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15199 00000100:00100000:1.0:1746129818.017004:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053986560:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.017009:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054241024:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129818.017013:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15200 00010000:00010000:2.0:1746129818.017017:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129818.017019:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054241152:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129818.017022:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017025:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e4395446d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557d3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.017029:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.017035:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017035:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129818.017040:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053986688:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.017041:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e4395446d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557d3 expref: 12 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.017045:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017049:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbd800/0x48868a4e4395446d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557d3 expref: 12 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.017051:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.017053:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746129818.017053:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00010000:00010000:3.0:1746129818.017055:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017057:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbd800, rc 0) 00010000:00010000:3.0:1746129818.017070:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.017074:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054241024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (940us total) trans 0 rc 301/301 00010000:00010000:3.0:1746129818.017078:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.017079:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15199 00000100:00100000:3.0:1746129818.017086:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053986816:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.017101:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 11 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129818.017108:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013065e9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129818.017110:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 11 pid: 7975 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.017122:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053986944:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.017124:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054240896 00000100:00100000:3.0:1746129818.017127:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054240896 00010000:00010000:3.0:1746129818.017141:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.017148:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017155:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 22 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.017161:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7559 00000100:00100000:2.0:1746129818.017162:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053987072:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.017166:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054240896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.017183:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129818.017187:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.017246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:0.0:1746129818.017247:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129818.017256:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241280 00000100:00100000:0.0:1746129818.017259:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241280 00000100:00100000:2.0:1746129818.017271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.017272:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.017279:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241536 00010000:00010000:3.0:1746129818.017281:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.017281:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241536 00000100:00100000:0.0:1746129818.017291:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15201 00010000:00010000:3.0:1746129818.017294:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439543c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35577f expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.017296:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15202 00000100:00100000:0.0:1746129818.017296:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054241280:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129818.017302:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.017302:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31446:x1830949054241536:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.017308:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.017310:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017314:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557da expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.017318:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054240896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 152us (1115us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129818.017319:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.017323:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7559 00010000:00010000:0.0:1746129818.017324:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129818.017325:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.017326:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.017327:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017328:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017338:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129818.017340:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.017341:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [1134592->1286143] (req 1134592->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.017347:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.017350:0:4589:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.017353:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241408 00000100:00100000:0.0:1746129818.017354:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053987200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.017355:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241408 00010000:00010000:2.0:1746129818.017359:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [1134592->1286143] (req 1134592->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017363:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 18 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.017366:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a38000, rc 0) 00000100:00100000:0.0:1746129818.017371:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.017376:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7560 00000100:00100000:3.0:1746129818.017380:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949054241408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129818.017381:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31446:x1830949054241536:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 80us (135us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.017385:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129818.017385:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15202 00010000:00010000:3.0:1746129818.017391:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 18 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.017398:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 18 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.017409:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa79800/0x48868a4e439543b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35576a expref: 18 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.017412:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053985920:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.017417:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129818.017419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.017420:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053986048:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.017426:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053986176:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.017430:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054241408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.017435:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7560 00000100:00100000:3.0:1746129818.017442:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241920 00000100:00100000:3.0:1746129818.017444:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241920 00000100:00100000:0.0:1746129818.017447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.017450:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.017458:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241664 00000100:00100000:3.0:1746129818.017460:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241664 00010000:00010000:3.0:1746129818.017466:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.017474:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7561 00000100:00100000:3.0:1746129818.017477:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054241920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.017482:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.017492:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.017499:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.017503:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7562 00010000:00010000:3.0:1746129818.017508:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27c00/0x48868a4e43954283 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c2 expref: 24 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.017508:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054241664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.017514:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.017516:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129818.017521:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.017527:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.017528:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054241920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.017535:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7561 00010000:00010000:1.0:1746129818.017537:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8400/0x48868a4e4395435c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355747 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.017546:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.017547:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.017551:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.017557:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.017569:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.017580:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054241664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (132us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.017582:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017588:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.017588:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7562 00010000:00010000:3.0:1746129818.017604:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017610:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017616:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017623:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130efb800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.017625:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017632:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017641:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.017647:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130efb800/0x48868a4e43954451 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.017674:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054240384:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 9202us (9240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.017679:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15195 00010000:00010000:2.0:1746129818.017763:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.018592:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.018658:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.018725:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242048 00000100:00100000:1.0:1746129818.018729:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242048 00000100:00100000:2.0:1746129818.018739:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054241792 00000100:00100000:2.0:1746129818.018743:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054241792 00010000:00010000:2.0:1746129818.018756:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.018757:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.018775:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7563 00000100:00100000:1.0:1746129818.018780:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054242048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.018787:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129818.018788:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7564 00000100:00100000:2.0:1746129818.018794:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054241792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.018795:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.018800:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.018803:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.018810:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.018815:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fca00/0x48868a4e4395427c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556bb expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.018818:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.018824:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.018831:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8feda00/0x48868a4e439543cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355786 expref: 13 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.018839:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.018840:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.018842:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.018845:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054242048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (254us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129818.018865:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.018871:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7563 00010000:00010000:2.0:1746129818.018879:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746129818.018917:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129818.019159:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054241792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 364us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.019166:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7564 00010000:00010000:2.0:1746129818.019191:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019198:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019212:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019218:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019224:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019229:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffbda00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129818.019232:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019238:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019246:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.019248:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.019252:0:1877:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019258:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.019281:0:1877:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.019481:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053987328:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.019526:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d510840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.021565:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053986816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.021565:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053987200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.021582:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.021582:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.021609:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.021643:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.021649:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242304 00000100:00100000:1.0:1746129818.021649:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053986304:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.021654:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242304 00000100:00100000:0.0:1746129818.021657:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.021675:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 11 pid: 7975 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.021682:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.021950:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053986432:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.021960:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053986944:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.022870:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136319500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053986560:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.022884:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949053986688:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.022902:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.022906:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242688 00000100:00100000:3.0:1746129818.022909:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242688 00000100:00100000:1.0:1746129818.022919:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242176 00000100:00100000:1.0:1746129818.022921:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242176 00010000:00010000:3.0:1746129818.022923:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.022934:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 12 pid: 7975 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.022937:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242432 00000100:00100000:3.0:1746129818.022939:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242432 00000100:00100000:1.0:1746129818.022948:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7565 00010000:00010000:3.0:1746129818.022949:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.022954:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054242304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129818.022959:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7566 00000100:00100000:3.0:1746129818.022964:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054242688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.022966:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.022971:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.022983:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.022984:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 11 pid: 7975 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.022991:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.023004:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 11 pid: 7975 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.023021:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b530a200/0x48868a4e439543d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355794 expref: 11 pid: 7975 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.023037:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd53800/0x48868a4e4395429f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556de expref: 17 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.023037:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129818.023045:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.023072:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949054242688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (1428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.023072:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054242304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 118us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.023078:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7565 00000100:00100000:3.0:1746129818.023082:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7566 00000100:00100000:2.0:1746129818.023093:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7567 00000100:00100000:1.0:1746129818.023097:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7568 00000100:00100000:2.0:1746129818.023100:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054242176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129818.023102:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054242432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.023109:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.023111:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.023120:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.023122:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 12 pid: 7975 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.023127:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.023137:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 12 pid: 7975 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.023150:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43954291 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556d0 expref: 11 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.023156:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b530a800/0x48868a4e439543da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35578d expref: 12 pid: 7975 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.023159:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.023165:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.023182:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054242432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.023187:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7568 00000100:00100000:2.0:1746129818.023196:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054242176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.023202:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7567 00000100:00100000:0.0:1746129818.023212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.023255:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242560 00000100:00100000:3.0:1746129818.023258:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242560 00002000:00100000:3.0:1746129818.023280:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3809279) req@ffff88012d637100 x1830949054242560/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.023288:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637100 with x1830949054242560 ext(3145728->3809279) 00010000:00010000:3.0:1746129818.023293:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 10 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.023301:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 10 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.023306:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d637100 00000100:00100000:3.0:1746129818.023330:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1830 00000100:00100000:3.0:1746129818.023336:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054242560:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129818.024340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.024771:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242816 00000100:00100000:2.0:1746129818.024775:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242816 00000100:00100000:2.0:1746129818.024803:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15203 00000100:00100000:2.0:1746129818.024809:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31443:x1830949054242816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.024817:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.024827:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557e1 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.024840:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.024843:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.024867:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129818.024870:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 17 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.024882:0:3624:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.024891:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 17 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.024899:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948ca800, rc 0) 00000100:00100000:2.0:1746129818.024922:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31443:x1830949054242816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.024926:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949053987072:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.024927:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15203 00010000:00010000:1.0:1746129818.024943:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.025094:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.025134:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.025162:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.025184:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054243200 00000100:00100000:1.0:1746129818.025187:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054243200 00000100:00100000:0.0:1746129818.025200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129818.025204:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2805760->3145727) req@ffff88012d636300 x1830949054243200/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.025211:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636300 with x1830949054243200 ext(2805760->3145727) 00010000:00010000:1.0:1746129818.025216:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 10 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.025224:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129818.025228:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 10 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746129818.025234:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d636300 00000100:00100000:1.0:1746129818.025244:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054243456 00000100:00100000:1.0:1746129818.025246:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054243456 00002000:00100000:1.0:1746129818.025256:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1134592->1138687) req@ffff8800a8fd1180 x1830949054243456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129818.025258:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1831 00002000:00100000:1.0:1746129818.025262:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1180 with x1830949054243456 ext(1134592->1138687) 00000100:00100000:0.0:1746129818.025263:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054243200:12345-192.168.204.31@tcp:4:cat.0 00002000:00010000:1.0:1746129818.025265:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd1180 00000100:00100000:1.0:1746129818.025274:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6764 00000100:00100000:1.0:1746129818.025278:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054243456:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.025375:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054243456:12345-192.168.204.31@tcp:3:cat.0 Request processed in 96us (174us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129818.025380:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6764 00002000:00100000:1.0:1746129818.025385:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1134592->1138687) req@ffff8800a8fd1180 x1830949054243456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.025390:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd1180 with x1830949054243456 ext(1134592->1138687) 00002000:00010000:1.0:1746129818.025393:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd1180 00000100:00100000:1.0:1746129818.025409:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054243072 00000100:00100000:1.0:1746129818.025411:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054243072 00010000:00010000:1.0:1746129818.025419:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 23 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.025427:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054243584 00000100:00100000:2.0:1746129818.025430:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054243584 00000100:00100000:1.0:1746129818.025434:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054242944 00000100:00100000:1.0:1746129818.025435:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054242944 00010000:00010000:1.0:1746129818.025442:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.025446:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15204 00000100:00100000:2.0:1746129818.025451:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31439:x1830949054243584:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129818.025453:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7569 00000100:00100000:1.0:1746129818.025456:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054243072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.025457:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.025462:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.025463:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557e8 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025471:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 23 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.025474:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.025476:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129818.025478:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [4927488->5242879] (req 4927488->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025478:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 23 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.025485:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [4927488->5242879] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 13 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025491:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8c27200/0x48868a4e4395428a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556c9 expref: 23 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.025492:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948cb800, rc 0) 00010000:00010000:1.0:1746129818.025499:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.025501:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.025504:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025510:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.025512:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31439:x1830949054243584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.025517:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15204 00010000:00010000:1.0:1746129818.025522:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.025533:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7570 00000100:00100000:1.0:1746129818.025534:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054243072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.025538:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054242944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129818.025540:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7569 00010000:00010000:2.0:1746129818.025545:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.025553:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025556:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.025560:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025564:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.025574:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025578:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013067c200/0x48868a4e439542a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556e5 expref: 12 pid: 10930 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.025581:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025585:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.025586:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.025587:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025589:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025593:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5245200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129818.025595:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025595:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025601:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025607:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129818.025609:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.025613:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.025618:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5245200/0x48868a4e43954466 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.025619:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.025625:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054242944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.025630:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7570 00010000:00010000:0.0:1746129818.025632:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.025636:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.025642:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.025650:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054240640:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 8841us (9559us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129818.025650:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0ea800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129818.025652:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.025654:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053987328:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129818.025655:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15197 00010000:00010000:0.0:1746129818.025657:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.025665:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025669:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.025670:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e4395445f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.025674:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ffbda00/0x48868a4e43954458 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.025699:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054240512:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 16978us (17014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.025704:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15196 00000100:00100000:0.0:1746129818.025839:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054240768:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 9026us (9675us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.025881:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15198 00000100:00100000:2.0:1746129818.028269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.028442:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054243840 00000100:00100000:3.0:1746129818.028452:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054243840 00002000:00100000:3.0:1746129818.028483:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1282048->1286143) req@ffff88009f6a4000 x1830949054243840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.028491:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4000 with x1830949054243840 ext(1282048->1286143) 00002000:00010000:3.0:1746129818.028496:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4000 00000100:00100000:3.0:1746129818.028561:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6765 00000100:00100000:3.0:1746129818.028569:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054243840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.028763:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054243840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 194us (498us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129818.028769:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6765 00002000:00100000:3.0:1746129818.028774:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1282048->1286143) req@ffff88009f6a4000 x1830949054243840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.028779:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4000 with x1830949054243840 ext(1282048->1286143) 00002000:00010000:3.0:1746129818.028782:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4000 00000100:00100000:1.0:1746129818.029554:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054243200:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4289us (4390us total) trans 17179874077 rc 0/0 00000100:00100000:1.0:1746129818.029562:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1831 00002000:00100000:1.0:1746129818.029567:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2805760->3145727) req@ffff88012d636300 x1830949054243200/t17179874077(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.029574:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636300 with x1830949054243200 ext(2805760->3145727) 00010000:00010000:1.0:1746129818.029582:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.029593:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746129818.029598:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d636300 00000100:00100000:0.0:1746129818.030900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.031018:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244096 00000100:00100000:3.0:1746129818.031023:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244096 00000100:00100000:3.0:1746129818.031079:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4559 00000100:00100000:3.0:1746129818.031085:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31446:x1830949054244096:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129818.031248:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31446:x1830949054244096:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 162us (350us total) trans 8589944943 rc 0/0 00000100:00100000:3.0:1746129818.031253:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4559 00000100:00080000:0.0:1746129818.031307:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129818.034168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.034267:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244224 00000100:00100000:1.0:1746129818.034275:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244224 00010000:00010000:1.0:1746129818.034307:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.034343:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7571 00000100:00100000:1.0:1746129818.034350:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054244224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.034361:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.034377:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.034386:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.034404:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4fc00/0x48868a4e43954363 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2805760->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35574e expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.034417:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.034419:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.034423:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.034429:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.034447:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.034477:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054244224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 127us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.034482:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7571 00010000:00010000:0.0:1746129818.036972:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.036983:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037005:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037015:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037022:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037027:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b66000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129818.037031:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037038:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037049:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.037055:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b66000/0x48868a4e4395447b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.037132:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054241280:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 19832us (20410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.037140:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15201 00000100:00100000:3.0:1746129818.037874:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054242560:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14536us (14660us total) trans 21474841269 rc 0/0 00000100:00100000:3.0:1746129818.037885:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1830 00002000:00100000:3.0:1746129818.037893:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3809279) req@ffff88012d637100 x1830949054242560/t21474841269(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.037901:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637100 with x1830949054242560 ext(3145728->3809279) 00010000:00010000:3.0:1746129818.037909:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.037920:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.037927:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d637100 00000100:00100000:0.0:1746129818.042540:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.042632:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244352 00000100:00100000:2.0:1746129818.042641:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244352 00010000:00010000:2.0:1746129818.042669:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.042707:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7572 00000100:00100000:2.0:1746129818.042714:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054244352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.042725:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.042743:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.042754:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.042773:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e4395436a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3809279) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355755 expref: 12 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.042788:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.042790:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.042794:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.042801:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.043133:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.043242:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054244352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 527us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.043249:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7572 00010000:00010000:3.0:1746129818.043306:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043314:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043331:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043337:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043343:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043352:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c90000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.043354:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043360:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043368:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.043369:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.043374:0:7975:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043379:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043384:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.043385:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.043388:0:7975:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043394:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.043417:0:7975:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 10 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.043427:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053987456:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129818.043492:0:7975:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 16 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.043500:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053987584:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129818.043863:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.048028:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.048057:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.048075:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244480 00000100:00100000:1.0:1746129818.048080:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244608 00000100:00100000:0.0:1746129818.048082:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244480 00000100:00100000:1.0:1746129818.048083:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244608 00000100:00100000:3.0:1746129818.048195:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053987456:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129818.048266:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15205 00000100:00100000:1.0:1746129818.048271:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15206 00000100:00100000:0.0:1746129818.048273:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054244480:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129818.048276:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054244608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.048286:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.048286:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.048298:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0ea600/0x48868a4e43954497 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557f6 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.048298:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557ef expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129818.048317:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d39a, atime: 0x6813d399, ctime: 0x6813d39a, blocks: 0x7e7 00010000:00010000:0.0:1746129818.048326:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.048328:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.048334:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.048348:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.048356:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67400, rc 0) 00000100:00100000:1.0:1746129818.048389:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053987712:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129818.048390:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054244480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.048394:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15205 00000100:00100000:0.0:1746129818.048421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.048433:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244736 00000100:00100000:0.0:1746129818.048435:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244736 00000100:00100000:1.0:1746129818.048440:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.048447:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15207 00000100:00100000:0.0:1746129818.048451:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054244736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129818.048456:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.048463:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3557fd expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129818.048480:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d399, atime: 0x6813d399, ctime: 0x6813d39a, blocks: 0x821 00010000:00010000:0.0:1746129818.048488:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.048489:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.048493:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.048501:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.048553:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67600, rc 0) 00000100:00100000:0.0:1746129818.048568:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054244736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 116us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.048572:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15207 00000100:00100000:0.0:1746129818.048616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.049020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.049709:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244864 00000100:00100000:2.0:1746129818.049713:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244864 00000100:00100000:2.0:1746129818.049729:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054244992 00000100:00100000:2.0:1746129818.049731:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054244992 00000100:00100000:2.0:1746129818.049752:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15208 00000100:00100000:1.0:1746129818.049752:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.049757:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054244864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.049764:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.049774:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355804 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129818.049787:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d399, atime: 0x6813d399, ctime: 0x6813d39a, blocks: 0x821 00010000:00010000:2.0:1746129818.049796:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.049797:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129818.049801:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15209 00010000:00010000:2.0:1746129818.049802:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129818.049807:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054244992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.049811:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.049812:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.049817:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffbda00, rc 0) 00010000:00010000:3.0:1746129818.049819:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35580b expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129818.049829:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d39a, atime: 0x6813d39a, ctime: 0x6813d39a, blocks: 0x1029 00010000:00010000:3.0:1746129818.049836:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.049837:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129818.049838:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054244864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 81us (1222us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.049840:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129818.049843:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15208 00010000:00010000:3.0:1746129818.049863:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.049870:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4f800, rc 0) 00000100:00100000:3.0:1746129818.049884:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054244992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 78us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.049888:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15209 00000100:00100000:3.0:1746129818.049910:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053987584:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129818.049926:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.049932:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c90000/0x48868a4e43954474 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.049967:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054241152:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 32948us (33746us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.049973:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15200 00000100:00100000:3.0:1746129818.049993:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054245248 00000100:00100000:3.0:1746129818.049995:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054245248 00002000:00100000:3.0:1746129818.050016:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880136319500 x1830949054245248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.050329:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319500 with x1830949054245248 ext(2097152->3145727) 00002000:00010000:3.0:1746129818.050334:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136319500 00000100:00100000:3.0:1746129818.050428:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6766 00000100:00100000:3.0:1746129818.050622:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054245248:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:1.0:1746129818.052866:0:1140:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129817 -> 1746129818 00002000:00010000:1.0:1746129818.052871:0:1140:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129817 -> 1746129818 00000100:00100000:1.0:1746129818.052888:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053987712:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129818.052912:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0ea600/0x48868a4e43954497 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557f6 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.052924:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0ea600/0x48868a4e43954497 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557f6 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.052941:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ea600, rc 0) 00000100:00100000:1.0:1746129818.052969:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054244608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4692us (4910us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129818.052976:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15206 00000100:00100000:0.0:1746129818.057380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.057759:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054245504 00000100:00100000:3.0:1746129818.057768:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054245504 00000100:00100000:3.0:1746129818.057803:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10957 00000100:00100000:3.0:1746129818.057810:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31442:x1830949054245504:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129818.057875:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.057896:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78600/0x48868a4e43954435 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557be expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.057927:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.057931:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.057976:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31442:x1830949054245504:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 166us (606us total) trans 0 rc -116/-116 00000100:00100000:2.0:1746129818.058540:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054245248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7918us (8786us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.058551:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6766 00002000:00100000:2.0:1746129818.058559:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880136319500 x1830949054245248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.058567:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319500 with x1830949054245248 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.058571:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136319500 00000100:00100000:3.0:1746129818.058614:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10957 00000100:00100000:0.0:1746129818.059676:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.059710:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054245760 00000100:00100000:2.0:1746129818.059714:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054245760 00002000:00100000:2.0:1746129818.059734:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff8800a01ba300 x1830949054245760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.059739:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01ba300 with x1830949054245760 ext(4927488->4931583) 00002000:00010000:2.0:1746129818.059741:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01ba300 00000100:00100000:2.0:1746129818.059758:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6767 00000100:00100000:2.0:1746129818.059762:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054245760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.059869:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054245760:12345-192.168.204.31@tcp:3:cat.0 Request processed in 106us (194us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129818.059873:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6767 00002000:00100000:2.0:1746129818.059876:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff8800a01ba300 x1830949054245760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.059880:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01ba300 with x1830949054245760 ext(4927488->4931583) 00002000:00010000:2.0:1746129818.059882:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01ba300 00000100:00100000:0.0:1746129818.060563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.060629:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054246016 00000100:00100000:2.0:1746129818.060633:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054246016 00000100:00100000:2.0:1746129818.060671:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4560 00000100:00100000:2.0:1746129818.060677:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31442:x1830949054246016:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129818.061092:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31442:x1830949054246016:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 414us (528us total) trans 8589944944 rc 0/0 00000100:00100000:2.0:1746129818.061099:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4560 00000100:00100000:0.0:1746129818.064070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.064124:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054246272 00000100:00100000:2.0:1746129818.064131:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054246272 00000100:00100000:2.0:1746129818.064185:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4561 00000100:00100000:2.0:1746129818.064193:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31439:x1830949054246272:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129818.064355:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31439:x1830949054246272:12345-192.168.204.31@tcp:35:cat.0 Request processed in 162us (290us total) trans 8589944945 rc 0/0 00000100:00100000:2.0:1746129818.064366:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4561 00000100:00100000:0.0:1746129818.065103:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.065185:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054246400 00000100:00100000:1.0:1746129818.065192:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054246400 00000100:00100000:1.0:1746129818.065228:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15210 00000100:00100000:1.0:1746129818.065234:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31443:x1830949054246400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.065243:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.065256:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355812 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.065274:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.065276:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.065282:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.065294:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.065303:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0eaa00, rc 0) 00000100:00100000:1.0:1746129818.065340:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31443:x1830949054246400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.065345:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15210 00000100:00100000:2.0:1746129818.065653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.065712:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054246656 00000100:00100000:0.0:1746129818.065715:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054246656 00000100:00100000:0.0:1746129818.065742:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4562 00000100:00100000:0.0:1746129818.065747:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31442:x1830949054246656:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:0.0:1746129818.065924:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31442:x1830949054246656:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 175us (270us total) trans 8589944946 rc 0/0 00000100:00100000:0.0:1746129818.065930:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4562 00000100:00100000:2.0:1746129818.073292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.073433:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.073466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.073688:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054246912 00000100:00100000:1.0:1746129818.073699:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054246912 00002000:00100000:1.0:1746129818.073735:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6a4380 x1830949054246912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.073743:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4380 with x1830949054246912 ext(2097152->3145727) 00002000:00010000:1.0:1746129818.073748:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4380 00000100:00100000:1.0:1746129818.073777:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054247168 00000100:00100000:1.0:1746129818.073780:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054247168 00000100:00100000:3.0:1746129818.073781:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054247424 00000100:00100000:3.0:1746129818.073785:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054247424 00002000:00100000:1.0:1746129818.073791:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6a7800 x1830949054247168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.073797:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949054247168 ext(3145728->4194303) 00002000:00010000:1.0:1746129818.073799:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7800 00002000:00100000:3.0:1746129818.073804:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f6a4700 x1830949054247424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.073812:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949054247424 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.073816:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4700 00000100:00100000:1.0:1746129818.073822:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6768 00000100:00100000:1.0:1746129818.073829:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054246912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.073836:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6769 00000100:00100000:3.0:1746129818.073843:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054247168:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.073843:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6770 00000100:00100000:0.0:1746129818.073863:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054247424:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.081282:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054247424:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7412us (7807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.081293:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6770 00002000:00100000:2.0:1746129818.081424:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f6a4700 x1830949054247424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.081434:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4700 with x1830949054247424 ext(3145728->4194303) 00002000:00010000:2.0:1746129818.081439:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4700 00000100:00100000:1.0:1746129818.083394:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054246912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9559us (10102us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.083403:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6768 00002000:00100000:1.0:1746129818.083410:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6a4380 x1830949054246912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.083418:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4380 with x1830949054246912 ext(2097152->3145727) 00002000:00010000:1.0:1746129818.083422:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a4380 00000100:00100000:3.0:1746129818.087878:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054247168:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13998us (14408us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.087889:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6769 00002000:00100000:3.0:1746129818.087899:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6a7800 x1830949054247168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.087909:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7800 with x1830949054247168 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.087914:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7800 00000100:00100000:0.0:1746129818.092417:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.092453:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.092484:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054247552 00000100:00100000:2.0:1746129818.092492:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054247552 00000100:00100000:0.0:1746129818.092501:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.092525:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054247680 00000100:00100000:2.0:1746129818.092526:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054247680 00000100:00100000:2.0:1746129818.092535:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054247808 00000100:00100000:2.0:1746129818.092537:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054247808 00000100:00100000:2.0:1746129818.092547:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15211 00000100:00100000:2.0:1746129818.092552:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054247552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.092565:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.092578:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355819 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.092583:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15212 00000100:00100000:3.0:1746129818.092591:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054247680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.092598:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.092600:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.092600:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.092607:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.092611:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355820 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.092620:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.092623:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.092625:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.092629:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.092629:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3a000, rc 0) 00010000:00010000:3.0:1746129818.092639:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.092646:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c840c00, rc 0) 00000100:00100000:3.0:1746129818.092665:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054247680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.092666:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054247552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.092671:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15211 00000100:00100000:3.0:1746129818.093119:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15212 00000100:00100000:2.0:1746129818.093126:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15213 00000100:00100000:2.0:1746129818.093132:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054247808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.093139:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.093145:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355827 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.093153:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.093155:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.093159:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.093167:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.093187:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b600, rc 0) 00000100:00100000:2.0:1746129818.093215:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054247808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 84us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.093220:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15213 00000100:00100000:0.0:1746129818.096221:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.096512:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054248064 00000100:00100000:3.0:1746129818.096520:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054248064 00002000:00100000:3.0:1746129818.096553:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a5490e00 x1830949054248064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.096562:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490e00 with x1830949054248064 ext(4194304->4931583) 00002000:00010000:3.0:1746129818.096566:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5490e00 00000100:00100000:3.0:1746129818.096596:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6771 00000100:00100000:3.0:1746129818.096603:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054248064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.105107:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054248064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8496us (8883us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129818.105118:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6771 00002000:00100000:3.0:1746129818.105127:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a5490e00 x1830949054248064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.105137:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490e00 with x1830949054248064 ext(4194304->4931583) 00002000:00010000:3.0:1746129818.105142:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5490e00 00000100:00100000:0.0:1746129818.112975:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.113068:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054248320 00000100:00100000:3.0:1746129818.113075:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054248320 00000100:00100000:3.0:1746129818.113832:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4563 00000100:00100000:3.0:1746129818.113885:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31443:x1830949054248320:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129818.114573:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31443:x1830949054248320:12345-192.168.204.31@tcp:35:cat.0 Request processed in 718us (1588us total) trans 8589944947 rc 0/0 00000100:00100000:3.0:1746129818.114579:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4563 00000100:00100000:0.0:1746129818.155377:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.155926:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054248576 00000100:00100000:2.0:1746129818.155935:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054248576 00000100:00100000:2.0:1746129818.155990:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10958 00000100:00100000:2.0:1746129818.155997:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31452:x1830949054248576:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.156019:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.156032:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e439544d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35582e expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.156112:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156122:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156130:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156141:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156146:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156150:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156247:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156254:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156259:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129818.156266:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129818.156328:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156334:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156339:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156343:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3a800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.156346:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156351:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156359:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129818.156361:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.156364:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156371:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e439544dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156397:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156401:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156405:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156408:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ae00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.156410:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156414:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156419:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009404c700) 00010000:00010000:2.0:1746129818.156633:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.156637:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156642:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.156679:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e439544d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 294 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.156689:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 293 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.156699:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.156701:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129818.156703:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b800, rc 0) 00000100:00100000:2.0:1746129818.156740:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31452:x1830949054248576:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 744us (1371us total) trans 8589944948 rc 0/0 00000100:00100000:2.0:1746129818.156746:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10958 00000100:00100000:0.0:1746129818.183487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.183581:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054248704 00000100:00100000:2.0:1746129818.183588:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054248704 00000100:00100000:2.0:1746129818.183641:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10959 00000100:00100000:2.0:1746129818.183648:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31455:x1830949054248704:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129818.183666:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.183679:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355835 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.183727:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183738:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183747:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183758:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183763:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183771:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183894:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183902:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183907:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129818.183932:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129818.183936:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129818.183947:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183955:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183961:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183965:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183970:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183975:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3a800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.183978:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183983:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.183992:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129818.183995:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.183997:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184002:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a800/0x48868a4e43954500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184016:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184021:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184025:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184028:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ba00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.184031:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184035:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184040:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009cae5300) 00010000:00010000:2.0:1746129818.184042:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.184044:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184049:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x48868a4e43954507 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.184070:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ae00/0x48868a4e439544f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.184080:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 11 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.184086:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.184087:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129818.184089:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b200, rc 0) 00000100:00100000:2.0:1746129818.184140:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31455:x1830949054248704:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 492us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.184145:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10959 00000100:00100000:0.0:1746129818.191733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.192714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.192759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.192779:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054248832 00000100:00100000:3.0:1746129818.192787:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054248832 00000100:00100000:1.0:1746129818.193069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.193301:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054249344 00000100:00100000:0.0:1746129818.193307:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054249344 00000100:00100000:0.0:1746129818.193341:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10960 00000100:00100000:0.0:1746129818.193349:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31457:x1830949054249344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129818.193372:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.193389:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78400/0x48868a4e43954515 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355851 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.194254:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194270:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194283:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194296:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194302:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194307:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194417:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194426:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194431:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129818.194440:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129818.194523:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194531:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194536:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194541:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129818.194544:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194551:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194561:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129818.194564:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129818.194567:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194572:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79000/0x48868a4e4395451c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194602:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194609:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194613:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194616:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa79800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129818.194619:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194623:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194629:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244800) 00010000:00010000:0.0:1746129818.194631:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129818.194634:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194637:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79800/0x48868a4e43954523 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.194680:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78400/0x48868a4e43954515 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 18 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.194692:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.194698:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.194699:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129818.194701:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa79c00, rc 0) 00000100:00100000:0.0:1746129818.194754:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31457:x1830949054249344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1404us (1992us total) trans 8589944949 rc 0/0 00000100:00100000:0.0:1746129818.194761:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10960 00000100:00100000:3.0:1746129818.195475:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054248960 00000100:00100000:3.0:1746129818.195484:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054248960 00000100:00100000:1.0:1746129818.195502:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054249088 00000100:00100000:1.0:1746129818.195507:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054249088 00000100:00100000:3.0:1746129818.195509:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15214 00000100:00100000:3.0:1746129818.195515:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054248832:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129818.195524:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.195533:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35583c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.195534:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15215 00000100:00100000:1.0:1746129818.195540:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054248960:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129818.195546:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.195547:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.195549:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.195555:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0ea400/0x48868a4e4395453f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355843 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.195556:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.195565:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.195577:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841a00, rc 0) 00000100:00100000:1.0:1746129818.195587:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053987840:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.195599:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054248832:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 85us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.195604:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15214 00000100:00100000:3.0:1746129818.195617:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15216 00000100:00100000:3.0:1746129818.195622:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054249088:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129818.195627:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129818.195632:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129818.195633:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35584a expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.195640:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.195641:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.195645:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.195654:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.195660:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c841e00, rc 0) 00000100:00100000:3.0:1746129818.195672:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054249088:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 51us (2606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.195677:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15216 00000100:00100000:3.0:1746129818.196996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.197046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.198783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.199147:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054249472 00000100:00100000:1.0:1746129818.199155:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054249472 00000100:00100000:1.0:1746129818.199204:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054249600 00000100:00100000:1.0:1746129818.199209:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054249600 00000100:00100000:1.0:1746129818.199227:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054249728 00000100:00100000:1.0:1746129818.199230:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054249728 00000100:00100000:1.0:1746129818.199255:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15217 00000100:00100000:1.0:1746129818.199262:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054249472:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129818.199277:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.199292:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355858 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.199312:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.199314:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.199324:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199338:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199349:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ebc00, rc 0) 00000100:00100000:1.0:1746129818.199393:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054249472:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 131us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.199399:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15217 00000100:00100000:1.0:1746129818.199416:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15218 00000100:00100000:1.0:1746129818.199422:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054249600:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129818.199428:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.199434:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35585f expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.199445:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.199446:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.199451:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199462:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199469:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ea800, rc 0) 00000100:00100000:1.0:1746129818.199492:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054249600:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 70us (2446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.199497:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15218 00000100:00100000:1.0:1746129818.199511:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15219 00000100:00100000:1.0:1746129818.199517:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054249728:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129818.199525:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.199534:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355866 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.199546:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.199548:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.199552:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199562:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199569:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0eb000, rc 0) 00000100:00100000:1.0:1746129818.199592:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054249728:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 74us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.199597:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15219 00000100:00100000:1.0:1746129818.199772:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013631b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053987840:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129818.199797:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e0ea400/0x48868a4e4395453f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355843 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199808:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0ea400/0x48868a4e4395453f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355843 expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.199834:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0ea400, rc 0) 00000100:00100000:1.0:1746129818.199884:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054248960:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 4342us (7169us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129818.199889:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15215 00000100:00100000:0.0:1746129818.201506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129818.201812:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129818.203538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.203829:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054249856 00000100:00100000:3.0:1746129818.203836:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054249856 00000100:00100000:3.0:1746129818.203883:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15220 00000100:00100000:3.0:1746129818.203889:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054249856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.203901:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.203913:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e315800/0x48868a4e43954562 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35586d expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.203949:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053987968:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.204008:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.204427:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054250112 00000100:00100000:3.0:1746129818.204430:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054250112 00000100:00100000:3.0:1746129818.204449:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10961 00000100:00100000:3.0:1746129818.204453:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31455:x1830949054250112:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129818.204461:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.204469:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e315600/0x48868a4e43954569 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355874 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204530:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.204541:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 292 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204547:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204552:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204557:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.204573:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204581:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 16 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.204588:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988096:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.204635:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 12 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204642:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 12 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.204649:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988224:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.204670:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 292 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.204677:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 292 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.204684:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.204699:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.205512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.205881:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054250368 00000100:00100000:0.0:1746129818.205887:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054250368 00000100:00100000:0.0:1746129818.205920:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10962 00000100:00100000:0.0:1746129818.205928:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31458:x1830949054250368:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129818.205943:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.205953:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43954577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35587b expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.206011:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.206021:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.206030:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000100:00100000:0.0:1746129818.210703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.210724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.210762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.210900:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053987968:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129818.210931:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e315800/0x48868a4e43954562 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35586d expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.210942:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e315800/0x48868a4e43954562 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35586d expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.210956:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e315800, rc 0) 00000100:00100000:3.0:1746129818.210990:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054249856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7101us (9486us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129818.210996:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15220 00000100:00100000:2.0:1746129818.211085:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054250496 00000100:00100000:2.0:1746129818.211091:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054250496 00010000:00010000:2.0:1746129818.211112:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 13 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.211127:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054250624 00000100:00100000:2.0:1746129818.211128:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054250624 00010000:00010000:2.0:1746129818.211135:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 293 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.211143:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054250752 00000100:00100000:2.0:1746129818.211145:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054250752 00010000:00010000:2.0:1746129818.211150:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 19 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.211160:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7573 00000100:00100000:2.0:1746129818.211179:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054250496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.211192:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.211197:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 13 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.211204:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 13 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.211219:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.211222:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211229:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211234:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.211248:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054250496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.211253:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7573 00000100:00100000:2.0:1746129818.211283:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7574 00000100:00100000:2.0:1746129818.211288:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1962:x1830949054250624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.211292:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.211295:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 293 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.211301:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 293 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.211310:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.211313:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211317:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211321:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.211331:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1962:x1830949054250624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 44us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.211335:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7574 00000100:00100000:2.0:1746129818.211341:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7575 00000100:00100000:2.0:1746129818.211345:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054250752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.211349:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.211352:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 19 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.211359:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 19 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.211366:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.211368:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211374:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211379:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211384:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.211389:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.211393:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129818.211406:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.211416:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054250752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.211420:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7575 00010000:00010000:2.0:1746129818.211439:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa79c00/0x48868a4e4395452a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355851 expref: 18 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.211450:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.211463:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x48868a4e4395450e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355835 expref: 12 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.211470:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988224:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.211476:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x48868a4e439544eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35582e expref: 292 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.211483:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988352:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.211495:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211501:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.211508:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129818.211521:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129818.211816:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:0.0:1746129818.211822:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:0.0:1746129818.211831:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129818.211928:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78e00/0x48868a4e43954577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 19 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.211949:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 18 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.211954:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.211956:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129818.211957:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78000, rc 0) 00000100:00100000:0.0:1746129818.211977:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31458:x1830949054250368:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6051us (6468us total) trans 8589944951 rc 0/0 00000100:00100000:0.0:1746129818.211981:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10962 00010000:00010000:2.0:1746129818.212690:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e315600/0x48868a4e43954569 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355874 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.212702:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355874 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.212707:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.212708:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129818.212710:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e314400, rc 0) 00000100:00100000:2.0:1746129818.212922:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31455:x1830949054250112:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 8468us (9391us total) trans 8589944950 rc 0/0 00000100:00100000:2.0:1746129818.212927:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10961 00000100:00100000:0.0:1746129818.215260:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.215338:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054251008 00000100:00100000:3.0:1746129818.215345:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054251008 00002000:00100000:3.0:1746129818.215374:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c1c5880 x1830949054251008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.215382:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5880 with x1830949054251008 ext(0->1048575) 00002000:00010000:3.0:1746129818.215386:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c5880 00000100:00100000:3.0:1746129818.215447:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6772 00000100:00100000:3.0:1746129818.215453:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054251008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.216602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.216748:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054251264 00000100:00100000:2.0:1746129818.216752:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054251264 00000100:00100000:2.0:1746129818.216780:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10963 00000100:00100000:2.0:1746129818.216786:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31455:x1830949054251264:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129818.216799:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.216801:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129818.216821:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e314400/0x48868a4e43954570 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355874 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.216835:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.216838:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.216863:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x48868a4e43954593 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355882 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.216933:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.216944:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.216949:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 4/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.216973:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.216982:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 17 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.216991:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988480:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.217064:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.221518:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053988480:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.221538:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.228047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.228119:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054251392 00000100:00100000:3.0:1746129818.228126:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054251392 00010000:00010000:3.0:1746129818.228152:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 18 pid: 14314 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.228197:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7576 00000100:00100000:3.0:1746129818.228204:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054251392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.228215:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.228220:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 18 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.228230:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 18 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.228247:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa78000/0x48868a4e4395457e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35587b expref: 18 pid: 14314 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.228265:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.228269:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.228277:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.228282:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.228301:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.228333:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054251392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 129us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.228338:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7576 00010000:00010000:2.0:1746129818.228404:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228411:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228424:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228431:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228435:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228440:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3be00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.228443:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228449:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228456:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.228458:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129818.228461:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.228465:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3be00/0x48868a4e4395459a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.228479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129818.228493:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x48868a4e43954593 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355882 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.228500:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x48868a4e43954593 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355882 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.228506:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b400, rc 0) 00000100:00100000:2.0:1746129818.228523:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31455:x1830949054251264:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 11737us (11924us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.228532:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10963 00000100:00100000:3.0:1746129818.228600:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054251520 00000100:00100000:3.0:1746129818.228603:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054251520 00000100:00100000:3.0:1746129818.228619:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15221 00000100:00100000:3.0:1746129818.228623:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31458:x1830949054251520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129818.228633:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.228647:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355889 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.228668:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.228675:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.228681:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.228686:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.228687:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.228690:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1839104->2076671] (req 1839104->2076671) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.228712:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.228722:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 23 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.228731:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988608:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.228786:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.228794:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 9 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.228801:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988736:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.228836:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.228844:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 14 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.228880:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988864:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.229306:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.229737:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054251008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14282us (14480us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.229744:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6772 00002000:00100000:2.0:1746129818.229751:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c1c5880 x1830949054251008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.229758:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5880 with x1830949054251008 ext(0->1048575) 00002000:00010000:2.0:1746129818.229762:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c5880 00000100:00100000:0.0:1746129818.231794:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.231837:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054251776 00000100:00100000:2.0:1746129818.231842:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054251776 00000100:00100000:2.0:1746129818.231888:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4564 00000100:00100000:2.0:1746129818.231894:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31455:x1830949054251776:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129818.232089:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988608:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.232098:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988736:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.232612:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31455:x1830949054251776:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 717us (822us total) trans 8589944952 rc 0/0 00000100:00100000:2.0:1746129818.232618:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4564 00000100:00100000:0.0:1746129818.235644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.235881:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054251904 00000100:00100000:2.0:1746129818.235888:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054251904 00010000:00010000:2.0:1746129818.235916:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 24 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.235952:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7577 00000100:00100000:2.0:1746129818.235960:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054251904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.235972:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.235993:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 24 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.236008:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 24 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.236029:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c840c00/0x48868a4e439544c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355820 expref: 24 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.236043:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.236079:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054251904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 121us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.236086:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7577 00000100:00100000:0.0:1746129818.238658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.238715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.238735:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988864:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.238762:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1839104->2076671] (req 1839104->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.238777:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfa00, rc 0) 00000100:00100000:3.0:1746129818.238813:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31458:x1830949054251520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10188us (10331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.238819:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15221 00000100:00100000:2.0:1746129818.238863:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054252032 00000100:00100000:3.0:1746129818.238864:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054252288 00000100:00100000:3.0:1746129818.238868:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054252288 00000100:00100000:2.0:1746129818.238868:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054252032 00010000:00010000:2.0:1746129818.238886:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 10 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.238907:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7578 00000100:00100000:2.0:1746129818.238913:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054252032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129818.238914:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10964 00000100:00100000:3.0:1746129818.238918:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31461:x1830949054252288:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.238924:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.238931:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.238940:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 10 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.238943:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e439545a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355890 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.238948:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 10 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.238963:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c841e00/0x48868a4e43954546 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35584a expref: 10 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.238972:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.238987:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054252032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.238993:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7578 00010000:00010000:3.0:1746129818.239020:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239030:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239039:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129818.239040:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.239053:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054252544 00000100:00100000:3.0:1746129818.239056:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054252544 00000100:00100000:3.0:1746129818.239070:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15222 00000100:00100000:3.0:1746129818.239074:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31457:x1830949054252544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.239080:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.239087:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355897 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239099:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239105:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.239107:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.239110:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239131:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239140:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 22 pid: 4589 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.239150:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988992:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.239192:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.239215:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129818.239226:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239232:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239238:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239325:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129818.239331:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054252416 00010000:00010000:3.0:1746129818.239332:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129818.239335:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054252416 00010000:00010000:2.0:1746129818.239345:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 16 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.239371:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7579 00000100:00100000:2.0:1746129818.239376:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054252416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.239382:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.239389:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 16 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.239397:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 16 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.239406:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67600/0x48868a4e439544a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557fd expref: 16 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.239414:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.239415:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.239419:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.239428:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239436:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.239443:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746129818.239444:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:2.0:1746129818.239451:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053989120:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.239469:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129818.239509:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239514:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239519:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239524:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80de000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.239527:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239532:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239539:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129818.239542:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.239544:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239548:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e439545af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239689:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239695:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239700:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239704:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80de600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.239707:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239711:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239717:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f888800) 00010000:00010000:3.0:1746129818.239719:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.239721:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239726:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de600/0x48868a4e439545bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.239754:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dee00/0x48868a4e439545a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 295 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239761:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 294 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.239767:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.239769:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129818.239770:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfc00, rc 0) 00000100:00100000:3.0:1746129818.239801:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31461:x1830949054252288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 882us (1148us total) trans 8589944953 rc 0/0 00000100:00100000:3.0:1746129818.239806:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10964 00000100:00100000:3.0:1746129818.241654:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053988992:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.241673:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.241683:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80df800, rc 0) 00000100:00100000:3.0:1746129818.241708:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31457:x1830949054252544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2632us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.241714:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15222 00000100:00100000:2.0:1746129818.241784:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053989120:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.241792:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.241807:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054252416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2431us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.241813:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7579 00000100:00100000:1.0:1746129818.244488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.244520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.244537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.244592:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054252800 00000100:00100000:0.0:1746129818.244598:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054252800 00002000:00100000:0.0:1746129818.244632:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1839104->1843199) req@ffff88013631aa00 x1830949054252800/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.244641:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631aa00 with x1830949054252800 ext(1839104->1843199) 00002000:00010000:0.0:1746129818.244645:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631aa00 00000100:00100000:0.0:1746129818.244659:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054252928 00000100:00100000:0.0:1746129818.244661:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054252928 00002000:00100000:0.0:1746129818.244672:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1134592->1286143) req@ffff880136318700 x1830949054252928/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.244678:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318700 with x1830949054252928 ext(1134592->1286143) 00010000:00010000:0.0:1746129818.244683:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 23 pid: 4589 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.244700:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 23 pid: 4589 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746129818.244706:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136318700 00000100:00100000:0.0:1746129818.244717:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1832 00000100:00100000:2.0:1746129818.244728:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6773 00000100:00100000:0.0:1746129818.244729:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054252928:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129818.244737:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054252800:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129818.244872:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054252800:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 136us (389us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129818.244877:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6773 00002000:00100000:2.0:1746129818.244882:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1839104->1843199) req@ffff88013631aa00 x1830949054252800/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.244889:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631aa00 with x1830949054252800 ext(1839104->1843199) 00002000:00010000:2.0:1746129818.244892:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631aa00 00000100:00100000:1.0:1746129818.245218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.245325:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054253056 00000100:00100000:0.0:1746129818.245328:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054253056 00000100:00100000:0.0:1746129818.245345:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054253184 00000100:00100000:0.0:1746129818.245347:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054253184 00000100:00100000:0.0:1746129818.245358:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15223 00000100:00100000:0.0:1746129818.245362:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054253056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129818.245370:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.245380:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e439545d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35589e expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.245418:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989248:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129818.245472:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.245598:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15224 00000100:00100000:3.0:1746129818.245605:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054253184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.245612:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.245619:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a80df600/0x48868a4e439545d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558a5 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.245639:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053989376:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.245666:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.248106:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989248:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129818.248130:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e439545d2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35589e expref: 28 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.248142:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa78000/0x48868a4e439545d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35589e expref: 28 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.248166:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa78000, rc 0) 00000100:00100000:1.0:1746129818.248203:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054253056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2839us (3663us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129818.248210:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15223 00000100:00100000:2.0:1746129818.249783:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054252928:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5056us (5258us total) trans 17179874078 rc 0/0 00000100:00100000:2.0:1746129818.249791:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1832 00002000:00100000:2.0:1746129818.249799:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1134592->1286143) req@ffff880136318700 x1830949054252928/t17179874078(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.249807:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318700 with x1830949054252928 ext(1134592->1286143) 00010000:00010000:2.0:1746129818.249814:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 27 pid: 4589 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.249826:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 27 pid: 4589 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746129818.249831:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136318700 00000100:00100000:0.0:1746129818.250134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.250336:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054253440 00000100:00100000:3.0:1746129818.250342:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054253440 00002000:00100000:3.0:1746129818.250366:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (2072576->2076671) req@ffff88009fbef100 x1830949054253440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.250372:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef100 with x1830949054253440 ext(2072576->2076671) 00002000:00010000:3.0:1746129818.250375:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef100 00000100:00100000:3.0:1746129818.250387:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6774 00000100:00100000:3.0:1746129818.250392:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054253440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129818.250609:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054253440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 215us (475us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129818.250615:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6774 00002000:00100000:3.0:1746129818.250620:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (2072576->2076671) req@ffff88009fbef100 x1830949054253440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00010000:0.0:1746129818.250938:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129817 -> 1746129818 00002000:00010000:0.0:1746129818.250941:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129817 -> 1746129818 00000100:00100000:0.0:1746129818.250950:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053989376:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129818.250967:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a80df600/0x48868a4e439545d9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558a5 expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.250977:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a80df600/0x48868a4e439545d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558a5 expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.250988:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80df600, rc 0) 00000100:00100000:0.0:1746129818.251008:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054253184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5404us (5790us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129818.251014:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15224 00002000:00100000:3.0:1746129818.251242:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbef100 with x1830949054253440 ext(2072576->2076671) 00002000:00010000:3.0:1746129818.251245:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fbef100 00000100:00100000:0.0:1746129818.251363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.251514:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054253568 00000100:00100000:3.0:1746129818.251517:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054253568 00010000:00010000:3.0:1746129818.251532:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 25 pid: 4589 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.251553:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7580 00000100:00100000:3.0:1746129818.251559:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054253568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.251568:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.251578:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 25 pid: 4589 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.251587:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 25 pid: 4589 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.251600:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a38000/0x48868a4e43954482 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1134592->1286143) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557da expref: 25 pid: 4589 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.251612:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.251614:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.251619:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.251625:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.251647:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.251656:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053989504:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129818.252296:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.258002:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.258107:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054253824 00000100:00100000:2.0:1746129818.258115:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054253824 00000100:00100000:0.0:1746129818.258277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.258388:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949053989504:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129818.258403:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.258575:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4565 00000100:00100000:2.0:1746129818.258582:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31458:x1830949054253824:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129818.258915:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054253568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7353us (7550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.258923:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7580 00000100:00100000:3.0:1746129818.258977:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054254080 00000100:00100000:3.0:1746129818.258980:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054254080 00002000:00100000:3.0:1746129818.259000:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880131463800 x1830949054254080/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.259008:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463800 with x1830949054254080 ext(0->1048575) 00002000:00010000:3.0:1746129818.259012:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131463800 00000100:00100000:3.0:1746129818.259025:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6775 00000100:00100000:3.0:1746129818.259030:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054254080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.259580:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31458:x1830949054253824:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 998us (1585us total) trans 8589944954 rc 0/0 00000100:00100000:2.0:1746129818.259586:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4565 00000100:00100000:0.0:1746129818.264279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.264315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.264353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.264370:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054254336 00000100:00100000:2.0:1746129818.264378:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054254336 00000100:00100000:3.0:1746129818.264405:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054254592 00002000:00100000:2.0:1746129818.264409:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880131461f80 x1830949054254336/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129818.264410:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054254592 00002000:00100000:2.0:1746129818.264418:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461f80 with x1830949054254336 ext(1048576->2097151) 00002000:00010000:2.0:1746129818.264423:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131461f80 00002000:00100000:3.0:1746129818.264426:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880131460700 x1830949054254592/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 504/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.264434:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460700 with x1830949054254592 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.264437:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460700 00000100:00100000:2.0:1746129818.264447:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054254848 00000100:00100000:2.0:1746129818.264450:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054254848 00000100:00100000:3.0:1746129818.264463:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6776 00000100:00100000:3.0:1746129818.264468:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054254336:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129818.264468:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6777 00000100:00100000:2.0:1746129818.264473:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054254592:12345-192.168.204.31@tcp:3:multiop.0 00002000:00100000:2.0:1746129818.264611:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880131460e00 x1830949054254848/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.264618:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949054254848 ext(1048576->2097151) 00002000:00010000:2.0:1746129818.264621:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460e00 00000100:00100000:2.0:1746129818.264632:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6778 00000100:00100000:2.0:1746129818.264636:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054254848:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129818.274056:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054254592:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 9572us (9730us total) trans 0 rc 811008/811008 00000100:00100000:2.0:1746129818.274066:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6777 00000100:00100000:3.0:1746129818.274073:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054254080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15041us (15794us total) trans 0 rc 1048576/1048576 00002000:00100000:2.0:1746129818.274076:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880131460700 x1830949054254592/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 504/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 811008/811008 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129818.274081:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6775 00002000:00100000:2.0:1746129818.274085:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460700 with x1830949054254592 ext(1048576->2097151) 00002000:00100000:3.0:1746129818.274086:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880131463800 x1830949054254080/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746129818.274090:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460700 00002000:00100000:3.0:1746129818.274095:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463800 with x1830949054254080 ext(0->1048575) 00002000:00010000:3.0:1746129818.274098:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131463800 00000100:00100000:2.0:1746129818.276557:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054254336:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12081us (12501us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.276566:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6776 00002000:00100000:2.0:1746129818.276574:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880131461f80 x1830949054254336/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.276582:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461f80 with x1830949054254336 ext(1048576->2097151) 00002000:00010000:2.0:1746129818.276587:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131461f80 00000100:00100000:2.0:1746129818.279539:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054254848:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14894us (15177us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.279549:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6778 00002000:00100000:2.0:1746129818.279556:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880131460e00 x1830949054254848/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.279566:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460e00 with x1830949054254848 ext(1048576->2097151) 00002000:00010000:2.0:1746129818.279570:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460e00 00000100:00100000:0.0:1746129818.283087:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.283219:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054254976 00000100:00100000:2.0:1746129818.283227:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054254976 00000100:00100000:2.0:1746129818.283821:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15225 00000100:00100000:2.0:1746129818.283829:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31461:x1830949054254976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.283872:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.283888:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558ac expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.283914:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.283916:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.283922:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.283935:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.283944:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676200, rc 0) 00000100:00100000:2.0:1746129818.283981:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31461:x1830949054254976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 152us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.283990:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15225 00000100:00100000:0.0:1746129818.287252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.287509:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054255232 00000100:00100000:2.0:1746129818.287517:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054255232 00002000:00100000:2.0:1746129818.287552:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880131460000 x1830949054255232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.287561:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460000 with x1830949054255232 ext(1048576->2097151) 00002000:00010000:2.0:1746129818.287566:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460000 00000100:00100000:2.0:1746129818.287689:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6779 00000100:00100000:2.0:1746129818.287696:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054255232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.291209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.291245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.291362:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054255360 00000100:00100000:1.0:1746129818.291369:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054255360 00000100:00100000:1.0:1746129818.291416:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15226 00000100:00100000:1.0:1746129818.291424:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31452:x1830949054255360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129818.291438:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.291451:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558b3 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.291476:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.291485:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.291491:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.291496:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.291498:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.291501:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3497984->4194303] (req 3497984->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.291526:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.291542:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 28 pid: 1140 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.291552:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989632:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.291609:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.291617:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 8 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.291623:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989760:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.291999:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054255616 00000100:00100000:2.0:1746129818.292004:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054255616 00002000:00100000:2.0:1746129818.292026:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880131461c00 x1830949054255616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.292034:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461c00 with x1830949054255616 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.292038:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131461c00 00000100:00100000:2.0:1746129818.292077:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6780 00000100:00100000:2.0:1746129818.292083:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054255616:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129818.293269:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.293280:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 13 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.293289:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989888:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.293315:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.293533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.294208:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054255872 00000100:00100000:3.0:1746129818.294212:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054255872 00002000:00100000:3.0:1746129818.294232:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880131463b80 x1830949054255872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.294239:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463b80 with x1830949054255872 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.294243:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131463b80 00000100:00100000:3.0:1746129818.294257:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6781 00000100:00100000:3.0:1746129818.294261:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054255872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.294466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.294497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.294594:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989632:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.294777:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054256128 00000100:00100000:0.0:1746129818.294780:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054256128 00002000:00100000:0.0:1746129818.294794:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800934d4700 x1830949054256128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.294802:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949054256128 ext(2097152->3145727) 00010000:00010000:0.0:1746129818.294807:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 14 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.294816:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 14 pid: 20441 timeout: 864 lvb_type: 1 00002000:00010000:0.0:1746129818.294821:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d4700 00000100:00100000:0.0:1746129818.294836:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054256256 00000100:00100000:0.0:1746129818.294838:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054256256 00002000:00100000:0.0:1746129818.294867:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800934d7800 x1830949054256256/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.294873:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949054256256 ext(3145728->4194303) 00010000:00010000:0.0:1746129818.294877:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 15 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.294884:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 15 pid: 20441 timeout: 864 lvb_type: 1 00002000:00010000:0.0:1746129818.294892:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d7800 00000100:00100000:0.0:1746129818.294903:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1833 00000100:00100000:0.0:1746129818.294908:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054256128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.295228:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1834 00000100:00100000:3.0:1746129818.295234:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054256256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.296629:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054255232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8929us (9379us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.296636:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6779 00002000:00100000:3.0:1746129818.296642:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880131460000 x1830949054255232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.296649:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460000 with x1830949054255232 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.296654:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131460000 00000100:00100000:1.0:1746129818.296700:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989760:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.297543:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053989888:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.297567:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3497984->4194303] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.297583:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009330f600, rc 0) 00000100:00100000:1.0:1746129818.297601:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31452:x1830949054255360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6178us (6398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.297606:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15226 00000100:00100000:1.0:1746129818.297651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.297699:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054256512 00000100:00100000:3.0:1746129818.297704:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054256512 00010000:00010000:3.0:1746129818.297725:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 9 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.297752:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7581 00000100:00100000:3.0:1746129818.297757:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054256512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.297767:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.297780:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 9 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.297786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.297788:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 9 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.297803:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0eb000/0x48868a4e4395455b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355866 expref: 9 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.297822:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.297841:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054256512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.297861:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7581 00000100:00100000:3.0:1746129818.297873:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054256640 00000100:00100000:3.0:1746129818.297876:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054256640 00010000:00010000:3.0:1746129818.297883:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 26 pid: 1140 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.297896:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7582 00000100:00100000:3.0:1746129818.297900:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054256640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.297905:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.297911:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 26 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.297917:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 26 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.297926:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0eaa00/0x48868a4e439544ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355812 expref: 26 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.297932:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.297946:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054256640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.297951:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7582 00000100:00100000:3.0:1746129818.304166:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054255872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9896us (10641us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.304187:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6781 00002000:00100000:3.0:1746129818.304197:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880131463b80 x1830949054255872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.304205:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131463b80 with x1830949054255872 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.304209:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131463b80 00000100:00100000:0.0:1746129818.305991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.306091:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054256768 00000100:00100000:2.0:1746129818.306097:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054256768 00000100:00100000:3.0:1746129818.306922:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054256256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11685us (12421us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.306931:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1834 00002000:00100000:3.0:1746129818.306940:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800934d7800 x1830949054256256/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.306948:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949054256256 ext(3145728->4194303) 00010000:00010000:3.0:1746129818.306955:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 16 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.306966:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 16 pid: 20441 timeout: 864 lvb_type: 1 00002000:00010000:3.0:1746129818.306972:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d7800 00000100:00100000:2.0:1746129818.307119:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15227 00000100:00100000:2.0:1746129818.307127:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31461:x1830949054256768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.307138:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.307150:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558ba expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.307186:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.307193:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.307195:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.307198:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.307223:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.307232:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 15 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.307242:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053990016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.307302:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6af00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.309428:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054256128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14514us (14956us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.309438:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1833 00002000:00100000:1.0:1746129818.309446:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800934d4700 x1830949054256128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.309454:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949054256128 ext(2097152->3145727) 00010000:00010000:1.0:1746129818.309461:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 14 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.309471:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 14 pid: 20441 timeout: 864 lvb_type: 1 00002000:00010000:1.0:1746129818.309476:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d4700 00000100:00100000:3.0:1746129818.309869:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053990016:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.309890:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 26 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.309907:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676000, rc 0) 00000100:00100000:3.0:1746129818.309929:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31461:x1830949054256768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2803us (3943us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.309935:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15227 00000100:00100000:2.0:1746129818.310525:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054255616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18441us (19277us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.310532:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6780 00002000:00100000:2.0:1746129818.310538:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880131461c00 x1830949054255616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.310546:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461c00 with x1830949054255616 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.310550:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131461c00 00000100:00100000:0.0:1746129818.313065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.313238:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054256896 00000100:00100000:2.0:1746129818.313246:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054256896 00002000:00100000:2.0:1746129818.313278:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1839104->2076671) req@ffff880131461500 x1830949054256896/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.313286:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461500 with x1830949054256896 ext(1839104->2076671) 00010000:00010000:2.0:1746129818.313293:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 14 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.313303:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 14 pid: 20441 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746129818.313309:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131461500 00000100:00100000:2.0:1746129818.313332:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1835 00000100:00100000:2.0:1746129818.313338:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054256896:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129818.316374:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.318395:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054257024 00000100:00100000:0.0:1746129818.318407:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054257024 00010000:00010000:0.0:1746129818.318436:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 16 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.318474:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7583 00000100:00100000:0.0:1746129818.318481:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054257024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.318494:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.318513:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 16 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.318523:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 16 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.318541:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e439544b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35580b expref: 16 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.318563:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.318565:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.318570:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.318577:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.318607:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.318617:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053990144:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129818.318686:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.318949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.320441:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054256896:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7096us (7374us total) trans 17179874079 rc 0/0 00000100:00100000:2.0:1746129818.320451:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1835 00002000:00100000:2.0:1746129818.320460:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1839104->2076671) req@ffff880131461500 x1830949054256896/t17179874079(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.320468:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461500 with x1830949054256896 ext(1839104->2076671) 00010000:00010000:2.0:1746129818.320476:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 16 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.320488:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 16 pid: 20441 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746129818.320494:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131461500 00000100:00100000:3.0:1746129818.320582:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054257152 00000100:00100000:3.0:1746129818.320588:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054257152 00000100:00100000:3.0:1746129818.320613:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15228 00000100:00100000:3.0:1746129818.320619:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31457:x1830949054257152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.320629:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.320640:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558c1 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.320658:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.320665:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.320667:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.320670:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.320689:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.320698:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 25 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.320707:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053990272:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.320765:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.323715:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.323776:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054257408 00000100:00100000:3.0:1746129818.323783:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054257408 00000100:00100000:3.0:1746129818.323820:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949053990272:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.323841:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.323877:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80de800, rc 0) 00000100:00100000:3.0:1746129818.323908:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31457:x1830949054257152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3289us (4960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.323915:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15228 00002000:00100000:3.0:1746129818.323958:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3497984->3502079) req@ffff880094eb5180 x1830949054257408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.323966:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5180 with x1830949054257408 ext(3497984->3502079) 00010000:00010000:3.0:1746129818.323972:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 26 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.323981:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 26 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.323987:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094eb5180 00000100:00100000:3.0:1746129818.324014:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1836 00000100:00100000:3.0:1746129818.324020:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054257408:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129818.324135:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054257408:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 115us (425us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129818.324141:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1836 00002000:00100000:3.0:1746129818.324146:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3497984->3502079) req@ffff880094eb5180 x1830949054257408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.324153:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5180 with x1830949054257408 ext(3497984->3502079) 00010000:00010000:3.0:1746129818.324158:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 26 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.324165:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 26 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.324181:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094eb5180 00000100:00100000:0.0:1746129818.324437:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.324554:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053990144:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.324564:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.324584:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054257024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6103us (8217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.324591:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7583 00000100:00100000:2.0:1746129818.324604:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054257536 00000100:00100000:2.0:1746129818.324607:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054257536 00010000:00010000:2.0:1746129818.324618:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 16 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.324632:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7584 00000100:00100000:2.0:1746129818.324636:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054257536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.324643:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.324655:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 16 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.324663:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 16 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.324681:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfa00/0x48868a4e439545a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1839104->2076671) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355889 expref: 16 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.324695:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.324697:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.324703:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.324714:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.324736:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 25 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.324746:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053990400:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.324788:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.330055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.330056:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053990400:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.330074:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.330112:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054257536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5474us (5674us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.330114:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.330120:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7584 00000100:00100000:3.0:1746129818.330180:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054257792 00000100:00100000:3.0:1746129818.330186:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054257792 00000100:00100000:1.0:1746129818.330205:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054258048 00000100:00100000:1.0:1746129818.330209:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054258048 00002000:00100000:3.0:1746129818.330216:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094eb6d80 x1830949054257792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.330224:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6d80 with x1830949054257792 ext(1048576->2097151) 00002000:00100000:1.0:1746129818.330227:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880094eb5880 x1830949054258048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:3.0:1746129818.330229:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6d80 00002000:00100000:1.0:1746129818.330234:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949054258048 ext(1048576->2097151) 00002000:00010000:1.0:1746129818.330238:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb5880 00000100:00100000:3.0:1746129818.330245:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6782 00000100:00100000:3.0:1746129818.330251:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054257792:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129818.330253:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6783 00000100:00100000:1.0:1746129818.330258:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054258048:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129818.332221:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.332389:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054258304 00000100:00100000:0.0:1746129818.332393:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054258304 00002000:00100000:0.0:1746129818.332415:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3497984->4194303) req@ffff8800934d7b80 x1830949054258304/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.332422:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949054258304 ext(3497984->4194303) 00010000:00010000:0.0:1746129818.332475:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 27 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.332493:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 27 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746129818.332498:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d7b80 00000100:00100000:0.0:1746129818.332524:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1837 00000100:00100000:0.0:1746129818.332531:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054258304:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129818.332799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.332890:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054258432 00000100:00100000:2.0:1746129818.332894:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054258432 00000100:00100000:2.0:1746129818.332916:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15229 00000100:00100000:2.0:1746129818.332921:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31452:x1830949054258432:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.332929:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.332943:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558c8 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.332962:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.332974:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.332981:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.332986:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.332988:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.332990:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [4194304->4427775] (req 4194304->4427775) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.333011:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 12 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.333020:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 12 pid: 3624 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.333029:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053990528:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.333085:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.333093:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 10 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.333100:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053990656:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.333124:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.333131:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 21 pid: 3624 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.333138:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053990784:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.333153:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.338071:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053990528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.338083:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053990656:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.338090:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053990784:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.338114:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [4194304->4427775] (req 4194304->4427775) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.338130:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5621400, rc 0) 00000100:00100000:3.0:1746129818.338163:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31452:x1830949054258432:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5241us (5363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.338184:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15229 00000100:00100000:0.0:1746129818.339247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.339423:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054258560 00000100:00100000:2.0:1746129818.339429:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054258560 00010000:00010000:2.0:1746129818.339454:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 11 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.339475:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7585 00000100:00100000:2.0:1746129818.339480:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054258560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.339489:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.339505:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 11 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.339514:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 11 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.339532:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ea800/0x48868a4e43954554 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35585f expref: 11 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.339548:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.339569:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054258560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.339574:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7585 00000100:00100000:2.0:1746129818.341189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.341550:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054258688 00000100:00100000:0.0:1746129818.341556:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054258688 00010000:00010000:0.0:1746129818.341578:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 13 pid: 3624 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.341609:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7586 00000100:00100000:0.0:1746129818.341615:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054258688:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.341624:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.341638:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 13 pid: 3624 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.341647:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 13 pid: 3624 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.341662:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948cb800/0x48868a4e43954490 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e8 expref: 13 pid: 3624 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.341684:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129818.341713:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054258688:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.341718:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7586 00000100:00100000:0.0:1746129818.342368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.342476:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054258816 00000100:00100000:2.0:1746129818.342480:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054258816 00010000:00010000:2.0:1746129818.342494:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 22 pid: 3624 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.342519:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7587 00000100:00100000:2.0:1746129818.342524:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054258816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.342531:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.342540:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 22 pid: 3624 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.342546:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 22 pid: 3624 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.342558:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948ca800/0x48868a4e43954489 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557e1 expref: 22 pid: 3624 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.342566:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.342568:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.342573:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.342580:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.342608:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.342619:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053990912:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.343222:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.343883:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054257792:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13629us (13832us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.343892:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6782 00002000:00100000:3.0:1746129818.343899:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094eb6d80 x1830949054257792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.343908:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6d80 with x1830949054257792 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.343912:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6d80 00000100:00100000:1.0:1746129818.345644:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054258048:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15380us (15523us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.345653:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6783 00002000:00100000:1.0:1746129818.345661:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880094eb5880 x1830949054258048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.345669:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5880 with x1830949054258048 ext(1048576->2097151) 00002000:00010000:1.0:1746129818.345673:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb5880 00000100:00100000:0.0:1746129818.350791:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.350876:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054259072 00000100:00100000:1.0:1746129818.350883:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054259072 00002000:00100000:1.0:1746129818.350917:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4423680->4427775) req@ffff880094eb6300 x1830949054259072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.350926:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6300 with x1830949054259072 ext(4423680->4427775) 00002000:00010000:1.0:1746129818.350931:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb6300 00000100:00100000:1.0:1746129818.350949:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6784 00000100:00100000:1.0:1746129818.350956:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054259072:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129818.351082:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054259072:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 125us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129818.351088:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6784 00002000:00100000:1.0:1746129818.351093:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4423680->4427775) req@ffff880094eb6300 x1830949054259072/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.351101:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6300 with x1830949054259072 ext(4423680->4427775) 00002000:00010000:1.0:1746129818.351103:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb6300 00000100:00100000:3.0:1746129818.351192:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053990912:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129818.351208:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.351229:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054258816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8705us (8861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.351237:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7587 00000100:00100000:2.0:1746129818.351296:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054258304:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 18763us (19077us total) trans 17179874080 rc 0/0 00000100:00100000:2.0:1746129818.351304:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1837 00002000:00100000:2.0:1746129818.351310:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3497984->4194303) req@ffff8800934d7b80 x1830949054258304/t17179874080(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.351317:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949054258304 ext(3497984->4194303) 00010000:00010000:2.0:1746129818.351325:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.351337:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:2.0:1746129818.351343:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d7b80 00000100:00100000:0.0:1746129818.354579:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.354633:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.354684:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054259456 00000100:00100000:2.0:1746129818.354690:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054259456 00000100:00100000:2.0:1746129818.354735:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4566 00000100:00100000:2.0:1746129818.354743:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31452:x1830949054259456:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129818.354983:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31452:x1830949054259456:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 240us (349us total) trans 8589944955 rc 0/0 00000100:00100000:2.0:1746129818.354994:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4566 00000100:00100000:3.0:1746129818.355240:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054259200 00000100:00100000:3.0:1746129818.355245:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054259200 00010000:00010000:3.0:1746129818.355264:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.355296:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7588 00000100:00100000:3.0:1746129818.355302:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054259200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.355311:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.355327:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.355337:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.355356:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009330f600/0x48868a4e439545e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3497984->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558b3 expref: 28 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.355382:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.355384:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.355390:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.356049:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.356164:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.356187:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053991040:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.357443:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.358864:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949053991040:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.358879:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.358912:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054259200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3609us (4340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.358921:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7588 00000100:00100000:0.0:1746129818.361020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.361181:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054259712 00000100:00100000:3.0:1746129818.361188:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054259712 00002000:00100000:3.0:1746129818.361224:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094eb6680 x1830949054259712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.361233:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6680 with x1830949054259712 ext(2097152->3145727) 00002000:00010000:3.0:1746129818.361238:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb6680 00000100:00100000:3.0:1746129818.361255:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6785 00000100:00100000:3.0:1746129818.361261:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054259712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.366921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.366992:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054259968 00000100:00100000:2.0:1746129818.367000:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054259968 00002000:00100000:2.0:1746129818.367031:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094eb6a00 x1830949054259968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.367040:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6a00 with x1830949054259968 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.367045:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6a00 00000100:00100000:2.0:1746129818.367069:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6786 00000100:00100000:2.0:1746129818.367075:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054259968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.371618:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054259712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10347us (10594us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.371647:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6785 00002000:00100000:3.0:1746129818.371656:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094eb6680 x1830949054259712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.371665:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6680 with x1830949054259712 ext(2097152->3145727) 00002000:00010000:3.0:1746129818.371670:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb6680 00000100:00100000:0.0:1746129818.376550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.376628:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054260096 00000100:00100000:3.0:1746129818.376637:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054260096 00000100:00100000:3.0:1746129818.376683:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15230 00000100:00100000:3.0:1746129818.376690:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31461:x1830949054260096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.376703:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129818.376821:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054259968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9745us (9907us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.376828:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6786 00002000:00100000:2.0:1746129818.376835:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094eb6a00 x1830949054259968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129818.376941:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558cf expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.376960:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.376962:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.376967:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.376983:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.376991:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80de000, rc 0) 00000100:00100000:3.0:1746129818.377019:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31461:x1830949054260096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 330us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.377023:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15230 00002000:00100000:2.0:1746129818.377067:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb6a00 with x1830949054259968 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.377071:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb6a00 00000100:00100000:0.0:1746129818.381182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.381812:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054260224 00000100:00100000:3.0:1746129818.381821:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054260224 00000100:00100000:3.0:1746129818.381886:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15231 00000100:00100000:3.0:1746129818.381893:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31457:x1830949054260224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.381908:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.381924:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558d6 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.381951:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.381959:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.381960:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.381964:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.381989:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.382005:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 18 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.382014:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053991168:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.383861:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.385938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.385987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.386024:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054260480 00000100:00100000:2.0:1746129818.386031:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054260480 00000100:00100000:1.0:1746129818.386040:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054260736 00000100:00100000:1.0:1746129818.386044:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054260736 00000100:00100000:3.0:1746129818.386048:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949053991168:192.168.204.31@tcp:104: 00002000:00100000:2.0:1746129818.386065:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094eb7100 x1830949054260480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.386067:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094eb4e00 x1830949054260736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129818.386069:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129818.386074:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7100 with x1830949054260480 ext(2097152->3145727) 00002000:00100000:1.0:1746129818.386074:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4e00 with x1830949054260736 ext(3145728->4194303) 00002000:00010000:2.0:1746129818.386078:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7100 00002000:00010000:1.0:1746129818.386078:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4e00 00010000:00010000:3.0:1746129818.386083:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80df200, rc 0) 00000100:00100000:2.0:1746129818.386094:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6787 00000100:00100000:2.0:1746129818.386100:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054260480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.386117:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31457:x1830949054260224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4225us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.386122:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15231 00000100:00100000:1.0:1746129818.386203:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6788 00000100:00100000:1.0:1746129818.386208:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054260736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.386312:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.386341:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054261120 00000100:00100000:3.0:1746129818.386344:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054261120 00002000:00100000:3.0:1746129818.386358:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094eb7b80 x1830949054261120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.386364:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7b80 with x1830949054261120 ext(3145728->4194303) 00010000:00010000:3.0:1746129818.386369:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 19 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.386376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.386379:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 19 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.386389:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eb7b80 00000100:00100000:3.0:1746129818.386404:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054260864 00000100:00100000:3.0:1746129818.386407:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054260864 00002000:00100000:3.0:1746129818.386416:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4427775) req@ffff880094eb4a80 x1830949054260864/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129818.386416:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1838 00000100:00100000:2.0:1746129818.386420:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054261120:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:3.0:1746129818.386422:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949054260864 ext(4194304->4427775) 00010000:00010000:3.0:1746129818.386425:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 20 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.386432:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 20 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.386437:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eb4a80 00000100:00100000:3.0:1746129818.386446:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1839 00000100:00100000:3.0:1746129818.386450:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949054260864:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129818.395451:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949054261120:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9022us (9131us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.395462:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1838 00002000:00100000:3.0:1746129818.395471:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094eb7b80 x1830949054261120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.395480:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7b80 with x1830949054261120 ext(3145728->4194303) 00010000:00010000:3.0:1746129818.395490:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.395508:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.395515:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eb7b80 00000100:00100000:3.0:1746129818.401300:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054260480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15188us (15358us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.401310:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6787 00002000:00100000:3.0:1746129818.401321:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094eb7100 x1830949054260480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.401330:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7100 with x1830949054260480 ext(2097152->3145727) 00002000:00010000:3.0:1746129818.401335:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7100 00000100:00100000:3.0:1746129818.402772:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054260864:12345-192.168.204.31@tcp:4:cat.0 Request processed in 16315us (16389us total) trans 21474841270 rc 0/0 00000100:00100000:3.0:1746129818.402780:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1839 00002000:00100000:3.0:1746129818.402787:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4427775) req@ffff880094eb4a80 x1830949054260864/t21474841270(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.402796:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4a80 with x1830949054260864 ext(4194304->4427775) 00010000:00010000:3.0:1746129818.402804:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.402817:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.402823:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094eb4a80 00000100:00100000:1.0:1746129818.403680:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054260736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17468us (17688us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.403687:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6788 00002000:00100000:1.0:1746129818.403691:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094eb4e00 x1830949054260736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.403699:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4e00 with x1830949054260736 ext(3145728->4194303) 00002000:00010000:1.0:1746129818.403703:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb4e00 00000100:00100000:0.0:1746129818.405982:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.408385:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054261248 00000100:00100000:3.0:1746129818.408396:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054261248 00000100:00100000:3.0:1746129818.408460:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15232 00000100:00100000:3.0:1746129818.408468:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31461:x1830949054261248:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.408483:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.408500:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558dd expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.408522:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.408527:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.408536:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.408546:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfe00, rc 0) 00000100:00100000:3.0:1746129818.408611:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31461:x1830949054261248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 144us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.408617:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15232 00000100:00100000:0.0:1746129818.410223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.410628:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054261376 00000100:00100000:2.0:1746129818.410640:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054261376 00010000:00010000:2.0:1746129818.410666:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 22 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.410697:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7589 00000100:00100000:2.0:1746129818.410703:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054261376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.410714:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129818.410729:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129818 -> 1746129819 00002000:00010000:2.0:1746129818.410731:0:16449:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129818 -> 1746129819 00002000:00010000:2.0:1746129818.410733:0:16449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129818 -> 1746129819 00010000:00010000:2.0:1746129818.410738:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 22 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.410747:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 22 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.410765:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5621400/0x48868a4e439545fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4427775) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c8 expref: 22 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.410785:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.410787:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.410793:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.410799:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.410806:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.410807:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.410809:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.410815:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.410838:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.410877:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053991296:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.410947:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.410954:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053991424:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.410969:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.413059:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053991296:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.413069:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053991424:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.413084:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.414248:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054261376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3539us (4025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.414419:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7589 00000100:00100000:0.0:1746129818.415687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.415732:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.415829:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054261760 00000100:00100000:3.0:1746129818.415835:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054261760 00002000:00100000:3.0:1746129818.415895:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880135d8dc00 x1830949054261760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.415903:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8dc00 with x1830949054261760 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.415908:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8dc00 00000100:00100000:3.0:1746129818.415931:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054261888 00000100:00100000:3.0:1746129818.415933:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054261888 00002000:00100000:3.0:1746129818.415944:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880135d8ce00 x1830949054261888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.415949:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ce00 with x1830949054261888 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.415951:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8ce00 00000100:00100000:3.0:1746129818.415960:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6789 00000100:00100000:3.0:1746129818.415966:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054261760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.416447:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6790 00000100:00100000:2.0:1746129818.416454:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054261888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.419809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.420579:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054262144 00000100:00100000:0.0:1746129818.420587:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054262144 00002000:00100000:0.0:1746129818.420621:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800934d7100 x1830949054262144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.420630:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7100 with x1830949054262144 ext(3145728->4194303) 00002000:00010000:0.0:1746129818.420634:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7100 00000100:00100000:0.0:1746129818.420662:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6791 00000100:00100000:0.0:1746129818.420668:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054262144:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.426472:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054261760:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10497us (10780us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.426482:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6789 00002000:00100000:3.0:1746129818.426491:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880135d8dc00 x1830949054261760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.426500:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8dc00 with x1830949054261760 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.426506:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8dc00 00000100:00100000:2.0:1746129818.427255:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054261888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10799us (11519us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.427262:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6790 00002000:00100000:2.0:1746129818.427268:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880135d8ce00 x1830949054261888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.427275:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ce00 with x1830949054261888 ext(3145728->4194303) 00002000:00010000:2.0:1746129818.427279:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135d8ce00 00000100:00100000:2.0:1746129818.428093:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054262144:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7423us (8289us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.428100:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6791 00002000:00100000:2.0:1746129818.428106:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800934d7100 x1830949054262144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.428112:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7100 with x1830949054262144 ext(3145728->4194303) 00002000:00010000:2.0:1746129818.428115:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7100 00000100:00100000:0.0:1746129818.432914:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.433484:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054262272 00000100:00100000:2.0:1746129818.433492:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054262272 00000100:00100000:2.0:1746129818.433541:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15233 00000100:00100000:2.0:1746129818.433548:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054262272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.433563:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.433577:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558e4 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.433596:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.433598:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.433604:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.433618:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.433627:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef600, rc 0) 00000100:00100000:2.0:1746129818.433678:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054262272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 130us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.433684:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15233 00000100:00100000:0.0:1746129818.437516:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.437564:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.437624:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054262528 00000100:00100000:3.0:1746129818.437630:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054262528 00002000:00100000:3.0:1746129818.437661:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880135d8ca80 x1830949054262528/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.437670:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ca80 with x1830949054262528 ext(4194304->4931583) 00002000:00010000:3.0:1746129818.437674:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8ca80 00000100:00100000:3.0:1746129818.437695:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054262784 00000100:00100000:3.0:1746129818.437697:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054262784 00002000:00100000:3.0:1746129818.437706:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880135d8f800 x1830949054262784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129818.437706:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6792 00002000:00100000:3.0:1746129818.437712:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f800 with x1830949054262784 ext(4194304->4931583) 00002000:00010000:3.0:1746129818.437715:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8f800 00000100:00100000:3.0:1746129818.437729:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6793 00000100:00100000:3.0:1746129818.437734:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054262784:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.437809:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054262528:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.449210:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054262528:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11397us (11694us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129818.449220:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6792 00002000:00100000:2.0:1746129818.449232:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880135d8ca80 x1830949054262528/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.449241:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ca80 with x1830949054262528 ext(4194304->4931583) 00002000:00010000:2.0:1746129818.449246:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8ca80 00000100:00100000:2.0:1746129818.449901:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054262784:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12165us (12335us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129818.449908:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6793 00002000:00100000:2.0:1746129818.449914:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880135d8f800 x1830949054262784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.449921:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8f800 with x1830949054262784 ext(4194304->4931583) 00002000:00010000:2.0:1746129818.449924:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135d8f800 00000100:00100000:0.0:1746129818.457139:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.457374:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054263040 00000100:00100000:1.0:1746129818.457382:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054263040 00000100:00100000:1.0:1746129818.457432:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4567 00000100:00100000:1.0:1746129818.457568:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31461:x1830949054263040:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129818.457772:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31461:x1830949054263040:12345-192.168.204.31@tcp:35:cat.0 Request processed in 333us (640us total) trans 8589944956 rc 0/0 00000100:00100000:1.0:1746129818.457778:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4567 00000100:00100000:1.0:1746129818.459145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.459195:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054263296 00000100:00100000:2.0:1746129818.459200:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054263296 00000100:00100000:2.0:1746129818.459254:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4568 00000100:00100000:2.0:1746129818.459260:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31457:x1830949054263296:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129818.459669:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31457:x1830949054263296:12345-192.168.204.31@tcp:35:cat.0 Request processed in 408us (526us total) trans 8589944957 rc 0/0 00000100:00100000:2.0:1746129818.459675:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4568 00000100:00100000:0.0:1746129818.484323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.484457:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054263552 00000100:00100000:3.0:1746129818.484466:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054263552 00000100:00100000:3.0:1746129818.484516:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10965 00000100:00100000:3.0:1746129818.484524:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31469:x1830949054263552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129818.484543:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.484557:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a7200/0x48868a4e4395461f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558eb expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.484640:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484650:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484659:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484670:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484675:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484680:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484782:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484793:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484798:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129818.484806:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:0.0:1746129818.484886:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.484894:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484900:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484905:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484910:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801305a6200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.484913:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.484916:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054263808 00010000:00010000:3.0:1746129818.484918:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.484921:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054263808 00010000:00010000:3.0:1746129818.484927:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129818.484929:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.484932:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484937:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6200/0x48868a4e43954626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484960:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484969:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484973:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484977:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095347e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.484979:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484983:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484989:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f888200) 00010000:00010000:3.0:1746129818.484991:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.484993:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.484997:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095347e00/0x48868a4e4395462d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.485029:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a7200/0x48868a4e4395461f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 22 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.485039:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 21 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.485045:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.485047:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129818.485049:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5621400, rc 0) 00000100:00100000:2.0:1746129818.485131:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10966 00000100:00100000:2.0:1746129818.485139:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31470:x1830949054263808:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.485150:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.485157:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee800/0x48868a4e43954642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558f2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.485208:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.485217:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 297 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.485224:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31469:x1830949054263552:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 700us (908us total) trans 8589944958 rc 0/0 00010000:00010000:2.0:1746129818.485224:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 21 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.485230:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129818.485231:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10965 00010000:00010000:2.0:1746129818.485253:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 20 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.485930:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 20 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.485942:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053991552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.486025:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 297 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.486033:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 297 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.486044:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053991680:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.486062:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.487694:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053991680:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.487729:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053991552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.487731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129818.487746:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129818.487769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.487819:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054264064 00000100:00100000:1.0:1746129818.487824:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054264064 00010000:00010000:1.0:1746129818.487867:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 21 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.487897:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054263936 00000100:00100000:1.0:1746129818.487900:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054263936 00010000:00010000:1.0:1746129818.487909:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 298 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.487916:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7590 00000100:00100000:3.0:1746129818.487924:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054264064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129818.487925:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7591 00010000:00010000:3.0:1746129818.487935:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.487940:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 21 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.487948:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 21 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.487965:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5621400/0x48868a4e43954634 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558eb expref: 21 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.487977:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.487981:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.487987:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.487991:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.488016:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054264064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.488020:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7590 00000100:00100000:2.0:1746129818.488191:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054263936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.488201:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.488205:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 298 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.488214:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 298 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.488226:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e439545c4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355890 expref: 298 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.488238:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.488241:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.488247:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.488256:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.488610:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129818.488630:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.488635:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129818.488651:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129818.488752:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee800/0x48868a4e43954642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.488776:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 298 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.488781:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.488783:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129818.488785:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee400, rc 0) 00000100:00100000:2.0:1746129818.488862:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054263936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 915us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.488865:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:31470:x1830949054263808:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3728us (3980us total) trans 8589944959 rc 0/0 00000100:00100000:2.0:1746129818.488868:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7591 00000100:00100000:0.0:1746129818.488870:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10966 00000100:00100000:0.0:1746129818.500951:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.501033:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054264192 00000100:00100000:2.0:1746129818.501041:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054264192 00000100:00100000:2.0:1746129818.501084:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15234 00000100:00100000:2.0:1746129818.501091:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31470:x1830949054264192:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.501111:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.501125:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3558f9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.501151:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.501159:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.501176:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.501178:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.501181:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2482176->2793471] (req 2482176->2793471) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.501202:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.501210:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.501217:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053991808:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.501292:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 15 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.501299:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 15 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.501305:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053991936:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.501320:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.503871:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053991808:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.503884:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053991936:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.503907:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2482176->2793471] (req 2482176->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.503922:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef800, rc 0) 00000100:00100000:2.0:1746129818.503952:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31470:x1830949054264192:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2862us (3008us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.503959:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15234 00000100:00100000:0.0:1746129818.504934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.504991:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.505070:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054264320 00000100:00100000:3.0:1746129818.505076:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054264320 00000100:00100000:2.0:1746129818.505149:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054264448 00000100:00100000:2.0:1746129818.505153:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054264448 00010000:00010000:2.0:1746129818.505186:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 16 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.505208:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.505331:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7592 00000100:00100000:2.0:1746129818.505338:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054264448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129818.505340:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7593 00000100:00100000:3.0:1746129818.505345:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054264320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.505349:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.505350:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.505366:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.505366:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 16 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.505375:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 16 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.505382:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.505519:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a80de800/0x48868a4e439545f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558c1 expref: 16 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.505523:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a80de000/0x48868a4e43954603 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558cf expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.505563:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.505565:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.505570:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.505577:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.505584:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.505600:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.505649:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054264320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 303us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.505655:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7593 00000100:00100000:2.0:1746129818.505732:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053992064:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.505894:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.508145:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949053992064:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.508162:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.508205:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054264448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2867us (3212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.508213:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7592 00000100:00100000:0.0:1746129818.508771:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.508808:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054264704 00000100:00100000:2.0:1746129818.508812:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054264704 00002000:00100000:2.0:1746129818.508838:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2482176->2486271) req@ffff88008f909500 x1830949054264704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.508844:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909500 with x1830949054264704 ext(2482176->2486271) 00002000:00010000:2.0:1746129818.508879:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f909500 00000100:00100000:2.0:1746129818.508897:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6794 00000100:00100000:2.0:1746129818.508903:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054264704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129818.509105:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054264704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 200us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129818.509111:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6794 00002000:00100000:2.0:1746129818.509117:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2482176->2486271) req@ffff88008f909500 x1830949054264704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.509123:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909500 with x1830949054264704 ext(2482176->2486271) 00002000:00010000:2.0:1746129818.509126:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f909500 00000100:00100000:2.0:1746129818.512783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.512954:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054264960 00000100:00100000:0.0:1746129818.512962:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054264960 00002000:00100000:0.0:1746129818.512998:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2789376->2793471) req@ffff88009f6a7100 x1830949054264960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.513006:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7100 with x1830949054264960 ext(2789376->2793471) 00002000:00010000:0.0:1746129818.513010:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7100 00000100:00100000:0.0:1746129818.513039:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6795 00000100:00100000:0.0:1746129818.513128:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054264960:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129818.513284:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054264960:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 160us (508us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129818.513290:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6795 00002000:00100000:0.0:1746129818.513295:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2789376->2793471) req@ffff88009f6a7100 x1830949054264960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.513302:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a7100 with x1830949054264960 ext(2789376->2793471) 00002000:00010000:0.0:1746129818.513304:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6a7100 00000100:00100000:0.0:1746129818.555341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.555454:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265088 00000100:00100000:2.0:1746129818.555467:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265088 00000100:00100000:2.0:1746129818.555535:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10967 00000100:00100000:2.0:1746129818.555544:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31472:x1830949054265088:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.555573:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.555592:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e4395465e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355900 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.555654:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555667:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555676:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555688:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555694:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555698:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555813:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555822:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 296 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.555829:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.555906:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 296 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.555921:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 296 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.555933:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053992192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.556034:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.558188:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053992192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.558213:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129818.558350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.558417:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265344 00000100:00100000:2.0:1746129818.558423:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265344 00000100:00100000:2.0:1746129818.558470:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4569 00000100:00100000:2.0:1746129818.558476:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:27192:x1830949054265344:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129818.558676:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:27192:x1830949054265344:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 199us (327us total) trans 8589944960 rc 0/0 00000100:00100000:2.0:1746129818.558683:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4569 00000100:00100000:0.0:1746129818.562472:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.562533:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.562722:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265472 00000100:00100000:2.0:1746129818.562731:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265472 00010000:00010000:2.0:1746129818.562767:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.562805:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7594 00000100:00100000:2.0:1746129818.562811:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1961:x1830949054265472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.562825:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.562831:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.562843:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.562889:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee400/0x48868a4e43954649 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f2 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.563075:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265600 00000100:00100000:3.0:1746129818.563080:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265600 00000100:00100000:3.0:1746129818.563105:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15235 00000100:00100000:3.0:1746129818.563110:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31469:x1830949054265600:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129818.563125:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.563139:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355907 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.563173:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.563184:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.563190:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.563192:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.563196:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3239936->3887103] (req 3239936->3887103) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.563224:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.563235:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 20 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.563246:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053992320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.563341:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.563350:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 14 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.563357:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053992448:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.563376:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129818.563479:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.563483:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.563491:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.563495:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.563517:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.563544:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1961:x1830949054265472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 734us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.563550:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7594 00010000:00010000:0.0:1746129818.563636:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563643:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129818.563691:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:0.0:1746129818.563696:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129818.563712:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563722:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563731:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563737:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563820:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563826:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129818.563829:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563835:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563842:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129818.563844:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129818.563870:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563874:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563895:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563901:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563905:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563908:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093befa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129818.563911:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563915:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563922:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29a500) 00010000:00010000:0.0:1746129818.563924:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129818.563925:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563929:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e4395466c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.563962:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef200/0x48868a4e4395465e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.563972:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.563978:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.563980:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129818.563982:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee000, rc 0) 00000100:00100000:0.0:1746129818.564014:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31472:x1830949054265088:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8471us (8680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.564021:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10967 00000100:00100000:0.0:1746129818.568968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.569011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.569094:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265728 00000100:00100000:1.0:1746129818.569103:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265728 00010000:00010000:1.0:1746129818.569146:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.569184:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265856 00000100:00100000:1.0:1746129818.569187:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265856 00010000:00010000:1.0:1746129818.569198:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 15 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.569214:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7595 00000100:00100000:1.0:1746129818.569221:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054265728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.569235:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.569256:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.569267:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 21 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.569293:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.569333:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054265728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.569339:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7595 00000100:00100000:1.0:1746129818.569353:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7596 00000100:00100000:1.0:1746129818.569357:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054265856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.569365:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.569371:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 15 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.569380:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 15 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.569391:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.569393:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.569401:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.569408:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.569441:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.569454:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053992576:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129818.569512:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19cef00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129818.569946:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954611 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558dd expref: 20 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.569977:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053992320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.569987:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e4395460a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558d6 expref: 15 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.569994:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053992448:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.570023:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.570032:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a7200, rc 0) 00000100:00100000:3.0:1746129818.570054:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31469:x1830949054265600:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6944us (7521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.570060:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15235 00000100:00100000:0.0:1746129818.572207:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.572243:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.572270:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.572293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.572317:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054265984 00000100:00100000:2.0:1746129818.572324:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054265984 00000100:00100000:2.0:1746129818.572366:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054266112 00000100:00100000:2.0:1746129818.572368:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054266112 00000100:00100000:2.0:1746129818.572379:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054266240 00000100:00100000:2.0:1746129818.572380:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054266240 00000100:00100000:2.0:1746129818.572394:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15236 00000100:00100000:2.0:1746129818.572402:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054265984:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.572418:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.572434:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35590e expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.572454:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.572456:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.572466:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.572480:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129818.572482:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054266368 00000100:00100000:3.0:1746129818.572486:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054266368 00010000:00010000:2.0:1746129818.572489:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee400, rc 0) 00000100:00100000:3.0:1746129818.572507:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15237 00000100:00100000:3.0:1746129818.572512:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054266112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129818.572518:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129818.572522:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054265984:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 121us (324us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.572525:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355915 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.572528:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15236 00010000:00010000:3.0:1746129818.572539:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.572540:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129818.572543:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15238 00010000:00010000:3.0:1746129818.572545:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129818.572548:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054266240:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.572554:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.572560:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.572562:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395468f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35591c expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.572568:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9e00, rc 0) 00000100:00100000:3.0:1746129818.572584:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054266112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.572589:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15237 00000100:00100000:2.0:1746129818.572597:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053992704:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.572600:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15239 00000100:00100000:3.0:1746129818.572604:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054266368:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129818.572609:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.572616:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e43954696 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355923 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.572639:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053992832:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.572645:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.572666:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.572746:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949053992576:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129818.572760:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.572778:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054265856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3420us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.572785:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7596 00000100:00100000:1.0:1746129818.573333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.573415:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054266624 00000100:00100000:0.0:1746129818.573419:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054266624 00002000:00100000:0.0:1746129818.573446:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3239936->3244031) req@ffff8800934d6300 x1830949054266624/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.573456:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d6300 with x1830949054266624 ext(3239936->3244031) 00002000:00010000:0.0:1746129818.573460:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d6300 00000100:00100000:0.0:1746129818.573485:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6796 00000100:00100000:0.0:1746129818.573491:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054266624:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129818.573625:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054266624:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 135us (294us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129818.573630:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6796 00002000:00100000:0.0:1746129818.573634:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3239936->3244031) req@ffff8800934d6300 x1830949054266624/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.573639:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d6300 with x1830949054266624 ext(3239936->3244031) 00002000:00010000:0.0:1746129818.573641:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d6300 00000100:00100000:2.0:1746129818.575813:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053992704:192.168.204.31@tcp:106: 00002000:00010000:3.0:1746129818.575834:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129818 -> 1746129819 00002000:00010000:3.0:1746129818.575839:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129818 -> 1746129819 00002000:00010000:3.0:1746129818.575841:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129818 -> 1746129819 00010000:00010000:2.0:1746129818.575873:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395468f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35591c expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129818.575884:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949053992832:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.575893:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395468f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35591c expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.575908:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e43954696 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355923 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.575916:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befc00, rc 0) 00010000:00010000:3.0:1746129818.575918:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f8400/0x48868a4e43954696 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355923 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.575932:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f8400, rc 0) 00000100:00100000:2.0:1746129818.575947:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054266240:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3398us (3675us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129818.575954:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054266368:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3349us (3659us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.575955:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15238 00000100:00100000:3.0:1746129818.575959:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15239 00000100:00100000:2.0:1746129818.579799:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.580840:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054266880 00000100:00100000:0.0:1746129818.580883:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054266880 00002000:00100000:0.0:1746129818.580936:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3883008->3887103) req@ffff88009f6a5180 x1830949054266880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.580946:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5180 with x1830949054266880 ext(3883008->3887103) 00002000:00010000:0.0:1746129818.580952:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a5180 00000100:00100000:0.0:1746129818.580982:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6797 00000100:00100000:0.0:1746129818.580990:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054266880:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129818.581206:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054266880:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 216us (1416us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129818.581214:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6797 00002000:00100000:0.0:1746129818.581220:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3883008->3887103) req@ffff88009f6a5180 x1830949054266880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.581227:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a5180 with x1830949054266880 ext(3883008->3887103) 00002000:00010000:0.0:1746129818.581229:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a5180 00000100:00100000:1.0:1746129818.582115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.582197:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054267136 00000100:00100000:0.0:1746129818.582203:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054267136 00000100:00100000:0.0:1746129818.582229:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10968 00000100:00100000:0.0:1746129818.582234:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31472:x1830949054267136:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129818.582248:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.582265:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d600/0x48868a4e4395469d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35592a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.582356:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.582371:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.582382:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.582411:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.582421:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 14 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.582432:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053992960:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.582505:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.583972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.583990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.584021:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054267392 00000100:00100000:1.0:1746129818.584026:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054267392 00000100:00100000:0.0:1746129818.584038:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053992960:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129818.584057:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129818.584068:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10969 00000100:00100000:1.0:1746129818.584074:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31475:x1830949054267392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.584093:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.584105:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e439546ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355931 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.584121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.584143:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054267648 00000100:00100000:2.0:1746129818.584147:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054267648 00000100:00100000:2.0:1746129818.584184:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4570 00000100:00100000:2.0:1746129818.584189:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31469:x1830949054267648:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:1.0:1746129818.584215:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584226:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584235:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584247:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584252:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584256:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584338:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8200/0x48868a4e439546c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00000100:00100000:2.0:1746129818.584343:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31469:x1830949054267648:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 152us (376us total) trans 8589944961 rc 0/0 00010000:00010000:1.0:1746129818.584346:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8200/0x48868a4e439546c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00000100:00100000:2.0:1746129818.584350:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4570 00010000:00010000:1.0:1746129818.584351:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8200/0x48868a4e439546c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:1.0:1746129818.584359:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129818.584531:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584539:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584544:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584550:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8e9a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129818.584554:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584638:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584650:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129818.584652:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129818.584656:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584661:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e9a00/0x48868a4e439546b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584929:0:14314:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584934:0:14314:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584939:0:14314:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584942:0:14314:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8e8000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129818.584944:0:14314:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584949:0:14314:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584956:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02500) 00010000:00010000:1.0:1746129818.584958:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129818.584960:0:14314:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.584965:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8000/0x48868a4e439546b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129818.585001:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e439546ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355931 expref: 300 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.585012:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8200/0x48868a4e439546c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355931 expref: 299 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.585018:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129818.585019:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129818.585022:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e8200, rc 0) 00000100:00100000:1.0:1746129818.585049:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31475:x1830949054267392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 974us (1058us total) trans 8589944962 rc 0/0 00000100:00100000:1.0:1746129818.585055:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10969 00000100:00100000:1.0:1746129818.585076:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054267776 00000100:00100000:1.0:1746129818.585080:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054267776 00010000:00010000:1.0:1746129818.585094:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 15 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.585111:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7597 00000100:00100000:1.0:1746129818.585116:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054267776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.585125:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.585128:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 15 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.585137:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 15 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.585149:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43954673 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355900 expref: 15 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.585157:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129818.585160:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129818.585177:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129818.585182:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129818.585196:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.585229:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054267776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.585235:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7597 00010000:00010000:0.0:1746129818.585370:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.585377:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:0.0:1746129818.585389:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129818.585447:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d600/0x48868a4e4395469d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.585473:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.585480:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.585482:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129818.585484:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08cc00, rc 0) 00000100:00100000:0.0:1746129818.585502:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31472:x1830949054267136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3267us (3390us total) trans 8589944963 rc 0/0 00000100:00100000:0.0:1746129818.585507:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10968 00000100:00100000:0.0:1746129818.587533:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.587600:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054267904 00000100:00100000:2.0:1746129818.587609:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054267904 00000100:00100000:2.0:1746129818.587671:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 726 00000100:00100000:2.0:1746129818.587679:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1964:x1830949054267904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.587693:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.587714:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8200/0x48868a4e439546c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355931 expref: 299 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.587729:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.587733:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.587775:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1964:x1830949054267904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.587781:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 726 00000100:00100000:0.0:1746129818.588335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.588575:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268032 00000100:00100000:2.0:1746129818.588579:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268032 00000100:00100000:2.0:1746129818.588612:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10970 00000100:00100000:2.0:1746129818.588617:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31472:x1830949054268032:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.588638:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.588651:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beea00/0x48868a4e439546d5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355938 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.588731:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.588743:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.588749:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.588777:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.588787:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 15 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.588799:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053993088:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.589054:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.589390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.589436:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268160 00000100:00100000:3.0:1746129818.589441:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268160 00000100:00100000:3.0:1746129818.589479:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15240 00000100:00100000:3.0:1746129818.589485:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054268160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.589493:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.589505:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305a6200/0x48868a4e439546e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35593f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.589542:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053993216:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.589584:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.590340:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053993088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.590364:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129818.591127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.591333:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268288 00000100:00100000:2.0:1746129818.591338:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268288 00010000:00010000:2.0:1746129818.591361:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 16 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.591725:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7598 00000100:00100000:2.0:1746129818.591738:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1961:x1830949054268288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.591753:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.591761:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 16 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.591773:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 16 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.591792:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439546a4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35592a expref: 16 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.591807:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.591811:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.591819:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.591825:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.591882:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.591928:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1961:x1830949054268288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 196us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.591934:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7598 00010000:00010000:2.0:1746129818.591962:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.591968:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129818.592001:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129818.592004:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129818.592017:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.592042:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beea00/0x48868a4e439546d5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355938 expref: 15 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.592052:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355938 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.592057:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.592060:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129818.592061:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befe00, rc 0) 00000100:00100000:2.0:1746129818.592085:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31472:x1830949054268032:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3467us (3751us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.592090:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10970 00000100:00100000:3.0:1746129818.592322:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949053993216:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129818.592346:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305a6200/0x48868a4e439546e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35593f expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.592358:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305a6200/0x48868a4e439546e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35593f expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.592380:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6200, rc 0) 00000100:00100000:3.0:1746129818.592414:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054268160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2928us (3024us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129818.592425:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15240 00000100:00100000:0.0:1746129818.594641:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.594687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.594777:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268544 00000100:00100000:3.0:1746129818.594786:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268544 00000100:00100000:3.0:1746129818.595085:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268416 00000100:00100000:3.0:1746129818.595088:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268416 00000100:00100000:2.0:1746129818.595237:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15241 00000100:00100000:2.0:1746129818.595247:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054268544:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.595267:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129818.595274:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15242 00010000:00010000:2.0:1746129818.595284:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093befc00/0x48868a4e439546ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35594d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.595284:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054268416:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129818.595292:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.595302:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9000/0x48868a4e439546f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355946 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.595334:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053993344:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.595335:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053993472:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129818.596384:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.596469:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.600387:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949053993344:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129818.600427:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9000/0x48868a4e439546f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355946 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.600448:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9000/0x48868a4e439546f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355946 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.600479:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e9000, rc 0) 00000100:00100000:1.0:1746129818.600526:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054268416:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5244us (5838us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129818.600536:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15242 00000100:00100000:3.0:1746129818.600664:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949053993472:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129818.600684:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093befc00/0x48868a4e439546ea lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35594d expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.600694:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093befc00/0x48868a4e439546ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35594d expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.600706:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befc00, rc 0) 00000100:00100000:3.0:1746129818.600941:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054268544:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5695us (6306us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129818.600947:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15241 00000100:00100000:0.0:1746129818.601128:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.601432:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268672 00000100:00100000:3.0:1746129818.601438:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268672 00000100:00100000:3.0:1746129818.601585:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15243 00000100:00100000:3.0:1746129818.601592:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31475:x1830949054268672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.601606:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.601619:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355954 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.601642:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.601650:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.601652:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129818.601655:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.601684:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.601695:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 12 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.601706:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053993600:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.602528:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.603611:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.603678:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054268928 00000100:00100000:2.0:1746129818.603686:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054268928 00000100:00100000:2.0:1746129818.603744:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10971 00000100:00100000:2.0:1746129818.603753:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31472:x1830949054268928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.603770:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.603785:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e439546ff lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35595b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.603909:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.603922:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.603933:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129818.603945:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129818.604367:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093befa00/0x48868a4e439546ff lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.604385:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.604397:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.604400:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129818.604403:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee200, rc 0) 00000100:00100000:2.0:1746129818.604463:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31472:x1830949054268928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 710us (858us total) trans 8589944964 rc 0/0 00000100:00100000:2.0:1746129818.604468:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10971 00000100:00100000:3.0:1746129818.604576:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949053993600:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.604602:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.604617:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9600, rc 0) 00000100:00100000:3.0:1746129818.604654:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31475:x1830949054268672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3062us (3525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.604662:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15243 00000100:00100000:0.0:1746129818.605301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.605435:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269056 00000100:00100000:1.0:1746129818.605445:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269056 00002000:00100000:1.0:1746129818.605477:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3239936->3887103) req@ffff88012d634380 x1830949054269056/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.605485:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634380 with x1830949054269056 ext(3239936->3887103) 00010000:00010000:1.0:1746129818.605490:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.605500:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746129818.605505:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d634380 00000100:00100000:1.0:1746129818.605527:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1840 00000100:00100000:1.0:1746129818.605533:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054269056:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129818.606381:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.606405:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.606429:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.606441:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.606453:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.606470:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.606490:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269312 00000100:00100000:3.0:1746129818.606497:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269312 00000100:00100000:3.0:1746129818.606526:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269568 00000100:00100000:3.0:1746129818.606528:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269568 00000100:00100000:3.0:1746129818.606541:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269824 00000100:00100000:3.0:1746129818.606542:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269824 00000100:00100000:3.0:1746129818.606559:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269184 00000100:00100000:3.0:1746129818.606561:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269184 00000100:00100000:3.0:1746129818.606575:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269440 00000100:00100000:3.0:1746129818.606577:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269440 00000100:00100000:3.0:1746129818.606588:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269696 00000100:00100000:3.0:1746129818.606589:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269696 00000100:00100000:3.0:1746129818.606603:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15244 00000100:00100000:3.0:1746129818.606609:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054269312:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129818.606613:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15245 00000100:00100000:1.0:1746129818.606621:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054269568:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129818.606641:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.606648:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.606657:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.606662:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.606665:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.606669:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.606673:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.606676:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.606680:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.606681:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.606682:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.606683:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.606684:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.606685:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.606710:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.606711:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.606719:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 20 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.606725:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 27 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.606730:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053993728:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.606735:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053993856:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.606883:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15246 00000100:00100000:2.0:1746129818.606890:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054269824:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129818.606907:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.606917:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.606922:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.606924:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.606926:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.606939:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.606945:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 27 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.606952:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053993984:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.607044:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 12 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.607056:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 12 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.607070:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053994112:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.607118:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15247 00000100:00100000:0.0:1746129818.607126:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054269184:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129818.607142:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.607156:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129818.607171:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00010000:00010000:0.0:1746129818.607173:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.607180:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.607185:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.607186:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.607188:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.607193:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15248 00000100:00100000:2.0:1746129818.607199:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054269440:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129818.607203:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.607210:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.607215:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.607217:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053994240:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.607224:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.607231:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.607237:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.607242:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.607243:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.607245:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.607253:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.607261:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.607261:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 12 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.607268:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 14 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.607275:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053994496:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.607278:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053994368:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.607333:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.607342:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 14 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.607350:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053994624:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.607363:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.607372:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 12 pid: 1140 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.607372:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.607380:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053994752:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.607391:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15249 00000100:00100000:1.0:1746129818.607397:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054269696:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129818.607405:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.607413:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 14 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.607413:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.607420:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053994880:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.607420:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129818.607424:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.607429:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:3.0:1746129818.607431:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00010000:00010000:1.0:1746129818.607431:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.607497:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 14 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.607504:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 14 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.607512:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053995008:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.607525:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28300 going to sleep for 11 seconds 00010000:00010000:2.0:1746129818.607898:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.607908:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.607916:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053995136:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.607944:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.607952:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 27 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.607959:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053995264:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.607971:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6ac00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129818.607988:0:8435:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.607997:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.609786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.609984:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053993728:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.610296:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054269952 00000100:00100000:3.0:1746129818.610301:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054269952 00000100:00100000:2.0:1746129818.610317:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949053993984:192.168.204.31@tcp:104: 00002000:00100000:3.0:1746129818.610333:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2482176->2793471) req@ffff88009206c000 x1830949054269952/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.610342:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206c000 with x1830949054269952 ext(2482176->2793471) 00010000:00010000:3.0:1746129818.610349:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.610363:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.610369:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206c000 00000100:00100000:1.0:1746129818.610382:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053994240:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.610385:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1841 00000100:00100000:3.0:1746129818.610391:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054269952:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:2.0:1746129818.610418:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.613548:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.613569:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270080 00000100:00100000:2.0:1746129818.613574:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270080 00010000:00010000:2.0:1746129818.613598:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 13 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.613619:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7599 00000100:00100000:2.0:1746129818.613625:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054270080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129818.613634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129818.613636:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129818.613646:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270336 00000100:00100000:0.0:1746129818.613649:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270336 00010000:00010000:2.0:1746129818.613653:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 13 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.613660:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 13 pid: 1140 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.613663:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 13 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.613674:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7600 00000100:00100000:0.0:1746129818.613678:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054270336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.613682:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129818.613684:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.613693:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 13 pid: 1140 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.613700:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 13 pid: 1140 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.613709:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054270080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.613714:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7599 00010000:00010000:0.0:1746129818.613714:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129818.613726:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054270336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.613730:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7600 00000100:00100000:2.0:1746129818.613742:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.613753:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270208 00000100:00100000:2.0:1746129818.613755:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270208 00000100:00100000:0.0:1746129818.613768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.613777:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270464 00000100:00100000:0.0:1746129818.613779:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270464 00010000:00010000:0.0:1746129818.613788:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 22 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.613799:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7601 00000100:00100000:0.0:1746129818.613803:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054270464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.613808:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.613814:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 22 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.613821:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 22 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:3.0:1746129818.613829:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053993856:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129818.613832:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3b600/0x48868a4e439544cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355827 expref: 22 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.613838:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bee400/0x48868a4e43954681 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35590e expref: 12 pid: 1140 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.613844:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.613878:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053994752:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.613879:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054270464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 76us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.613887:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7601 00000100:00100000:0.0:1746129818.613908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.613916:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270592 00000100:00100000:0.0:1746129818.613918:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270592 00010000:00010000:1.0:1746129818.613970:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008e0ebc00/0x48868a4e4395454d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355858 expref: 12 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.613982:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053994112:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.613991:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949053994624:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.614017:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.614346:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.614363:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7602 00000100:00100000:2.0:1746129818.614368:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054270208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.614375:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.614382:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.614390:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.614403:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3a000/0x48868a4e439544c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355819 expref: 20 pid: 10930 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.614842:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.614872:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054270208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 504us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.614878:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7602 00010000:00010000:0.0:1746129818.614880:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 30 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.614896:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7603 00000100:00100000:0.0:1746129818.614900:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054270592:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129818.615361:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.615371:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270848 00000100:00100000:2.0:1746129818.615374:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270848 00010000:00010000:2.0:1746129818.615385:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 15 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.615397:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7604 00000100:00100000:2.0:1746129818.615400:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054270848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.615407:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.615416:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 15 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.615423:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 15 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.615434:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.615447:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054270848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.615453:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7604 00000100:00100000:2.0:1746129818.615474:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.615482:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270720 00000100:00100000:2.0:1746129818.615484:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270720 00010000:00010000:2.0:1746129818.615492:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 12 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.615502:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7605 00000100:00100000:2.0:1746129818.615506:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054270720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.615511:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.615517:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 12 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615523:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 12 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615532:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.615542:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054270720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 36us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.615546:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7605 00000100:00100000:2.0:1746129818.615573:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.615580:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054270976 00000100:00100000:2.0:1746129818.615582:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054270976 00010000:00010000:2.0:1746129818.615589:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.615599:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7606 00000100:00100000:2.0:1746129818.615603:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054270976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.615607:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.615612:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615619:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615627:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.615629:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.615632:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.615639:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.615650:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.615661:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054270976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.615665:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7606 00000100:00100000:2.0:1746129818.615692:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.615700:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054271104 00000100:00100000:2.0:1746129818.615702:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054271104 00010000:00010000:2.0:1746129818.615709:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.615719:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7607 00000100:00100000:2.0:1746129818.615723:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054271104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.615728:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.615735:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615741:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615749:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffbda00/0x48868a4e439544ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355804 expref: 15 pid: 7976 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.615757:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.615758:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.615760:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.615765:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.615774:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.615785:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054271104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.615789:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7607 00000100:00100000:2.0:1746129818.615830:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053994496:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.615897:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053995136:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.615917:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949053995264:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.615931:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.615950:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.615957:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054271232 00000100:00100000:2.0:1746129818.615959:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054271232 00010000:00010000:2.0:1746129818.615967:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 15 pid: 20441 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.615978:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7608 00000100:00100000:2.0:1746129818.615981:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054271232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.615986:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.615994:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 15 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.616001:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 15 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.616009:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e43954618 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558e4 expref: 15 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.616022:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.616033:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054271232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (83us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.616037:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7608 00000100:00100000:2.0:1746129818.616070:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.616080:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054271360 00000100:00100000:2.0:1746129818.616082:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054271360 00010000:00010000:2.0:1746129818.616091:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:3.0:1746129818.616452:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a80df800/0x48868a4e439545b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355897 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.616461:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949053994880:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.616475:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.616604:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054269056:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 11070us (11302us total) trans 21474841271 rc 0/0 00000100:00100000:1.0:1746129818.616611:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1840 00002000:00100000:1.0:1746129818.616618:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3239936->3887103) req@ffff88012d634380 x1830949054269056/t21474841271(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.616626:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634380 with x1830949054269056 ext(3239936->3887103) 00010000:00010000:1.0:1746129818.616632:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 14 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.616639:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 14 pid: 20441 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746129818.616645:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d634380 00010000:00010000:1.0:1746129818.616671:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c841a00/0x48868a4e43954538 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35583c expref: 11 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.616680:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053994368:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.616688:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67400/0x48868a4e4395449e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3557ef expref: 13 pid: 7976 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.616695:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949053995008:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.616708:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616714:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616720:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616734:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616745:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616751:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616756:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d08da00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129818.616760:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616766:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616775:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.616779:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08da00/0x48868a4e43954729 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.616813:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054269184:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 9688us (10370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.616819:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15247 00000100:00100000:2.0:1746129818.616892:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7609 00000100:00100000:2.0:1746129818.616900:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054271360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.616906:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.616914:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.616920:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.616927:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e43954688 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355915 expref: 12 pid: 20441 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.616935:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.616950:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054271360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (879us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129818.617532:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.617544:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 30 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.617552:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 30 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.617564:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e439545e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ac expref: 30 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.617572:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.617573:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.617576:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.617582:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.617608:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129818.617626:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054270592:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2724us (3717us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.617685:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617692:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617705:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617711:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617716:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617721:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0e9400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.617730:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617736:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617745:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.617750:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9400/0x48868a4e43954714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.617780:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054269312:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 11171us (11401us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.617785:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15244 00000100:00100000:2.0:1746129818.617842:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7609 00000100:00100000:0.0:1746129818.617869:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7603 00000100:00100000:0.0:1746129818.617924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.617935:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054271488 00000100:00100000:0.0:1746129818.617938:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054271488 00010000:00010000:0.0:1746129818.617949:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.617964:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7610 00000100:00100000:0.0:1746129818.617969:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054271488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.617975:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.617982:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.617990:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.617999:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135676000/0x48868a4e439545ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558ba expref: 29 pid: 1877 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.618006:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.618007:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.618010:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.618019:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.618032:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129818.618047:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054271488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.618051:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7610 00000100:00100000:3.0:1746129818.619403:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054269952:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9008us (9618us total) trans 17179874081 rc 0/0 00000100:00100000:3.0:1746129818.619411:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1841 00002000:00100000:3.0:1746129818.619418:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2482176->2793471) req@ffff88009206c000 x1830949054269952/t17179874081(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.619426:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206c000 with x1830949054269952 ext(2482176->2793471) 00010000:00010000:3.0:1746129818.619433:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.619441:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.619447:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206c000 00010000:00010000:1.0:1746129818.619552:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619560:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619577:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619583:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619588:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619593:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8e9a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129818.619595:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619600:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619611:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.619617:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e9a00/0x48868a4e4395471b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.619647:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054269568:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 13027us (13240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.619652:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15245 00010000:00010000:3.0:1746129818.619705:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619712:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619725:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619730:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619736:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619744:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093beea00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.619746:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619752:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619761:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.619766:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093beea00/0x48868a4e43954730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.619811:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054269440:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 12611us (13356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.619816:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15248 00000100:00100000:0.0:1746129818.622063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.622196:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054271616 00000100:00100000:3.0:1746129818.622202:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054271616 00010000:00010000:3.0:1746129818.622225:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.622293:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7611 00000100:00100000:3.0:1746129818.622300:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054271616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.622310:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.622324:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.622334:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.622351:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305a7200/0x48868a4e4395467a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3239936->3887103) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355907 expref: 13 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.622361:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.622363:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.622369:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.622376:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.622403:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.622411:0:10979:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 18 pid: 1140 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.622421:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053995520:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129818.622492:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.622699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.622737:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054271744 00000100:00100000:2.0:1746129818.622741:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054271744 00010000:00010000:2.0:1746129818.622759:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.622776:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7612 00000100:00100000:2.0:1746129818.622781:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054271744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.622789:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.622800:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.622807:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.622818:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e43954657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2793471) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3558f9 expref: 28 pid: 20441 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.622826:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.622828:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.622830:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.622835:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.622873:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.622905:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054271744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 124us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.622910:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7612 00010000:00010000:0.0:1746129818.622956:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.622962:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.622978:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.622987:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.622993:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.622998:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129818.623000:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.623010:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.623071:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.623077:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43954722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.623110:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054269824:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 16221us (16680us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.623116:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15246 00000100:00100000:3.0:1746129818.624918:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949053995520:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129818.624932:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.625204:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054271616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2902us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.625211:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7611 00000100:00100000:0.0:1746129818.625779:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.626242:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054272000 00000100:00100000:3.0:1746129818.626247:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054272000 00002000:00100000:3.0:1746129818.626412:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008f90b800 x1830949054272000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.626422:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b800 with x1830949054272000 ext(2097152->3145727) 00010000:00010000:3.0:1746129818.626429:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.626443:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.626450:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f90b800 00000100:00100000:3.0:1746129818.626600:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1842 00000100:00100000:3.0:1746129818.626654:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054272000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.633130:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054272000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6515us (7344us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.633141:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1842 00002000:00100000:3.0:1746129818.633151:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008f90b800 x1830949054272000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.633185:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b800 with x1830949054272000 ext(2097152->3145727) 00010000:00010000:3.0:1746129818.633211:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.633227:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00002000:00010000:3.0:1746129818.633234:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f90b800 00000100:00100000:0.0:1746129818.636714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.637914:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054272128 00000100:00100000:2.0:1746129818.637922:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054272128 00000100:00100000:2.0:1746129818.638024:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15250 00000100:00100000:2.0:1746129818.638031:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31475:x1830949054272128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.638045:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.638060:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355962 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129818.638085:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d39b, atime: 0x6813d39a, ctime: 0x6813d39b, blocks: 0x1029 00010000:00010000:2.0:1746129818.638102:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.638104:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.638111:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 28 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.638123:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 28 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.638131:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e9200, rc 0) 00000100:00100000:2.0:1746129818.638441:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31475:x1830949054272128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 409us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.638447:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15250 00000100:00100000:0.0:1746129818.640471:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.640543:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054272256 00000100:00100000:3.0:1746129818.640548:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054272256 00010000:00010000:3.0:1746129818.640571:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.640618:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7613 00000100:00100000:3.0:1746129818.640624:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054272256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.640633:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.640647:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.640656:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.640671:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800924f9600/0x48868a4e439546f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355954 expref: 19 pid: 1140 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.640682:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.640684:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.640687:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.640698:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.640724:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.640750:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054272256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 125us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.640754:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7613 00010000:00010000:1.0:1746129818.640764:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640774:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640791:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640798:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640804:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640810:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095347e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129818.640813:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640820:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640828:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.640833:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095347e00/0x48868a4e43954737 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.640907:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054269696:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 33510us (34436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.640914:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15249 00000100:00100000:0.0:1746129818.642030:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.643099:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054272512 00000100:00100000:3.0:1746129818.643105:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054272512 00002000:00100000:3.0:1746129818.643132:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88008f908a80 x1830949054272512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.643138:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f908a80 with x1830949054272512 ext(2097152->3145727) 00002000:00010000:3.0:1746129818.643141:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f908a80 00000100:00100000:3.0:1746129818.643174:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6798 00000100:00100000:3.0:1746129818.643179:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054272512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.643252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.643313:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054272768 00000100:00100000:2.0:1746129818.643317:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054272768 00000100:00100000:2.0:1746129818.643339:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10972 00000100:00100000:2.0:1746129818.643343:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31472:x1830949054272768:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129818.643373:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.643391:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093befe00/0x48868a4e439546dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355938 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643406:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.643409:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.643433:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.643446:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643451:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643456:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 20 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643461:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 297 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643466:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643471:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.643494:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643503:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 20 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.643513:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053995648:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.643568:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 297 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643578:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 297 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.643583:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053995776:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.643602:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 20 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643607:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 20 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.643613:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053995904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.643630:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643635:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.643641:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053996032:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.643656:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 20 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.643661:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 20 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.643666:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053996160:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.643741:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.647706:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053995648:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.647716:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053995776:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.647721:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053995904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.648283:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.648307:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.648344:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.648397:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273024 00000100:00100000:2.0:1746129818.648403:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273024 00000100:00100000:3.0:1746129818.648414:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054272896 00000100:00100000:3.0:1746129818.648418:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054272896 00010000:00010000:2.0:1746129818.648425:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.648432:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 21 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.648443:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273152 00000100:00100000:2.0:1746129818.648444:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273152 00000100:00100000:3.0:1746129818.648450:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7614 00010000:00010000:2.0:1746129818.648451:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 22 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.648456:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054273024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.648467:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129818.648468:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7615 00010000:00010000:3.0:1746129818.648472:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.648472:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054272896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.648480:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.648481:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.648484:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 22 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:3.0:1746129818.648500:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b539b600/0x48868a4e439542fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355724 expref: 298 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.648520:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7616 00000100:00100000:0.0:1746129818.648525:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054273152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.648532:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.648536:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 22 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.648558:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 22 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.648570:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20400/0x48868a4e4395426e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556ad expref: 22 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:2.0:1746129818.648579:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.648583:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.648589:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.648617:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054272896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 144us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.648622:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7615 00010000:00010000:3.0:1746129818.648681:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.648687:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.648692:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129818.648696:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 20 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.648705:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8e00/0x48868a4e4395431d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35572b expref: 20 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.648711:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949054273024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 255us (430us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129818.648715:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00000100:00100000:3.0:1746129818.648717:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7614 00010000:00010000:0.0:1746129818.648718:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.648722:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129818.648735:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054273152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 211us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.648739:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7616 00000100:00100000:2.0:1746129818.650932:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053996032:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.651268:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.651296:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.651314:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273280 00000100:00100000:0.0:1746129818.651318:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273280 00010000:00010000:0.0:1746129818.651341:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.651372:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053996160:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.651372:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273408 00000100:00100000:0.0:1746129818.651374:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273408 00010000:00010000:0.0:1746129818.651382:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 19 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.651395:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7617 00010000:00010000:2.0:1746129818.651398:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129818.651399:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949054273280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.651410:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.651415:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.651455:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7618 00000100:00100000:1.0:1746129818.651463:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054273408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.651469:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.651473:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 19 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.651546:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.651559:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 19 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.651574:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20800/0x48868a4e43954267 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3556a6 expref: 297 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.651577:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e43954259 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35569f expref: 19 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.651585:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.651589:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.651595:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.651600:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129818.651606:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129818.651608:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129818.651622:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.651636:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054273408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 175us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.651636:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949054273280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 236us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.651642:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7618 00000100:00100000:0.0:1746129818.651644:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7617 00010000:00010000:2.0:1746129818.651714:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.651720:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:2.0:1746129818.652397:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3487, 88 off293584 00000004:00080000:2.0:1746129818.652404:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710555762ns, next at 731767308185ns, rc = 0 00000100:00100000:3.0:1746129818.652423:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054272512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9242us (10395us total) trans 0 rc 1048576/1048576 00000040:00080000:2.0:1746129818.652451:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3496, 88 off294288 00000004:00080000:2.0:1746129818.652456:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710608145ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652475:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3497, 88 off294376 00000004:00080000:2.0:1746129818.652478:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710629735ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652486:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3488, 88 off293672 00000004:00080000:2.0:1746129818.652488:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710640115ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652541:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3489, 88 off293760 00000004:00080000:2.0:1746129818.652545:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710696903ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652551:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3498, 88 off294464 00000004:00080000:2.0:1746129818.652554:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710706554ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652560:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3499, 88 off294552 00000004:00080000:2.0:1746129818.652562:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710714034ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652567:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3500, 88 off294640 00000004:00080000:2.0:1746129818.652570:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710721947ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652575:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3490, 88 off293848 00000004:00080000:2.0:1746129818.652577:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710729239ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652582:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3501, 88 off294728 00000004:00080000:2.0:1746129818.652584:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710736105ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652589:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3491, 88 off293936 00000004:00080000:2.0:1746129818.652591:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710742849ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652596:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3502, 88 off294816 00000004:00080000:2.0:1746129818.652598:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710750364ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.652604:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3492, 88 off294024 00000004:00080000:2.0:1746129818.652606:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710758069ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652612:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3493, 88 off294112 00000004:00080000:2.0:1746129818.652614:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710766354ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652622:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3494, 88 off294200 00000004:00080000:2.0:1746129818.652624:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710776560ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652632:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3495, 88 off294288 00000004:00080000:2.0:1746129818.652634:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764710786164ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.652668:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3504, 88 off295000 00000004:00080000:2.0:1746129818.652671:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764710823610ns, next at 716792379979ns, rc = 0 00000100:00100000:3.0:1746129818.652673:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6798 00002000:00100000:3.0:1746129818.652681:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88008f908a80 x1830949054272512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.652689:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f908a80 with x1830949054272512 ext(2097152->3145727) 00002000:00010000:3.0:1746129818.652692:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f908a80 00000100:00100000:2.0:1746129818.657690:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.657736:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273536 00000100:00100000:1.0:1746129818.657749:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273536 00000100:00100000:1.0:1746129818.657794:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15251 00000100:00100000:1.0:1746129818.657802:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31475:x1830949054273536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.657816:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.657831:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355969 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129818.657866:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x15e5 00010000:00010000:1.0:1746129818.657882:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.657884:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.657890:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.657902:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.657910:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb4a00, rc 0) 00000100:00100000:1.0:1746129818.657949:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31475:x1830949054273536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 148us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.657955:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15251 00000100:00100000:1.0:1746129818.661073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.661148:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273664 00000100:00100000:0.0:1746129818.661155:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273664 00000100:00100000:0.0:1746129818.661192:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10973 00000100:00100000:0.0:1746129818.661198:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31475:x1830949054273664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129818.661213:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.661226:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355970 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.661265:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.661273:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 297 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.661286:0:14314:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.661294:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 297 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.661303:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.661306:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129818.661309:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 297 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.661315:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a238800, rc 0) 00000100:00100000:0.0:1746129818.661344:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31475:x1830949054273664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 145us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.661349:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10973 00000001:00080000:0.0:1746129818.674593:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944963 is committed 00000001:00080000:0.0:1746129818.674607:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944959 is committed 00000001:00080000:0.0:1746129818.674610:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944951 is committed 00000004:00010000:2.0:1746129818.674611:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f909f80 reply state ffff880134ab0c00 transno 8589944965 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129818.674620:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746129818.674620:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944962 is committed 00000001:00080000:0.0:1746129818.674629:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944965 is committed 00000004:00080000:0.0:1746129818.674632:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2671 committed 00010000:00080000:2.0:1746129818.674711:0:14315:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129818.674741:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31472:x1830949054272768:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 31393us (31485us total) trans 8589944965 rc 0/0 00000100:00100000:2.0:1746129818.674748:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10972 00010000:00010000:3.0:1746129818.674890:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 00000004:00080000:0.0:1746129818.674916:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2668 committed 00000004:00080000:0.0:1746129818.674921:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2667 committed 00000004:00080000:0.0:1746129818.674923:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2666 committed 00000004:00080000:0.0:1746129818.674924:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2665 committed 00000004:00080000:0.0:1746129818.674926:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2670 committed 00000004:00080000:0.0:1746129818.674927:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2664 committed 00000004:00080000:0.0:1746129818.674928:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2669 committed 00000004:00080000:0.0:1746129818.674929:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2663 committed 00000004:00080000:0.0:1746129818.674931:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2668 committed 00000004:00080000:0.0:1746129818.674932:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2667 committed 00000004:00080000:0.0:1746129818.674933:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2666 committed 00000004:00080000:0.0:1746129818.674934:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2662 committed 00000004:00080000:0.0:1746129818.674935:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2661 committed 00000004:00080000:0.0:1746129818.674936:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2665 committed 00000004:00080000:0.0:1746129818.674937:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2664 committed 00000004:00080000:0.0:1746129818.674939:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2660 committed 00000001:00080000:0.0:1746129818.674946:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944961 is committed 00010000:00010000:3.0:1746129818.675092:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.675101:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.675106:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8e8c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.675109:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.675116:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.675129:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.675131:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129818.675136:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 281 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.675144:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 281 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.675151:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 281 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.675185:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 281 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.675196:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3282:1830949053997312:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129818.675249:0:3282:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.675253:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053996288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675258:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053996416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675281:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053996672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.675281:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129818.675298:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053996800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675301:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129818.675311:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.675313:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053997184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675324:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129818.675326:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053996544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.675338:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.675343:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996288 00000100:00100000:1.0:1746129818.675348:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053997056:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675349:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996288 00000100:00100000:1.0:1746129818.675359:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.675369:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996672 00000100:00100000:3.0:1746129818.675371:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996672 00000100:00100000:3.0:1746129818.675379:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996800 00000100:00100000:3.0:1746129818.675381:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996800 00000100:00100000:3.0:1746129818.675388:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997184 00000100:00100000:3.0:1746129818.675390:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997184 00000100:00100000:3.0:1746129818.675396:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996544 00000100:00100000:3.0:1746129818.675398:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996544 00000100:00100000:3.0:1746129818.675406:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997056 00000100:00100000:3.0:1746129818.675407:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997056 00000100:00100000:3.0:1746129818.675417:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15252 00000100:00100000:3.0:1746129818.675422:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053996288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.675445:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15253 00000100:00100000:1.0:1746129818.675451:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3299:x1830949053996672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675472:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15254 00000100:00100000:3.0:1746129818.675476:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949053996800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.675534:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15255 00000100:00100000:1.0:1746129818.675538:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053997184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675564:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3296:x1830949053996800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (252us total) trans 17179874082 rc 0/0 00000100:00100000:3.0:1746129818.675569:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15254 00000100:00100000:3.0:1746129818.675581:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15256 00000100:00100000:3.0:1746129818.675585:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3298:x1830949053996544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.675606:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3299:x1830949053997184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (280us total) trans 17179874084 rc 0/0 00000100:00100000:1.0:1746129818.675611:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15255 00000100:00100000:1.0:1746129818.675619:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15257 00000100:00100000:1.0:1746129818.675623:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+51:3298:x1830949053997056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129818.675649:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129818.675652:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:3.0:1746129818.675654:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129818 -> 1746129818 00002000:00010000:3.0:1746129818.675656:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:3.0:1746129818.675658:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129818.675674:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053996544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (335us total) trans 17179874085 rc 0/0 00000100:00100000:3.0:1746129818.675679:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15256 00000100:00100000:1.0:1746129818.675679:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+53:3298:x1830949053997056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (320us total) trans 17179874086 rc 0/0 00000100:00100000:1.0:1746129818.675684:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15257 00000100:00100000:1.0:1746129818.675696:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053997696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.675700:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129818.675737:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3299:x1830949053996672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 287us (439us total) trans 17179874083 rc 0/0 00000100:00100000:1.0:1746129818.675741:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15253 00000100:00100000:3.0:1746129818.675791:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053996928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.675806:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129818.676380:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996416 00000100:00100000:1.0:1746129818.676384:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996416 00000100:00100000:3.0:1746129818.676500:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053997568:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129818.676513:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15258 00000100:00100000:1.0:1746129818.676519:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3297:x1830949053996416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.676753:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3297:x1830949053996416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (1051us total) trans 17179874087 rc 0/0 00000100:00100000:3.0:1746129818.676785:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129818.676792:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053996928 00000100:00100000:0.0:1746129818.676795:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053996928 00000100:00100000:3.0:1746129818.676796:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053998080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.676807:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997568 00000100:00100000:3.0:1746129818.676809:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129818.676809:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997568 00000100:00100000:0.0:1746129818.676816:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998080 00000100:00100000:0.0:1746129818.676817:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998080 00000100:00100000:0.0:1746129818.676824:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15259 00000100:00100000:0.0:1746129818.676827:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3297:x1830949053996928:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129818.676829:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242a00/2, rc 0, transno 17179874087 00000100:00100000:3.0:1746129818.676833:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053996416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.676839:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129818.676843:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053997440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.676872:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.676879:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053997952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.676890:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.676902:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997440 00000100:00100000:3.0:1746129818.676904:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997440 00000100:00100000:3.0:1746129818.676914:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997952 00000100:00100000:3.0:1746129818.676915:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997952 00000100:00100000:3.0:1746129818.676922:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15260 00000100:00100000:0.0:1746129818.676923:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3297:x1830949053996928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (1117us total) trans 17179874088 rc 0/0 00000100:00100000:3.0:1746129818.676925:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3297:x1830949053997568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.676928:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15259 00000100:00100000:0.0:1746129818.676936:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15261 00000100:00100000:0.0:1746129818.676940:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+62:3297:x1830949053998080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.676968:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15262 00000100:00100000:0.0:1746129818.676971:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3297:x1830949053997440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.677922:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15263 00000100:00100000:1.0:1746129818.677928:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15258 00000100:00100000:2.0:1746129818.677931:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+64:3297:x1830949053997952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.678419:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+65:3297:x1830949053997568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1491us (1632us total) trans 21474841272 rc 0/0 00000100:00100000:0.0:1746129818.678422:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3297:x1830949053997440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1450us (1550us total) trans 21474841273 rc 0/0 00000100:00100000:3.0:1746129818.678427:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15260 00000100:00100000:0.0:1746129818.678430:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15262 00000100:00100000:3.0:1746129818.678454:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053997824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.678464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.678475:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.678487:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053998336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.678499:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746129818.678518:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242300/2, rc 0, transno 17179874083 00000100:00100000:3.0:1746129818.678522:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053996672:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129818.678530:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adbb80/2, rc 0, transno 17179874084 00000100:00100000:3.0:1746129818.678532:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053997184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129818.678534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.678546:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997824 00000100:00100000:3.0:1746129818.678549:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997824 00000100:00100000:0.0:1746129818.678550:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273920 00000100:00100000:0.0:1746129818.678552:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273920 00000100:00100000:3.0:1746129818.678562:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998336 00000100:00100000:3.0:1746129818.678563:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998336 00000100:00100000:0.0:1746129818.678568:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4571 00000100:00100000:3.0:1746129818.678572:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15264 00000100:00100000:0.0:1746129818.678572:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31475:x1830949054273920:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129818.678575:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3299:x1830949053997824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.678635:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31475:x1830949054273920:12345-192.168.204.31@tcp:49:cat.0 Request processed in 62us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.678640:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4571 00000100:00100000:3.0:1746129818.678653:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+66:3299:x1830949053997824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (177us total) trans 21474841275 rc 0/0 00000100:00100000:3.0:1746129818.678658:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15264 00000100:00100000:0.0:1746129818.678661:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15265 00000100:00100000:0.0:1746129818.678665:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+65:3299:x1830949053998336:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129818.678674:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206e680/2, rc 0, transno 21474841275 00000100:00100000:3.0:1746129818.678681:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053997824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.678699:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3282:1830949053997312:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129818.678731:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746129818.679312:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.679320:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b8e8c00/0x48868a4e43954745 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129818.679341:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053997696 00000100:00100000:3.0:1746129818.679344:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053997696 00000100:00100000:3.0:1746129818.679359:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15266 00000100:00100000:3.0:1746129818.679363:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3298:x1830949053997696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129818.679446:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:3.0:1746129818.679449:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:3.0:1746129818.679451:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:3.0:1746129818.679452:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:3.0:1746129818.679454:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:0.0:1746129818.679463:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3299:x1830949053998336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 798us (962us total) trans 21474841276 rc 0/0 00000100:00100000:0.0:1746129818.679468:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15265 00000100:00100000:3.0:1746129818.679471:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949053997696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (740us total) trans 21474841277 rc 0/0 00000100:00100000:3.0:1746129818.679475:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15266 00000004:00080000:3.0:1746129818.679493:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18380/2, rc 0, transno 21474841276 00000100:00100000:3.0:1746129818.679496:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053998336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129818.679509:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009423c000/2, rc 0, transno 21474841273 00000100:00100000:3.0:1746129818.679511:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053997440:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129818.679518:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206c380/2, rc 0, transno 21474841272 00000100:00100000:3.0:1746129818.679520:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053997568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129818.679528:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adb800/2, rc 0, transno 17179874088 00000100:00100000:3.0:1746129818.679531:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053996928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129818.679750:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009206d500/2, rc 0, transno 21474841277 00000100:00100000:1.0:1746129818.679754:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053997696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.679758:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3297:x1830949053998080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2817us (2948us total) trans 21474841278 rc 0/0 00000100:00100000:1.0:1746129818.679759:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053998208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.679763:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15261 00000100:00100000:1.0:1746129818.679777:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129818.679792:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095241180/2, rc 0, transno 17179874085 00000100:00100000:0.0:1746129818.679792:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998208 00000100:00100000:0.0:1746129818.679794:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998208 00000100:00100000:1.0:1746129818.679795:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053996544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129818.679801:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adad80/2, rc 0, transno 17179874086 00000100:00100000:1.0:1746129818.679804:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053997056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129818.679805:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15267 00000100:00100000:0.0:1746129818.679809:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+67:3298:x1830949053998208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129818.679886:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129818.679888:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129818.679890:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129818.679891:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129818.679892:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:3.0:1746129818.679913:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19500/2, rc 0, transno 21474841278 00000100:00100000:3.0:1746129818.679916:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053998080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.679917:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949053998208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (139us total) trans 21474841279 rc 0/0 00000100:00100000:3.0:1746129818.679920:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129818.679922:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15267 00000100:00100000:3.0:1746129818.679925:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053998464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.679947:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.679962:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053998464 00000100:00100000:3.0:1746129818.679964:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053998464 00000100:00100000:3.0:1746129818.679976:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15268 00000100:00100000:2.0:1746129818.680102:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053997952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2173us (3209us total) trans 21474841274 rc 0/0 00000100:00100000:2.0:1746129818.680108:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15263 00000100:00100000:2.0:1746129818.680133:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054273792 00000100:00100000:2.0:1746129818.680136:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054273792 00000100:00100000:2.0:1746129818.680154:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10974 00000100:00100000:2.0:1746129818.680158:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31472:x1830949054273792:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129818.680179:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.680190:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355977 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.680221:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.680232:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.680244:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.680246:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129818.680249:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be5e800, rc 0) 00000100:00100000:2.0:1746129818.680269:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31472:x1830949054273792:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 111us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.680277:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10974 00000100:00100000:1.0:1746129818.680863:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3296:x1830949053996288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5440us (5581us total) trans 17179874089 rc 0/0 00000100:00100000:1.0:1746129818.680869:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15252 00000004:00080000:1.0:1746129818.680928:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095241c00/2, rc 0, transno 17179874089 00000100:00100000:1.0:1746129818.680932:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053996288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129818.680939:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095241f80/2, rc 0, transno 17179874082 00000100:00100000:1.0:1746129818.680942:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095241f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053996800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129818.680954:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1ad80/2, rc 0, transno 21474841279 00000100:00100000:1.0:1746129818.680957:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053998208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.681002:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053998464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.681099:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+68:3297:x1830949053998464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1117us (1151us total) trans 21474841280 rc 0/0 00000100:00100000:3.0:1746129818.681110:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15268 00000004:00080000:3.0:1746129818.681131:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8792300/2, rc 0, transno 21474841280 00000100:00100000:3.0:1746129818.681134:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053998464:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129818.681141:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130505c00/2, rc 0, transno 21474841274 00000100:00100000:3.0:1746129818.681144:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130505c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053997952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.683364:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.684133:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054274176 00000100:00100000:3.0:1746129818.684141:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054274176 00000100:00100000:3.0:1746129818.684197:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10975 00000100:00100000:3.0:1746129818.684205:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31479:x1830949054274176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.684221:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.684235:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43954761 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35597e expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.684317:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684327:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684336:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684347:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684353:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684358:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684442:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684449:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684455:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129818.684462:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129818.684556:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684562:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684568:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684573:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53a0600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.684577:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684583:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684592:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.684595:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129818.684597:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684602:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53a0600/0x48868a4e43954776 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684613:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684618:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684622:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684626:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094be4c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.684872:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684878:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684885:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129818.684887:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.684889:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684894:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4c00/0x48868a4e43954768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684901:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684905:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684909:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684913:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0e9c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.684915:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684919:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684924:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a8177a00) 00010000:00010000:3.0:1746129818.684926:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.684927:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684931:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9c00/0x48868a4e4395476f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.684959:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43954761 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35597e expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.684965:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43954761 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35597e expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.684971:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094be4600, rc 0) 00000100:00100000:3.0:1746129818.685020:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31479:x1830949054274176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 815us (1660us total) trans 8589944966 rc 301/301 00000100:00100000:3.0:1746129818.685026:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10975 00000100:00100000:0.0:1746129818.685619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.685652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.685687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.685745:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054274304 00000100:00100000:3.0:1746129818.685749:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054274304 00000100:00100000:3.0:1746129818.685769:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10976 00000100:00100000:3.0:1746129818.685774:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31472:x1830949054274304:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129818.685782:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.685789:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0200/0x48868a4e43954784 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355985 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.685829:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e4395478b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.685836:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e4395478b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.685842:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e4395478b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129818.685885:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129818.685889:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129818.685896:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e4395478b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.685912:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0200/0x48868a4e43954784 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355985 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.685912:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054274560 00000100:00100000:1.0:1746129818.685916:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054274560 00010000:00010000:3.0:1746129818.685923:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e4395478b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355985 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.685929:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.685931:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129818.685933:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d1600, rc 0) 00002000:00100000:1.0:1746129818.685941:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800936ddc00 x1830949054274560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.685948:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830949054274560 ext(3145728->4194303) 00002000:00010000:1.0:1746129818.685952:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936ddc00 00000100:00100000:3.0:1746129818.685953:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31472:x1830949054274304:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 178us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.685958:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10976 00000100:00100000:1.0:1746129818.685963:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054274816 00000100:00100000:1.0:1746129818.685965:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054274816 00002000:00100000:1.0:1746129818.685976:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba38000 x1830949054274816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129818.685977:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6799 00002000:00100000:1.0:1746129818.685981:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949054274816 ext(3145728->4194303) 00000100:00100000:3.0:1746129818.685982:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054274560:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:1.0:1746129818.685984:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38000 00000100:00100000:1.0:1746129818.685993:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6800 00000100:00100000:1.0:1746129818.685997:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054274816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.689372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.690199:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054274944 00000100:00100000:2.0:1746129818.690206:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054274944 00000100:00100000:2.0:1746129818.690238:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10977 00000100:00100000:2.0:1746129818.690244:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31479:x1830949054274944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.690262:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.690276:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43954792 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35598c expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.690336:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.690346:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.690355:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129818.690374:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129818.690377:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129818.690388:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.690407:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5fa00/0x48868a4e43954792 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.690418:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.690425:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.690428:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129818.690431:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009be5e200, rc 0) 00000100:00100000:2.0:1746129818.690457:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31479:x1830949054274944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 213us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.690462:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10977 00000100:00100000:2.0:1746129818.694028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.695195:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275200 00000100:00100000:3.0:1746129818.695203:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275200 00000100:00100000:3.0:1746129818.695241:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15269 00000100:00100000:3.0:1746129818.695248:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054275200:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129818.695263:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.695280:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35599a expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129818.695301:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d39a, atime: 0x6813d399, ctime: 0x6813d39a, blocks: 0x821 00010000:00010000:3.0:1746129818.695319:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.695320:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.695328:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.695341:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129818.695350:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d0a00, rc 0) 00000100:00100000:3.0:1746129818.695741:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054275200:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 492us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.695747:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15269 00000100:00100000:0.0:1746129818.699056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.699098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.699125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.699137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.699149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.699233:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275456 00000100:00100000:0.0:1746129818.699240:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275456 00000100:00100000:0.0:1746129818.699267:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275712 00000100:00100000:0.0:1746129818.699269:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275712 00000100:00100000:0.0:1746129818.699277:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275072 00000100:00100000:0.0:1746129818.699279:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275072 00000100:00100000:0.0:1746129818.699287:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275328 00000100:00100000:0.0:1746129818.699288:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275328 00000100:00100000:0.0:1746129818.699295:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275584 00000100:00100000:0.0:1746129818.699296:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275584 00000100:00100000:0.0:1746129818.699307:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15270 00000100:00100000:0.0:1746129818.699314:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054275456:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129818.699327:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.699340:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559a8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129818.699360:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d399, atime: 0x6813d399, ctime: 0x6813d39a, blocks: 0x821 00010000:00010000:0.0:1746129818.699374:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699376:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699382:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699395:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699403:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08de00, rc 0) 00000100:00100000:0.0:1746129818.699432:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054275456:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 119us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.699437:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15270 00000100:00100000:0.0:1746129818.699449:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15271 00000100:00100000:0.0:1746129818.699453:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054275712:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129818.699459:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.699467:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559b6 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.699475:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699476:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699479:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699488:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699494:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c000, rc 0) 00000100:00100000:0.0:1746129818.699507:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054275712:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 53us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.699511:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15271 00000100:00100000:0.0:1746129818.699520:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15272 00000100:00100000:0.0:1746129818.699524:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054275072:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129818.699528:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.699534:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355993 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129818.699544:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d39a, atime: 0x6813d399, ctime: 0x6813d39a, blocks: 0x7e7 00010000:00010000:0.0:1746129818.699550:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699551:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699555:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699562:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699567:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08cc00, rc 0) 00000100:00100000:0.0:1746129818.699579:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054275072:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 55us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.699586:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15272 00000100:00100000:0.0:1746129818.699594:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15273 00000100:00100000:0.0:1746129818.699598:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054275328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129818.699602:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.699608:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559a1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129818.699619:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d39a, atime: 0x6813d39a, ctime: 0x6813d39a, blocks: 0x821 00010000:00010000:0.0:1746129818.699625:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699626:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699629:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699637:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699642:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08d400, rc 0) 00000100:00100000:0.0:1746129818.699655:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054275328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.699659:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15273 00000100:00100000:0.0:1746129818.699667:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15274 00000100:00100000:0.0:1746129818.699671:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054275584:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129818.699676:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.699682:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559af expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.699695:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699696:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.699699:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699708:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.699713:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08d600, rc 0) 00000100:00100000:0.0:1746129818.699724:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054275584:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 52us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.699728:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15274 00000100:00100000:3.0:1746129818.700651:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054274560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14666us (14996us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.700659:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6799 00002000:00100000:3.0:1746129818.700666:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800936ddc00 x1830949054274560/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.700674:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddc00 with x1830949054274560 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.700678:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936ddc00 00000100:00100000:2.0:1746129818.702972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.702984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.702994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.703005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.704313:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054274816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18310us (18620us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129818.704324:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6800 00002000:00100000:0.0:1746129818.704333:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba38000 x1830949054274816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.704343:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949054274816 ext(3145728->4194303) 00002000:00010000:0.0:1746129818.704347:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba38000 00000100:00100000:2.0:1746129818.705111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.705305:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275840 00000100:00100000:1.0:1746129818.705313:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275840 00000100:00100000:1.0:1746129818.705355:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054275968 00000100:00100000:1.0:1746129818.705358:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054275968 00000100:00100000:1.0:1746129818.705372:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054276096 00000100:00100000:1.0:1746129818.705373:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054276096 00000100:00100000:1.0:1746129818.705382:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054276224 00000100:00100000:1.0:1746129818.705383:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054276224 00000100:00100000:1.0:1746129818.705396:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15275 00000100:00100000:1.0:1746129818.705402:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054275840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.705414:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.705427:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559bd expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.705447:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.705449:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.705456:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.705470:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.705484:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff98400, rc 0) 00000100:00100000:1.0:1746129818.705508:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054275840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (2542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.705512:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15275 00000100:00100000:1.0:1746129818.705526:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15276 00000100:00100000:1.0:1746129818.705531:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054275968:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.705538:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.705545:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559c4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.705555:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.705557:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.705561:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.705570:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.705576:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff98000, rc 0) 00000100:00100000:1.0:1746129818.705589:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054275968:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (2604us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.705593:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15276 00000100:00100000:1.0:1746129818.705604:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15277 00000100:00100000:1.0:1746129818.705608:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054276096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.705615:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.705620:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559cb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.705765:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15278 00000100:00100000:0.0:1746129818.705771:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054276224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129818.705778:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.705784:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559d2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.705796:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.705798:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.705801:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.705809:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.705902:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08d800, rc 0) 00000100:00100000:0.0:1746129818.705918:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054276224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 148us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.705923:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15278 00010000:00010000:1.0:1746129818.706075:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.706077:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.706081:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.706089:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.706095:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff99a00, rc 0) 00000100:00100000:1.0:1746129818.706112:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054276096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 504us (3117us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.706116:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15277 00000100:00100000:2.0:1746129818.706201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.706229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.706274:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054276352 00000100:00100000:2.0:1746129818.706277:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054276352 00000100:00100000:2.0:1746129818.706288:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054276480 00000100:00100000:2.0:1746129818.706289:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054276480 00000100:00100000:2.0:1746129818.706306:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15279 00000100:00100000:2.0:1746129818.706310:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054276352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.706316:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.706322:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559d9 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.706330:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.706331:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.706335:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.706342:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.706348:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9d200, rc 0) 00000100:00100000:2.0:1746129818.706362:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054276352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 53us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.706366:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15279 00000100:00100000:2.0:1746129818.706374:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15280 00000100:00100000:2.0:1746129818.706377:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054276480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.706382:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.706386:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559e0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.706393:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.706393:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.706396:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 16 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.706404:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 16 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.706408:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9da00, rc 0) 00000100:00100000:2.0:1746129818.706417:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054276480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.706420:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15280 00000100:00100000:0.0:1746129818.706664:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054276736 00000100:00100000:0.0:1746129818.706668:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054276736 00002000:00100000:0.0:1746129818.706689:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012c089f80 x1830949054276736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.706697:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089f80 with x1830949054276736 ext(4194304->4931583) 00002000:00010000:0.0:1746129818.706701:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c089f80 00000100:00100000:0.0:1746129818.706766:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6801 00000100:00100000:0.0:1746129818.706771:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054276736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.710750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.711061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.711660:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054276992 00000100:00100000:3.0:1746129818.711668:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054276992 00000100:00100000:3.0:1746129818.711709:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054277248 00000100:00100000:3.0:1746129818.711711:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054277248 00000100:00100000:3.0:1746129818.711740:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6802 00000100:00100000:3.0:1746129818.711748:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054276992:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129818.711778:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.711790:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.711792:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.711797:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.711807:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.713025:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6803 00000100:00100000:0.0:1746129818.713032:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054277248:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129818.713054:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.713063:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.713064:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.713067:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.713077:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.713620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.713637:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054277760 00000100:00100000:2.0:1746129818.713641:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054277760 00000100:00100000:2.0:1746129818.713666:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6804 00000100:00100000:2.0:1746129818.713670:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054277760:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129818.713683:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.713691:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.713692:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.713694:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.713702:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.714577:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.714595:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.715670:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.715742:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054277504 00000100:00100000:1.0:1746129818.715748:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054277504 00000100:00100000:1.0:1746129818.716009:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054278016 00000100:00100000:1.0:1746129818.716012:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054278016 00000100:00100000:1.0:1746129818.716033:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6805 00000100:00100000:1.0:1746129818.716039:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054277504:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129818.716064:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.716075:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.716077:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.716081:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.716092:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.717043:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6806 00000100:00100000:3.0:1746129818.717051:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054278016:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129818.717068:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.717076:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.717077:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.717080:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.717088:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.718046:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054278144 00000100:00100000:0.0:1746129818.718052:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054278144 00000100:00100000:0.0:1746129818.718157:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15281 00000100:00100000:0.0:1746129818.718172:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054278144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129818.718181:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129818.718190:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559e7 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.718201:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.718202:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.718208:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.718219:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129818.718227:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08dc00, rc 0) 00000100:00100000:0.0:1746129818.718251:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054278144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 88us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.718255:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15281 00000100:00100000:0.0:1746129818.718300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.718687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.718771:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054278400 00000100:00100000:1.0:1746129818.718774:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054278400 00000100:00100000:1.0:1746129818.718795:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15282 00000100:00100000:1.0:1746129818.718799:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054278400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129818.718807:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.718815:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559f5 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.718825:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.718827:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.718831:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.718840:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129818.718844:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054278784 00000100:00100000:0.0:1746129818.718861:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054278784 00010000:00010000:1.0:1746129818.718862:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e8000, rc 0) 00000100:00100000:1.0:1746129818.718880:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054278400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 80us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.718883:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6807 00000100:00100000:1.0:1746129818.718885:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15282 00000100:00100000:0.0:1746129818.718887:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054278784:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129818.718902:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.718909:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129818.718910:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129818.719055:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c089f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054276736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12282us (12824us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129818.719065:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6801 00002000:00100000:2.0:1746129818.719073:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012c089f80 x1830949054276736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.719081:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c089f80 with x1830949054276736 ext(4194304->4931583) 00002000:00010000:2.0:1746129818.719085:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c089f80 00010000:00010000:0.0:1746129818.719178:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.719188:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.723098:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.723328:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054278272 00000100:00100000:2.0:1746129818.723336:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054278272 00000100:00100000:1.0:1746129818.723922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.723964:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054278528 00000100:00100000:1.0:1746129818.723967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.723968:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054278528 00000100:00100000:1.0:1746129818.723981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.723989:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15283 00000100:00100000:2.0:1746129818.723995:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054278272:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129818.724003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.724008:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054279040 00010000:00010000:2.0:1746129818.724010:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129818.724012:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054279040 00000100:00100000:1.0:1746129818.724017:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129818.724024:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559ee expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.724035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.724036:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054279296 00000100:00100000:3.0:1746129818.724038:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054279296 00010000:00010000:2.0:1746129818.724043:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129818.724046:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054279680 00000100:00100000:3.0:1746129818.724047:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054279936 00000100:00100000:3.0:1746129818.724048:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054279936 00000100:00100000:1.0:1746129818.724048:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054279680 00002000:00100000:3.0:1746129818.724059:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012d635c00 x1830949054279936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.724060:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a8790380 x1830949054279680/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129818.724066:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746129818.724068:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949054279936 ext(1048576->2097151) 00002000:00100000:1.0:1746129818.724068:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790380 with x1830949054279680 ext(0->1048575) 00002000:00010000:3.0:1746129818.724072:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00002000:00010000:1.0:1746129818.724072:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8790380 00010000:00010000:2.0:1746129818.724073:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 30 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129818.724075:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054280064 00000100:00100000:3.0:1746129818.724077:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054280064 00000100:00100000:1.0:1746129818.724078:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6808 00002000:00100000:3.0:1746129818.724083:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d636a00 x1830949054280064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129818.724083:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949054279040:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129818.724087:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 30 pid: 3624 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746129818.724093:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636a00 with x1830949054280064 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.724095:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d636a00 00010000:00010000:2.0:1746129818.724096:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4f800, rc 0) 00000100:00100000:3.0:1746129818.724100:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6809 00010000:00010000:1.0:1746129818.724103:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.724104:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949054279296:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129818.724111:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.724112:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.724115:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.724116:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.724122:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129818.724123:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.724124:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.724125:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.724129:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054278272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 135us (1039us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.724132:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.724135:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15283 00000100:00100000:2.0:1746129818.724148:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15284 00000100:00100000:2.0:1746129818.724152:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054278528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.724157:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.724175:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3559fc expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.724183:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.724185:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.724188:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.724196:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.724206:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acd4f000, rc 0) 00000100:00100000:2.0:1746129818.724217:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054278528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.724221:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15284 00000100:00100000:2.0:1746129818.724340:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6810 00000100:00100000:2.0:1746129818.724344:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054279936:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.725200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.725409:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054280320 00000100:00100000:0.0:1746129818.725414:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054280320 00000100:00100000:2.0:1746129818.725432:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6811 00002000:00100000:0.0:1746129818.725432:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d634700 x1830949054280320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129818.725439:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054279680:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:0.0:1746129818.725439:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634700 with x1830949054280320 ext(1048576->2097151) 00002000:00010000:0.0:1746129818.725442:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634700 00010000:00010000:1.0:1746129818.726628:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.726639:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.726651:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.726657:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d0200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129818.726660:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.726667:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.726682:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.726688:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d0200/0x48868a4e439547f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.727129:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1964:x1830949054276992:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 15379us (16384us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.727137:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6802 00000100:00100000:1.0:1746129818.727159:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6812 00000100:00100000:1.0:1746129818.727180:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054280064:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:0.0:1746129818.727787:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.727800:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.727806:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.727812:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d08c400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129818.727814:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.727821:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.727831:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.727836:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c400/0x48868a4e439547fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.727900:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1964:x1830949054277248:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 14867us (16838us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129818.727906:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6803 00000100:00100000:0.0:1746129818.727920:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6813 00000100:00100000:0.0:1746129818.727925:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054280320:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129818.731967:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.731982:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.731990:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.731996:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fed200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.731999:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.732011:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.732026:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.732032:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fed200/0x48868a4e43954802 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.732643:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1964:x1830949054277760:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 18802us (18853us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.732654:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6804 00010000:00010000:1.0:1746129818.733964:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.733972:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.733979:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.733983:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e0e9c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129818.733985:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.733988:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.733998:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.734001:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e0e9c00/0x48868a4e43954809 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.734044:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054277504:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 18004us (19468us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.734050:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6805 00010000:00010000:3.0:1746129818.737324:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.737351:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.737359:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.737366:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094be4600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.737369:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.737377:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.737392:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.737397:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094be4600/0x48868a4e43954810 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.737464:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054278016:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 20410us (22863us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.737473:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6806 00010000:00010000:1.0:1746129818.741216:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.741233:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.741240:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.741250:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b8e8e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129818.741254:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.741261:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.741278:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.741283:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b8e8e00/0x48868a4e43954833 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.741354:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054279040:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 17266us (17382us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.741364:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6808 00000100:00100000:3.0:1746129818.742878:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054279936:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18500us (18826us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.742887:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6810 00002000:00100000:3.0:1746129818.742897:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012d635c00 x1830949054279936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.742905:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949054279936 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.742910:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00000100:00100000:0.0:1746129818.743279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.743833:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054280576 00000100:00100000:2.0:1746129818.743841:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054280576 00000100:00100000:2.0:1746129818.743895:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4572 00000100:00100000:2.0:1746129818.743902:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c562050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31475:x1830949054280576:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129818.744650:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c562050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31475:x1830949054280576:12345-192.168.204.31@tcp:35:cat.0 Request processed in 747us (1370us total) trans 8589944967 rc 0/0 00000100:00100000:2.0:1746129818.744658:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4572 00010000:00010000:2.0:1746129818.746034:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.746048:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.746055:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.746065:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b7f0600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129818.746069:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.746077:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.746093:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.746098:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b7f0600/0x48868a4e43954825 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.746399:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054278784:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 27506us (28093us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.746408:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6807 00000100:00100000:0.0:1746129818.746965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.747010:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054280832 00000100:00100000:3.0:1746129818.747017:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054280832 00000100:00100000:3.0:1746129818.747051:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10978 00000100:00100000:3.0:1746129818.747057:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31481:x1830949054280832:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129818.747074:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.747088:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67a00/0x48868a4e43954848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a03 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747183:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747194:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747202:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747212:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747217:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747221:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747314:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747323:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747330:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.747353:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747362:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 8 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.747372:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053998592:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.747448:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092480 going to sleep for 11 seconds 00010000:00010000:3.0:1746129818.747958:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747966:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747971:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747976:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f4c5200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129818.747978:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747985:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.747996:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.748002:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4c5200/0x48868a4e4395483a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129818.748054:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054279296:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 23946us (24068us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.748062:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6809 00000100:00100000:2.0:1746129818.750078:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054279680:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24633us (26067us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.750087:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6811 00002000:00100000:2.0:1746129818.750095:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a8790380 x1830949054279680/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.750103:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790380 with x1830949054279680 ext(0->1048575) 00002000:00010000:2.0:1746129818.750108:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8790380 00000100:00100000:0.0:1746129818.752371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.752633:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053998592:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.752651:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.752707:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054280960 00000100:00100000:1.0:1746129818.752713:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054280960 00010000:00010000:1.0:1746129818.752738:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.752758:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7619 00000100:00100000:1.0:1746129818.752764:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054280960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.752774:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.752779:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.752793:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.752810:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43954706 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35595b expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.752820:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129818.752825:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129818.752838:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129818.752844:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.752931:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.752938:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129818.752950:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129818.753012:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129818.753044:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.753048:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054280960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 284us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.753054:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7619 00010000:00010000:3.0:1746129818.753420:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753425:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753429:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b67200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.753432:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753437:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753445:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.753447:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129818.753449:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753453:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67200/0x48868a4e4395485d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753465:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753473:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753477:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753480:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b67800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.753482:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753485:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753491:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129818.753492:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.753495:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753498:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67800/0x48868a4e4395484f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753505:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753509:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753513:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753516:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b66600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.753518:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753525:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753530:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f888800) 00010000:00010000:3.0:1746129818.753532:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.753533:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753537:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66600/0x48868a4e43954856 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.753569:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67a00/0x48868a4e43954848 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a03 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.753576:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67a00/0x48868a4e43954848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a03 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.753582:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67a00, rc 0) 00000100:00100000:3.0:1746129818.753617:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31481:x1830949054280832:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6560us (6652us total) trans 8589944968 rc 301/301 00000100:00100000:3.0:1746129818.753623:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10978 00000100:00100000:0.0:1746129818.753995:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054280320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26068us (28795us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129818.754003:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6813 00002000:00100000:0.0:1746129818.754010:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d634700 x1830949054280320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.754019:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634700 with x1830949054280320 ext(1048576->2097151) 00002000:00010000:0.0:1746129818.754022:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634700 00000100:00100000:0.0:1746129818.756449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.756511:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281216 00000100:00100000:3.0:1746129818.756518:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281216 00000100:00100000:3.0:1746129818.756564:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10979 00000100:00100000:3.0:1746129818.756571:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31472:x1830949054281216:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1746129818.756606:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.756624:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e4395478b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355985 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.756642:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.756645:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129818.756676:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.756686:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.756692:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 4/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.756715:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.756731:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 7 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:3.0:1746129818.756741:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053998720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129818.757085:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.758071:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949053998720:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129818.758085:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129818.758724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.758798:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281344 00000100:00100000:1.0:1746129818.758802:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281344 00010000:00010000:1.0:1746129818.758824:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 8 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.758841:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7620 00000100:00100000:1.0:1746129818.758867:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054281344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.758876:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.758882:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 8 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.758890:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 8 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.758904:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e200/0x48868a4e43954799 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35598c expref: 8 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.758913:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129818.758916:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129818.758923:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129818.758929:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129818.758953:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.758987:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054281344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 139us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.758993:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7620 00010000:00010000:3.0:1746129818.759072:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.759078:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00010000:3.0:1746129818.759217:0:14313:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880136318e00 reply state ffff880135b6f000 transno 8589944969 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129818.759224:0:14313:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129818.759270:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31472:x1830949054281216:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 2699us (2828us total) trans 8589944969 rc 0/0 00000100:00100000:3.0:1746129818.759276:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10979 00010000:00010000:3.0:1746129818.760227:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.760235:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.760241:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.760246:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c34800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129818.760249:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.760255:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.760264:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.760266:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129818.760268:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129818.760268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129818.760272:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c34800/0x48868a4e4395486b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129818.760302:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.760345:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281472 00000100:00100000:1.0:1746129818.760349:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281472 00000100:00100000:2.0:1746129818.760358:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281600 00000100:00100000:2.0:1746129818.760361:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281600 00000100:00100000:1.0:1746129818.760372:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15285 00000100:00100000:1.0:1746129818.760376:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054281472:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129818.760428:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15286 00000100:00100000:2.0:1746129818.760433:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054281600:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129818.760490:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129818.760493:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129818 -> 1746129819 00002000:00010000:1.0:1746129818.760495:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129817 -> 1746129819 00002000:00010000:1.0:1746129818.760497:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129818 -> 1746129819 00002000:00010000:1.0:1746129818.760499:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00002000:00010000:2.0:1746129818.760511:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129818.760513:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129818 -> 1746129819 00002000:00010000:2.0:1746129818.760514:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129817 -> 1746129819 00002000:00010000:2.0:1746129818.760516:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129818 -> 1746129819 00002000:00010000:2.0:1746129818.760518:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129818.760522:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054281472:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 146us (254us total) trans 21474841281 rc 0/0 00000100:00100000:1.0:1746129818.760528:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15285 00000100:00100000:2.0:1746129818.760529:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054281600:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 97us (227us total) trans 17179874090 rc 0/0 00000100:00100000:3.0:1746129818.761032:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.761046:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281728 00000100:00100000:2.0:1746129818.761046:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15286 00000100:00100000:3.0:1746129818.761048:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281728 00000100:00100000:3.0:1746129818.761061:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15287 00000100:00100000:3.0:1746129818.761065:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054281728:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129818.761137:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129818.761139:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129818 -> 1746129819 00002000:00010000:3.0:1746129818.761141:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129818 -> 1746129819 00002000:00010000:3.0:1746129818.761143:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129818 -> 1746129819 00002000:00010000:3.0:1746129818.761145:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129818.761175:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054281728:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 95us (128us total) trans 17179874091 rc 0/0 00000100:00100000:3.0:1746129818.761181:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15287 00000100:00100000:3.0:1746129818.761220:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.761241:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.761252:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281856 00000100:00100000:3.0:1746129818.761255:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281856 00000100:00100000:3.0:1746129818.761271:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10980 00000100:00100000:3.0:1746129818.761275:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31479:x1830949054281856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.761284:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.761293:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a0a expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.761327:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.761337:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.761354:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.761356:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129818.761358:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67600, rc 0) 00000100:00100000:3.0:1746129818.761375:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31479:x1830949054281856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 99us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.761379:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10980 00000100:00100000:1.0:1746129818.761451:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.761466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.761491:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054281984 00000100:00100000:2.0:1746129818.761494:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054281984 00000100:00100000:1.0:1746129818.761494:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054282112 00000100:00100000:1.0:1746129818.761497:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054282112 00000100:00100000:2.0:1746129818.761506:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054282240 00000100:00100000:2.0:1746129818.761508:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054282240 00000100:00100000:1.0:1746129818.761513:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15288 00000100:00100000:1.0:1746129818.761518:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054281984:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129818.761526:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15289 00000100:00100000:2.0:1746129818.761530:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054282112:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129818.761579:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15290 00000100:00100000:2.0:1746129818.761583:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054282240:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129818.761592:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129818.761594:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129817 -> 1746129819 00002000:00010000:1.0:1746129818.761596:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129817 -> 1746129819 00002000:00010000:1.0:1746129818.761598:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129818 -> 1746129819 00002000:00010000:1.0:1746129818.761599:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129818.761618:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1964:x1830949054281984:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 100us (397us total) trans 21474841282 rc 0/0 00000100:00100000:1.0:1746129818.761624:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15288 00002000:00010000:2.0:1746129818.761635:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129818.761638:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.761639:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129818 -> 1746129819 00002000:00010000:2.0:1746129818.761641:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.761642:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129818.761659:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054282240:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 75us (192us total) trans 17179874092 rc 0/0 00000100:00100000:2.0:1746129818.761667:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15290 00002000:00010000:2.0:1746129818.761695:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:2.0:1746129818.761697:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.761699:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.761701:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.761702:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:2.0:1746129818.761714:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054282112:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 184us (265us total) trans 21474841283 rc 0/0 00000100:00100000:2.0:1746129818.761718:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15289 00000100:00100000:1.0:1746129818.762010:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054280064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 34832us (37973us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.762017:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6812 00002000:00100000:1.0:1746129818.762024:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d636a00 x1830949054280064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.762032:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636a00 with x1830949054280064 ext(1048576->2097151) 00002000:00010000:1.0:1746129818.762036:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d636a00 00000100:00100000:0.0:1746129818.762880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.762920:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054282496 00000100:00100000:2.0:1746129818.762924:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054282496 00000100:00100000:2.0:1746129818.762954:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10981 00000100:00100000:2.0:1746129818.762959:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31481:x1830949054282496:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.762970:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.762972:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129818.762986:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238800/0x48868a4e43954753 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355970 expref: 284 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.763009:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.763012:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.763020:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43954879 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a11 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.763048:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.763058:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.763065:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.763070:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.763096:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.763107:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 7 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.763183:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053998848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.763403:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.763412:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 7 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.763419:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053998976:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.763451:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.763828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.763935:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054282752 00000100:00100000:2.0:1746129818.763939:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054282752 00000100:00100000:2.0:1746129818.763961:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4573 00000100:00100000:2.0:1746129818.763966:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31472:x1830949054282752:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129818.764084:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31472:x1830949054282752:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 117us (256us total) trans 8589944970 rc 0/0 00000100:00100000:2.0:1746129818.764091:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4573 00000100:00100000:0.0:1746129818.764712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.764747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.764755:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054282880 00000100:00100000:1.0:1746129818.764758:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054282880 00010000:00010000:1.0:1746129818.764779:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746129818.764794:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283008 00000100:00100000:1.0:1746129818.764796:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283008 00010000:00010000:1.0:1746129818.764803:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 8 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746129818.764803:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7621 00000100:00100000:0.0:1746129818.764809:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054282880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129818.764815:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7622 00010000:00010000:0.0:1746129818.764816:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129818.764818:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054283008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.764821:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.764823:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.764826:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 8 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.764829:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746129818.764900:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 8 pid: 14313 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.764980:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053998848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.764995:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009be5e800/0x48868a4e4395475a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355977 expref: 9 pid: 14315 timeout: 864 lvb_type: 0 00000100:00100000:2.0:1746129818.765006:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053998976:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.765037:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67600/0x48868a4e43954872 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a0a expref: 8 pid: 14313 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746129818.765037:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.765042:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.765048:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.765053:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129818.765059:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129818.765061:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129818.765064:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.765079:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949054283008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 260us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.765079:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054282880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 270us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.765085:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7621 00000100:00100000:1.0:1746129818.765087:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7622 00010000:00010000:2.0:1746129818.765268:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.765276:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.765280:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129818.765685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.765729:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283136 00000100:00100000:3.0:1746129818.765733:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283136 00000100:00100000:0.0:1746129818.765736:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000040:00080000:2.0:1746129818.765909:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3496, 88 off294376 00000004:00080000:2.0:1746129818.765914:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824065983ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766189:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3505, 88 off295088 00000004:00080000:2.0:1746129818.766193:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824345352ns, next at 716792379979ns, rc = 0 00000100:00100000:1.0:1746129818.766219:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283264 00000100:00100000:1.0:1746129818.766223:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283264 00000100:00100000:3.0:1746129818.766231:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10982 00000100:00100000:3.0:1746129818.766237:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31472:x1830949054283136:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:1.0:1746129818.766241:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10983 00000100:00100000:1.0:1746129818.766245:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31479:x1830949054283264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129818.766250:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.766250:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129818.766259:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a18 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.766259:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a1f expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1746129818.766315:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3506, 88 off295176 00000004:00080000:2.0:1746129818.766319:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824471050ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.766443:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3497, 88 off294464 00000004:00080000:2.0:1746129818.766447:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824599267ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766463:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3498, 88 off294552 00000004:00080000:2.0:1746129818.766469:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824621370ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766478:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3507, 88 off295264 00000004:00080000:2.0:1746129818.766480:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824632100ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.766626:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3508, 88 off295352 00000004:00080000:2.0:1746129818.766630:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824781775ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.766639:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3509, 88 off295440 00000004:00080000:2.0:1746129818.766641:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824793522ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.766648:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3499, 88 off294640 00000004:00080000:2.0:1746129818.766650:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824802054ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766667:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3510, 88 off295528 00000004:00080000:2.0:1746129818.766669:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824821025ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.766674:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3500, 88 off294728 00000004:00080000:2.0:1746129818.766676:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824828643ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766682:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3511, 88 off295616 00000004:00080000:2.0:1746129818.766683:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824835680ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129818.766689:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3501, 88 off294816 00000004:00080000:2.0:1746129818.766690:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824842542ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766717:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3503, 88 off295000 00000004:00080000:2.0:1746129818.766720:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824872095ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766726:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3504, 88 off295088 00000004:00080000:2.0:1746129818.766729:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824880857ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766734:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3505, 88 off295176 00000004:00080000:2.0:1746129818.766737:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764824889513ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129818.766744:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3512, 88 off295704 00000004:00080000:2.0:1746129818.766746:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764824898144ns, next at 716792379979ns, rc = 0 00010000:00010000:3.0:1746129818.766872:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129818.766879:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.766928:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 8 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.766936:0:14313:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129818.766937:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 8 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.766945:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.766946:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.766948:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129818.766951:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.766956:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129818.766956:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff99800, rc 0) 00010000:00010000:3.0:1746129818.766958:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129818.766960:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.766964:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67400, rc 0) 00000100:00100000:3.0:1746129818.766989:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31472:x1830949054283136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 752us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.766989:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31479:x1830949054283264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 742us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.766993:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10983 00000100:00100000:3.0:1746129818.766996:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10982 00000001:00080000:1.0:1746129818.782449:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944971 is committed 00000004:00080000:1.0:1746129818.782459:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746129818.782466:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746129818.782476:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746129818.782478:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746129818.782479:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746129818.782481:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2678 committed 00000004:00080000:1.0:1746129818.782482:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746129818.782483:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2677 committed 00000004:00080000:1.0:1746129818.782484:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746129818.782485:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2676 committed 00000004:00080000:1.0:1746129818.782487:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2675 committed 00000004:00080000:1.0:1746129818.782488:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2674 committed 00000004:00080000:1.0:1746129818.782489:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2671 committed 00000004:00080000:1.0:1746129818.782490:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2670 committed 00010000:00010000:2.0:1746129818.782491:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129818.782491:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2673 committed 00000004:00080000:1.0:1746129818.782492:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2672 committed 00000004:00080000:1.0:1746129818.782494:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2669 committed 00000001:00080000:1.0:1746129818.782499:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944970 is committed 00010000:00010000:2.0:1746129818.782503:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.782506:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000001:00080000:1.0:1746129818.782509:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944966 is committed 00010000:00010000:2.0:1746129818.782510:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.782518:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1746129818.782520:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.782525:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.782531:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 6 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129818.782531:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053999104:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129818.782536:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 6 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.782541:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 6 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.782561:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 6 pid: 14314 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.782568:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053999360:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129818.782580:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129818.782601:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053999488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129818.782609:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053999616:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129818.782618:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 6 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129818.782622:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.782625:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054000256:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129818.782627:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053999232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129818.782643:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129818.782645:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054000000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.782657:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.782657:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053999872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.782657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.782669:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999104 00000100:00100000:1.0:1746129818.782670:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.782675:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999104 00000100:00100000:0.0:1746129818.782678:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999488 00000100:00100000:0.0:1746129818.782681:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999488 00000100:00100000:1.0:1746129818.782687:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999232 00000100:00100000:1.0:1746129818.782689:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999232 00000100:00100000:0.0:1746129818.782698:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000000 00000100:00100000:0.0:1746129818.782700:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000000 00000100:00100000:3.0:1746129818.782794:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053999744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.782811:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.783010:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054000384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.783025:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.783038:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999872 00000100:00100000:1.0:1746129818.783038:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999744 00000100:00100000:2.0:1746129818.783040:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999872 00000100:00100000:1.0:1746129818.783040:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999744 00000100:00100000:0.0:1746129818.783043:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15291 00000100:00100000:0.0:1746129818.783050:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3299:x1830949053999488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129818.783055:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15292 00000100:00100000:2.0:1746129818.783058:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15293 00000100:00100000:1.0:1746129818.783060:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+73:3296:x1830949053999104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.783062:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3298:x1830949053999232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129818.783074:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15294 00000100:00100000:1.0:1746129818.783077:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:3299:x1830949054000000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.783105:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15295 00000100:00100000:2.0:1746129818.783109:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3297:x1830949053999744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.783183:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15296 00000100:00100000:2.0:1746129818.783188:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3298:x1830949053999872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129818.783201:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129818.783204:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129818.783206:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129818.783207:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129818.783209:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129818.783232:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3299:x1830949054000000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (573us total) trans 21474841284 rc 0/0 00000100:00100000:1.0:1746129818.783237:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15294 00000100:00100000:1.0:1746129818.783261:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054000512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783262:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3298:x1830949053999872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (590us total) trans 21474841286 rc 0/0 00000100:00100000:2.0:1746129818.783266:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15296 00002000:00010000:2.0:1746129818.783345:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129818.783347:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783349:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783351:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783353:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:3.0:1746129818.783369:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054000896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783370:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+75:3296:x1830949053999104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 310us (790us total) trans 21474841287 rc 0/0 00000100:00100000:2.0:1746129818.783375:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15292 00000100:00100000:3.0:1746129818.783382:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.783382:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000384 00000100:00100000:2.0:1746129818.783385:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000384 00000100:00100000:3.0:1746129818.783392:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129818.783395:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000896 00000100:00100000:3.0:1746129818.783396:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054000768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783396:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000896 00000100:00100000:2.0:1746129818.783403:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15297 00000100:00100000:2.0:1746129818.783407:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3297:x1830949054000384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.783409:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.783415:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054001280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.783426:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129818.783439:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000768 00000100:00100000:3.0:1746129818.783441:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000768 00000100:00100000:3.0:1746129818.783450:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001280 00000100:00100000:3.0:1746129818.783452:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001280 00000100:00100000:3.0:1746129818.783458:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15298 00000100:00100000:3.0:1746129818.783462:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949054000896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129818.783490:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129818.783492:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783494:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783496:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783497:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129818.783517:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3297:x1830949054000384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (491us total) trans 17179874093 rc 0/0 00000100:00100000:2.0:1746129818.783523:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15297 00000100:00100000:3.0:1746129818.783525:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3297:x1830949054000896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (142us total) trans 17179874094 rc 0/0 00000100:00100000:3.0:1746129818.783530:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15298 00000100:00100000:2.0:1746129818.783533:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15299 00000100:00100000:3.0:1746129818.783537:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15300 00000100:00100000:2.0:1746129818.783537:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949054000768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.783540:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+56:3297:x1830949054001280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129818.783576:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054000640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783590:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3297:x1830949053999744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 480us (777us total) trans 21474841285 rc 0/0 00000100:00100000:2.0:1746129818.783594:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15295 00000100:00100000:0.0:1746129818.783598:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.783605:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000640 00000100:00100000:2.0:1746129818.783607:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000640 00000100:00100000:3.0:1746129818.783608:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+57:3297:x1830949054001280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (180us total) trans 17179874095 rc 0/0 00000100:00100000:3.0:1746129818.783612:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15300 00000100:00100000:0.0:1746129818.783612:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054001152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783619:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15301 00000100:00100000:2.0:1746129818.783622:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3299:x1830949054000640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129818.783624:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129818.783646:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad0e00/2, rc 0, transno 21474841284 00000100:00100000:0.0:1746129818.783653:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054000000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.783666:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001152 00000100:00100000:0.0:1746129818.783669:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001152 00000100:00100000:0.0:1746129818.783683:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15302 00002000:00010000:2.0:1746129818.783684:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00000004:00080000:3.0:1746129818.783685:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8ca80/2, rc 0, transno 17179874095 00000100:00100000:0.0:1746129818.783686:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3299:x1830949054001152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129818.783687:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00000100:00100000:3.0:1746129818.783689:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054001280:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129818.783689:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783690:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783692:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000004:00080000:3.0:1746129818.783695:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4d880/2, rc 0, transno 21474841285 00000100:00100000:3.0:1746129818.783698:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949053999744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129818.783703:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468d180/2, rc 0, transno 17179874093 00000100:00100000:3.0:1746129818.783706:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054000384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783709:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3299:x1830949054000640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (111us total) trans 17179874096 rc 0/0 00000004:00080000:3.0:1746129818.783711:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18a80/2, rc 0, transno 17179874094 00000100:00100000:3.0:1746129818.783713:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054000896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783714:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15301 00002000:00010000:2.0:1746129818.783766:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129818.783768:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783770:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783772:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00000100:00100000:0.0:1746129818.783772:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3299:x1830949054001152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (146us total) trans 17179874097 rc 0/0 00002000:00010000:2.0:1746129818.783774:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129818.783777:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15302 00000100:00100000:3.0:1746129818.783780:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3297:x1830949054000768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (369us total) trans 17179874098 rc 0/0 00000100:00100000:3.0:1746129818.783785:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15299 00000100:00100000:2.0:1746129818.783786:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3298:x1830949053999232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 724us (1142us total) trans 21474841288 rc 0/0 00000100:00100000:2.0:1746129818.783790:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15293 00000004:00080000:3.0:1746129818.783801:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd3b80/2, rc 0, transno 17179874098 00000100:00100000:3.0:1746129818.783804:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054000768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.783866:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746129818.783873:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:2.0:1746129818.783876:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783877:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783879:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.783881:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:1.0:1746129818.783884:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054001024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129818.783896:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3299:x1830949053999488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 847us (1274us total) trans 21474841289 rc 0/0 00000100:00100000:1.0:1746129818.783897:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.783901:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15291 00000100:00100000:2.0:1746129818.783908:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000512 00000100:00100000:2.0:1746129818.783910:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000512 00000004:00080000:1.0:1746129818.783911:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbee300/2, rc 0, transno 21474841288 00000100:00100000:1.0:1746129818.783913:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053999232:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129818.783919:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4ce00/2, rc 0, transno 21474841286 00000100:00100000:1.0:1746129818.783921:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949053999872:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129818.783932:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129818.784396:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001024 00000100:00100000:2.0:1746129818.784398:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001024 00000100:00100000:3.0:1746129818.784406:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054001408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.784408:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949053999616 00000100:00100000:2.0:1746129818.784409:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949053999616 00000100:00100000:2.0:1746129818.784418:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15303 00000100:00100000:2.0:1746129818.784422:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3298:x1830949054000512:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129818.784424:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a8fd3100/2, rc 0, transno 17179874096 00000100:00100000:0.0:1746129818.784428:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054000640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.784429:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054000128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.784436:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129818.784441:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094d8d500/2, rc 0, transno 17179874097 00000100:00100000:0.0:1746129818.784444:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054001152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129818.784447:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129818.784451:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4f800/2, rc 0, transno 21474841289 00000100:00100000:0.0:1746129818.784453:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949053999488:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.784458:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054001408 00000100:00100000:3.0:1746129818.784461:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054001408 00000004:00080000:1.0:1746129818.784463:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbed180/2, rc 0, transno 21474841287 00000100:00100000:1.0:1746129818.784466:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053999104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.784471:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054000128 00000100:00100000:3.0:1746129818.784473:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054000128 00000100:00100000:1.0:1746129818.784480:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15304 00000100:00100000:3.0:1746129818.784483:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15305 00002000:00010000:2.0:1746129818.784484:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:1.0:1746129818.784484:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3298:x1830949054001024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129818.784487:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+76:3296:x1830949053999616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129818.784487:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.784488:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.784490:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129818.784492:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129818.784513:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3298:x1830949054000512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (646us total) trans 17179874099 rc 0/0 00000100:00100000:2.0:1746129818.784518:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15303 00000100:00100000:2.0:1746129818.784527:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15306 00000100:00100000:2.0:1746129818.784531:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3297:x1830949054001408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.784569:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949053999616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (635us total) trans 21474841290 rc 0/0 00000100:00100000:3.0:1746129818.784574:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15305 00000004:00080000:0.0:1746129818.784579:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094a4fb80/2, rc 0, transno 21474841290 00000100:00100000:0.0:1746129818.784582:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949053999616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129818.784584:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15307 00000100:00100000:3.0:1746129818.784588:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949054000128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129818.784607:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3297:x1830949054001408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (169us total) trans 21474841291 rc 0/0 00000100:00100000:2.0:1746129818.784612:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15306 00000100:00100000:3.0:1746129818.784660:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3296:x1830949054000128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (212us total) trans 21474841292 rc 0/0 00000100:00100000:3.0:1746129818.784664:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15307 00000100:00100000:1.0:1746129818.784676:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+61:3298:x1830949054001024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (777us total) trans 17179874100 rc 0/0 00000100:00100000:1.0:1746129818.784681:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15304 00000004:00080000:2.0:1746129818.784682:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5f80/2, rc 0, transno 21474841291 00000100:00100000:2.0:1746129818.784685:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054001408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129818.784698:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468e300/2, rc 0, transno 17179874099 00000100:00100000:1.0:1746129818.784701:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054000512:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129818.784706:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19880/2, rc 0, transno 17179874100 00000100:00100000:1.0:1746129818.784708:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054001024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129818.785034:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad0000/2, rc 0, transno 21474841292 00000100:00100000:0.0:1746129818.785038:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054000128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129818.786200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.786278:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a55a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949053999360:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.786288:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c08b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054000256:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.786316:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38000/0x48868a4e43954879 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 283 pid: 14315 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129818.786330:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.786355:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a38e00, rc 0) 00000100:00100000:2.0:1746129818.786385:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31481:x1830949054282496:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 23424us (23505us total) trans 8589944971 rc 0/0 00000100:00100000:2.0:1746129818.786391:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10981 00000100:00100000:1.0:1746129818.786444:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283392 00000100:00100000:1.0:1746129818.786448:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283392 00000100:00100000:1.0:1746129818.786483:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4574 00000100:00100000:1.0:1746129818.786488:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31472:x1830949054283392:12345-192.168.204.31@tcp:49:lfs.0 00000100:00100000:1.0:1746129818.786541:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31472:x1830949054283392:12345-192.168.204.31@tcp:49:lfs.0 Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.786550:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4574 00000100:00100000:2.0:1746129818.787204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.787222:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283520 00000100:00100000:0.0:1746129818.787225:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283520 00000100:00100000:0.0:1746129818.787254:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4575 00000100:00100000:0.0:1746129818.787259:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31479:x1830949054283520:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129818.787299:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c08b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31479:x1830949054283520:12345-192.168.204.31@tcp:49:cat.0 Request processed in 40us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.787304:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4575 00000100:00100000:0.0:1746129818.792307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.792383:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283648 00000100:00100000:1.0:1746129818.792390:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283648 00000100:00100000:1.0:1746129818.792713:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15308 00000100:00100000:1.0:1746129818.792722:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31481:x1830949054283648:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129818.792738:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129818.792753:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a26 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.792778:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.792786:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.792793:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.792798:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.792800:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.792803:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1949696->1966079] (req 1949696->1966079) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129818.792828:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.792839:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 14 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.792881:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054001536:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129818.793578:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.793588:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.793596:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054001664:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.793660:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129818.793737:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129818.793746:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 13 pid: 8436 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.793755:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054001792:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.793777:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129818.793792:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054283904 00000100:00100000:1.0:1746129818.793795:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054283904 00000100:00100000:1.0:1746129818.793831:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4576 00000100:00100000:1.0:1746129818.793837:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31472:x1830949054283904:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129818.794139:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.794412:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31472:x1830949054283904:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 573us (751us total) trans 8589944972 rc 0/0 00000100:00100000:1.0:1746129818.794603:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4576 00000100:00100000:1.0:1746129818.794623:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054284160 00000100:00100000:1.0:1746129818.794626:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054284160 00002000:00100000:1.0:1746129818.794646:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880135d8ea00 x1830949054284160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.794653:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ea00 with x1830949054284160 ext(1048576->2097151) 00010000:00010000:1.0:1746129818.794660:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.794862:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00002000:00010000:1.0:1746129818.794869:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d8ea00 00000100:00100000:1.0:1746129818.794883:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1843 00000100:00100000:1.0:1746129818.794889:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054284160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.795994:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054001536:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.796005:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054001664:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.796012:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054001792:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129818.796037:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1949696->1966079] (req 1949696->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.796051:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a1ee000, rc 0) 00000100:00100000:0.0:1746129818.796092:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31481:x1830949054283648:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3371us (3792us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.796099:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15308 00000100:00100000:2.0:1746129818.797480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.797513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.797535:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054284288 00000100:00100000:1.0:1746129818.797541:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054284288 00010000:00010000:1.0:1746129818.797567:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 14 pid: 8436 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746129818.797583:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7623 00000100:00100000:0.0:1746129818.797586:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054284416 00000100:00100000:1.0:1746129818.797589:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054284288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129818.797590:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054284416 00010000:00010000:1.0:1746129818.797600:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129818.797603:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.797614:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 14 pid: 8436 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.797620:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7624 00010000:00010000:1.0:1746129818.797622:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 14 pid: 8436 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746129818.797625:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054284416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129818.797632:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.797641:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08de00/0x48868a4e439547a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a8 expref: 14 pid: 8436 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.797642:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.797650:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.797656:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129818.797662:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acd4f000/0x48868a4e43954841 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559fc expref: 22 pid: 3624 timeout: 864 lvb_type: 1 00010000:00010000:0.0:1746129818.797671:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.797720:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a55a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054284288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.797726:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7623 00000100:00100000:0.0:1746129818.797946:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949054284416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 319us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129818.797952:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7624 00000100:00100000:1.0:1746129818.801899:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054284160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7002us (7770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.801910:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1843 00002000:00100000:1.0:1746129818.801919:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880135d8ea00 x1830949054284160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.801928:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135d8ea00 with x1830949054284160 ext(1048576->2097151) 00010000:00010000:1.0:1746129818.801935:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746129818.801948:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00002000:00010000:1.0:1746129818.801955:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135d8ea00 00000100:00100000:0.0:1746129818.806358:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.806403:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054284544 00000100:00100000:2.0:1746129818.806410:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054284544 00000100:00100000:2.0:1746129818.806440:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15309 00000100:00100000:2.0:1746129818.806446:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054284544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.806460:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.806473:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e4395489c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a2d expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.806489:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.806498:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e4395489c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a2d expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.806507:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e4395489c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a2d expref: 16 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.806522:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:2.0:1746129818.806553:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054284544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 107us (204us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.806557:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15309 00000100:00100000:0.0:1746129818.807532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.807604:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054284672 00000100:00100000:2.0:1746129818.807608:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054284672 00010000:00010000:2.0:1746129818.807624:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:2.0:1746129818.807641:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7625 00000100:00100000:2.0:1746129818.807646:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054284672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.807654:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.807672:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.807681:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.807695:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e439547df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d2 expref: 15 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:2.0:1746129818.807704:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.807705:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.807711:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.807717:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.807740:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.807751:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054001920:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.807816:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.808610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.808781:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054284928 00000100:00100000:2.0:1746129818.808786:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054284928 00000100:00100000:2.0:1746129818.808825:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10984 00000100:00100000:2.0:1746129818.808831:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31484:x1830949054284928:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.808841:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.808942:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e439548a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a34 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.809021:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809030:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809038:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809048:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809052:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809055:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809132:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809138:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809142:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129818.809149:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129818.809226:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809232:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809238:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809242:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.809245:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809249:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809256:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129818.809258:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.809260:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809265:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e439548aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809271:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809275:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809280:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809283:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ede00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.809284:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809288:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809296:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d0cfc00) 00010000:00010000:2.0:1746129818.809297:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.809299:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809302:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ede00/0x48868a4e439548b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.809328:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eca00/0x48868a4e439548a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.809335:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.809339:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.809341:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129818.809343:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec000, rc 0) 00000100:00100000:2.0:1746129818.809364:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31484:x1830949054284928:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 533us (755us total) trans 8589944973 rc 0/0 00000100:00100000:2.0:1746129818.809369:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10984 00000100:00100000:0.0:1746129818.809759:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.809824:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054001920:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.809836:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.809877:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054284672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2230us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.809883:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7625 00000100:00100000:1.0:1746129818.810059:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054285184 00000100:00100000:1.0:1746129818.810062:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054285184 00002000:00100000:1.0:1746129818.810081:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1949696->1953791) req@ffff880094eb4700 x1830949054285184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.810091:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4700 with x1830949054285184 ext(1949696->1953791) 00002000:00010000:1.0:1746129818.810094:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4700 00000100:00100000:1.0:1746129818.810111:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6814 00000100:00100000:1.0:1746129818.810115:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054285184:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129818.810303:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054285184:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 186us (545us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129818.810309:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6814 00002000:00100000:1.0:1746129818.810314:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1949696->1953791) req@ffff880094eb4700 x1830949054285184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.810320:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4700 with x1830949054285184 ext(1949696->1953791) 00002000:00010000:1.0:1746129818.810323:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4700 00000100:00100000:0.0:1746129818.811795:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.811867:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054285440 00000100:00100000:1.0:1746129818.811872:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054285440 00002000:00100000:1.0:1746129818.811895:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1961984->1966079) req@ffff880094eb4000 x1830949054285440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.811902:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4000 with x1830949054285440 ext(1961984->1966079) 00002000:00010000:1.0:1746129818.811905:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4000 00000100:00100000:1.0:1746129818.811927:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6815 00000100:00100000:1.0:1746129818.811932:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054285440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129818.812038:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054285440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 105us (245us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129818.812043:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6815 00002000:00100000:1.0:1746129818.812049:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1961984->1966079) req@ffff880094eb4000 x1830949054285440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.812056:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4000 with x1830949054285440 ext(1961984->1966079) 00002000:00010000:1.0:1746129818.812059:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4000 00000100:00100000:2.0:1746129818.816410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.816457:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054285696 00000100:00100000:2.0:1746129818.816458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.816466:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054285696 00000100:00100000:0.0:1746129818.816501:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054286080 00000100:00100000:0.0:1746129818.816505:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054286080 00000100:00100000:1.0:1746129818.816512:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4577 00000100:00100000:1.0:1746129818.816517:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31481:x1830949054285696:12345-192.168.204.31@tcp:35:multiop.0 00002000:00100000:0.0:1746129818.816529:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008f90ad80 x1830949054286080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129818.816537:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90ad80 with x1830949054286080 ext(2097152->3145727) 00002000:00010000:0.0:1746129818.816542:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f90ad80 00000100:00100000:0.0:1746129818.816554:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6816 00000100:00100000:0.0:1746129818.816559:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054286080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.816674:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31481:x1830949054285696:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 156us (270us total) trans 8589944974 rc 0/0 00000100:00100000:1.0:1746129818.816680:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4577 00000100:00100000:2.0:1746129818.817087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.817115:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.817136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.817150:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054286208 00000100:00100000:3.0:1746129818.817151:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054286592 00000100:00100000:2.0:1746129818.817153:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054286208 00000100:00100000:3.0:1746129818.817154:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054286592 00002000:00100000:3.0:1746129818.817181:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88008f90b480 x1830949054286592/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.817181:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008f90b100 x1830949054286208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.817188:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b480 with x1830949054286592 ext(3145728->4194303) 00002000:00100000:2.0:1746129818.817188:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b100 with x1830949054286208 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.817191:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f90b480 00002000:00010000:2.0:1746129818.817191:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f90b100 00000100:00100000:2.0:1746129818.817200:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054286464 00000100:00100000:2.0:1746129818.817202:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054286464 00002000:00100000:2.0:1746129818.817210:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88008f909c00 x1830949054286464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129818.817214:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6817 00002000:00100000:2.0:1746129818.817217:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909c00 with x1830949054286464 ext(2097152->3145727) 00000100:00100000:3.0:1746129818.817219:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054286208:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:2.0:1746129818.817219:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f909c00 00000100:00100000:2.0:1746129818.817240:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6818 00000100:00100000:2.0:1746129818.817245:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054286592:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129818.817306:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6819 00000100:00100000:1.0:1746129818.817314:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054286464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.825621:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054286208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8391us (8524us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.825632:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6817 00002000:00100000:2.0:1746129818.825643:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008f90b100 x1830949054286208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.825652:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b100 with x1830949054286208 ext(3145728->4194303) 00002000:00010000:2.0:1746129818.825658:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f90b100 00000100:00100000:2.0:1746129818.832742:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054286592:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15488us (15618us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.832753:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6818 00002000:00100000:2.0:1746129818.832764:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88008f90b480 x1830949054286592/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.832772:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b480 with x1830949054286592 ext(3145728->4194303) 00002000:00010000:2.0:1746129818.832777:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f90b480 00000100:00100000:1.0:1746129818.833135:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054286464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15821us (15996us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.833142:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6819 00002000:00100000:1.0:1746129818.833147:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88008f909c00 x1830949054286464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.833154:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909c00 with x1830949054286464 ext(2097152->3145727) 00002000:00010000:1.0:1746129818.833166:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f909c00 00000100:00100000:2.0:1746129818.836328:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054286080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19762us (19862us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.836336:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6816 00002000:00100000:2.0:1746129818.836344:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008f90ad80 x1830949054286080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.836352:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90ad80 with x1830949054286080 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.836356:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f90ad80 00000100:00100000:0.0:1746129818.843033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.843129:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054286848 00000100:00100000:2.0:1746129818.843137:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054286848 00000100:00100000:2.0:1746129818.843200:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15310 00000100:00100000:2.0:1746129818.843208:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054286848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.843222:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.843236:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e439548c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a3b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.843277:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002048:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.843356:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.847023:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002048:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.847057:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e439548c6 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a3b expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.847069:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e439548c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a3b expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.847095:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0200, rc 0) 00000100:00100000:2.0:1746129818.847147:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054286848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3939us (4119us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.847155:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15310 00000100:00100000:0.0:1746129818.851654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.851708:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054287104 00000100:00100000:2.0:1746129818.851716:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054287104 00002000:00100000:2.0:1746129818.851752:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f6a4a80 x1830949054287104/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.851760:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4a80 with x1830949054287104 ext(4194304->4931583) 00002000:00010000:2.0:1746129818.851765:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4a80 00000100:00100000:2.0:1746129818.851795:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6820 00000100:00100000:2.0:1746129818.851801:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054287104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.859539:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054287104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7729us (7885us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129818.859549:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6820 00002000:00100000:2.0:1746129818.859558:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f6a4a80 x1830949054287104/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.859566:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6a4a80 with x1830949054287104 ext(4194304->4931583) 00002000:00010000:2.0:1746129818.859572:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6a4a80 00000100:00100000:0.0:1746129818.863379:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.863478:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054287232 00000100:00100000:2.0:1746129818.863485:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054287232 00000100:00100000:2.0:1746129818.863520:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15311 00000100:00100000:2.0:1746129818.863526:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054287232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.863542:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.863556:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e439548cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a42 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.863602:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002176:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.864154:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.864873:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002176:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.864893:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e439548cd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a42 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.864903:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e439548cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a42 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.864943:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0400, rc 0) 00000100:00100000:2.0:1746129818.864967:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054287232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1440us (1595us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.864973:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15311 00000100:00100000:0.0:1746129818.866411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.866481:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054287488 00000100:00100000:2.0:1746129818.866486:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054287488 00000100:00100000:2.0:1746129818.866527:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10985 00000100:00100000:2.0:1746129818.866533:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31489:x1830949054287488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.866549:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.866559:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e439548d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a49 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.866644:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866654:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866663:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866672:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866677:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866681:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866767:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866774:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866780:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129818.866788:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129818.866877:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866886:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866891:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866896:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cae0a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.866899:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866904:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866912:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129818.866914:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.866917:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866921:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0a00/0x48868a4e439548db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866929:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866932:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866937:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866940:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cae0200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129818.866941:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866948:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866952:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8800) 00010000:00010000:2.0:1746129818.866954:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129818.866955:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866959:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0200/0x48868a4e439548e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129818.866983:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e439548d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.866990:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 285 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.866995:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.866996:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129818.866998:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919eda00, rc 0) 00000100:00100000:2.0:1746129818.867024:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31489:x1830949054287488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 492us (617us total) trans 8589944975 rc 0/0 00000100:00100000:2.0:1746129818.867029:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10985 00000100:00100000:0.0:1746129818.868335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.868428:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054287616 00000100:00100000:2.0:1746129818.868433:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054287616 00000100:00100000:2.0:1746129818.868743:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15312 00000100:00100000:2.0:1746129818.868750:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054287616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.868763:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.868773:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ecc00/0x48868a4e439548f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a50 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.868953:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002304:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.869439:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.871293:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002304:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.871319:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ecc00/0x48868a4e439548f7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a50 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.871330:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ecc00/0x48868a4e439548f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a50 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.871340:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ecc00, rc 0) 00000100:00100000:2.0:1746129818.871385:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054287616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2635us (3056us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.871392:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15312 00000100:00100000:0.0:1746129818.877940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.878034:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054287872 00000100:00100000:1.0:1746129818.878041:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054287872 00000100:00100000:1.0:1746129818.878084:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4578 00000100:00100000:1.0:1746129818.878090:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31479:x1830949054287872:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129818.878265:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31479:x1830949054287872:12345-192.168.204.31@tcp:35:cat.0 Request processed in 174us (422us total) trans 8589944976 rc 0/0 00000100:00100000:1.0:1746129818.878271:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4578 00000100:00100000:0.0:1746129818.879990:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.880042:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054288128 00000100:00100000:2.0:1746129818.880048:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054288128 00002000:00100000:2.0:1746129818.880079:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009f8d0000 x1830949054288128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.880088:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0000 with x1830949054288128 ext(0->1048575) 00002000:00010000:2.0:1746129818.880092:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d0000 00000100:00100000:2.0:1746129818.880122:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6821 00000100:00100000:2.0:1746129818.880128:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054288128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.882212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.882259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.882715:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054288384 00000100:00100000:1.0:1746129818.882722:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054288384 00000100:00100000:3.0:1746129818.882736:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054288640 00000100:00100000:3.0:1746129818.882740:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054288640 00002000:00100000:1.0:1746129818.882754:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009f8d0380 x1830949054288384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.882757:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f8d0700 x1830949054288640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.882762:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0380 with x1830949054288384 ext(1048576->2097151) 00002000:00100000:3.0:1746129818.882766:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0700 with x1830949054288640 ext(1048576->2097151) 00002000:00010000:1.0:1746129818.882767:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d0380 00002000:00010000:3.0:1746129818.882769:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d0700 00000100:00100000:1.0:1746129818.882790:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6822 00000100:00100000:2.0:1746129818.882795:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6823 00000100:00100000:1.0:1746129818.882795:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054288384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.882800:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054288640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.882883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.882938:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054288896 00000100:00100000:3.0:1746129818.882941:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054288896 00002000:00100000:3.0:1746129818.882954:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009f8d0a80 x1830949054288896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 504/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.882961:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0a80 with x1830949054288896 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.882963:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d0a80 00000100:00100000:3.0:1746129818.882974:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6824 00000100:00100000:3.0:1746129818.882978:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054288896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129818.896550:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054288128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16414us (16557us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.896561:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6821 00002000:00100000:2.0:1746129818.896572:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009f8d0000 x1830949054288128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.896581:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0000 with x1830949054288128 ext(0->1048575) 00002000:00010000:2.0:1746129818.896585:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d0000 00000100:00100000:3.0:1746129818.897922:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054288640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15117us (15658us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.897932:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6823 00002000:00100000:3.0:1746129818.897939:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009f8d0700 x1830949054288640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.897948:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0700 with x1830949054288640 ext(1048576->2097151) 00002000:00010000:3.0:1746129818.897952:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d0700 00000100:00100000:2.0:1746129818.902078:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054288896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19090us (19186us total) trans 0 rc 1032192/1032192 00000100:00100000:1.0:1746129818.902078:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054288384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19274us (19864us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.902087:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6824 00000100:00100000:1.0:1746129818.902091:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6822 00002000:00100000:2.0:1746129818.902097:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009f8d0a80 x1830949054288896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 504/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1032192/1032192 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.902097:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009f8d0380 x1830949054288384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.902105:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0a80 with x1830949054288896 ext(1048576->2097151) 00002000:00100000:1.0:1746129818.902105:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0380 with x1830949054288384 ext(1048576->2097151) 00002000:00010000:2.0:1746129818.902110:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d0a80 00002000:00010000:1.0:1746129818.902110:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d0380 00000100:00100000:0.0:1746129818.919455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.919550:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054289152 00000100:00100000:2.0:1746129818.919560:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054289152 00002000:00100000:2.0:1746129818.919601:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f8d0e00 x1830949054289152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.919608:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0e00 with x1830949054289152 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.919613:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d0e00 00000100:00100000:2.0:1746129818.919639:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6825 00000100:00100000:2.0:1746129818.919645:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054289152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.919673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.919684:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054289408 00000100:00100000:0.0:1746129818.919686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.919689:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054289408 00002000:00100000:1.0:1746129818.919705:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f8d1180 x1830949054289408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.919713:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1180 with x1830949054289408 ext(3145728->4194303) 00002000:00010000:1.0:1746129818.919716:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d1180 00000100:00100000:0.0:1746129818.919721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.919728:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054289664 00000100:00100000:1.0:1746129818.919730:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054289664 00002000:00100000:1.0:1746129818.919741:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f8d1500 x1830949054289664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129818.919742:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054289920 00000100:00100000:3.0:1746129818.919746:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054289920 00002000:00100000:1.0:1746129818.919747:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1500 with x1830949054289664 ext(2097152->3145727) 00002000:00010000:1.0:1746129818.919750:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d1500 00002000:00100000:3.0:1746129818.919763:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f8d1880 x1830949054289920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.919771:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1880 with x1830949054289920 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.919773:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d1880 00000100:00100000:1.0:1746129818.919776:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6826 00000100:00100000:1.0:1746129818.919782:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054289408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.920074:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6827 00000100:00100000:3.0:1746129818.920082:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6828 00000100:00100000:0.0:1746129818.920085:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054289664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.920090:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054289920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129818.933467:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054289920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13368us (13735us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129818.933478:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6828 00002000:00100000:3.0:1746129818.933487:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f8d1880 x1830949054289920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.933496:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1880 with x1830949054289920 ext(3145728->4194303) 00002000:00010000:3.0:1746129818.933501:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d1880 00000100:00100000:2.0:1746129818.935876:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054289664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15788us (16180us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.935886:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6827 00002000:00100000:2.0:1746129818.935894:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f8d1500 x1830949054289664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.935902:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1500 with x1830949054289664 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.935907:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d1500 00000100:00100000:1.0:1746129818.939142:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054289408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19352us (19463us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129818.939153:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6826 00002000:00100000:1.0:1746129818.939180:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f8d1180 x1830949054289408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.939189:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1180 with x1830949054289408 ext(3145728->4194303) 00002000:00010000:1.0:1746129818.939194:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d1180 00000100:00100000:2.0:1746129818.940278:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054289152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20631us (20829us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129818.940285:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6825 00002000:00100000:2.0:1746129818.940290:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f8d0e00 x1830949054289152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129818.940297:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0e00 with x1830949054289152 ext(2097152->3145727) 00002000:00010000:2.0:1746129818.940300:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d0e00 00000100:00100000:0.0:1746129818.947951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.948046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.948115:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054290048 00000100:00100000:2.0:1746129818.948123:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054290048 00000100:00100000:3.0:1746129818.948146:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054290304 00000100:00100000:2.0:1746129818.948178:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15313 00000100:00100000:2.0:1746129818.948185:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31484:x1830949054290048:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.948201:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129818.948209:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054290304 00010000:00010000:2.0:1746129818.948215:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a57 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129818.948237:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f8d1f80 x1830949054290304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129818.948239:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129818.948246:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1f80 with x1830949054290304 ext(4194304->4931583) 00010000:00010000:2.0:1746129818.948246:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129818.948248:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00010000:3.0:1746129818.948251:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d1f80 00010000:00010000:2.0:1746129818.948252:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1376256->2097151] (req 1376256->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.948276:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.948286:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 21 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.948297:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002432:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.948363:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129818.948605:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6829 00000100:00100000:3.0:1746129818.948612:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054290304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129818.949359:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.949439:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054290560 00000100:00100000:2.0:1746129818.949443:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054290560 00000100:00100000:2.0:1746129818.949476:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10986 00000100:00100000:2.0:1746129818.949483:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31492:x1830949054290560:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.949495:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.949504:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a5e expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.949567:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.949576:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.949581:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.949589:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.949604:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 286 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.949610:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 286 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.949617:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054002560:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.949672:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.949679:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 9 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.949685:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054002688:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.949704:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.950594:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.950662:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002432:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129818.950669:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054290688 00000100:00100000:1.0:1746129818.950674:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054290688 00010000:00010000:3.0:1746129818.950682:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1376256->2097151] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.950694:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ed200, rc 0) 00002000:00100000:1.0:1746129818.950696:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1949696->1966079) req@ffff880130507b80 x1830949054290688/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 16872/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.950702:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507b80 with x1830949054290688 ext(1949696->1966079) 00010000:00010000:1.0:1746129818.950706:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 23 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129818.950713:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 23 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129818.950720:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130507b80 00000100:00100000:3.0:1746129818.950724:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31484:x1830949054290048:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2540us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.950731:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15313 00000100:00100000:1.0:1746129818.950731:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1844 00000100:00100000:1.0:1746129818.950734:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054290688:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129818.951128:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054290688:12345-192.168.204.31@tcp:4:cat.0 Request processed in 321us (465us total) trans 21474841293 rc 0/0 00000100:00100000:1.0:1746129818.951134:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1844 00002000:00100000:1.0:1746129818.951140:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1949696->1966079) req@ffff880130507b80 x1830949054290688/t21474841293(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 16872/448 e 0 to 0 dl 1746129829 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129818.951146:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130507b80 with x1830949054290688 ext(1949696->1966079) 00010000:00010000:1.0:1746129818.951151:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 25 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129818.951170:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 25 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129818.951175:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130507b80 00000100:00100000:0.0:1746129818.953947:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.954165:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.954214:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.954246:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054002560:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.954258:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054002688:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.954277:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129818.954288:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054290816 00000100:00100000:3.0:1746129818.954293:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054290816 00010000:00010000:3.0:1746129818.954317:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 287 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129818.954350:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054290944 00000100:00100000:3.0:1746129818.954352:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054290944 00010000:00010000:3.0:1746129818.954361:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 10 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.954365:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054291072 00000100:00100000:2.0:1746129818.954368:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054291072 00000100:00100000:3.0:1746129818.954373:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7626 00000100:00100000:3.0:1746129818.954379:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1961:x1830949054290816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.954384:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 25 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129818.954388:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.954393:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 287 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129818.954401:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 287 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.954403:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7627 00000100:00100000:2.0:1746129818.954409:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054290944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.954416:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.954418:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e439548e9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a49 expref: 287 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129818.954420:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 10 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129818.954427:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 10 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129818.954547:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7628 00000100:00100000:1.0:1746129818.954555:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054291072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129818.954563:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129818.954581:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 25 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129818.954590:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 25 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129818.954605:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a1ee000/0x48868a4e43954895 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->1966079) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a26 expref: 25 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129818.954619:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.954620:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129818.954626:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.954628:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129818.954632:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129818.954634:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129818.954639:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129818.954643:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129818.954651:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e439548b8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a34 expref: 10 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129818.954658:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.954664:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.954667:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129818.954667:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054002816:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129818.954671:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1961:x1830949054290816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 292us (731us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129818.954672:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.954677:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129818.954679:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7626 00010000:00010000:2.0:1746129818.954688:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.954702:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.954704:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054290944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 295us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.954709:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7627 00010000:00010000:2.0:1746129818.954736:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129818.954742:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129818.954755:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129818.954879:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 287 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.954890:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.954896:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129818.954898:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129818.954900:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:2.0:1746129818.954932:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31492:x1830949054290560:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5450us (5575us total) trans 8589944977 rc 0/0 00000100:00100000:2.0:1746129818.954938:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10986 00000100:00100000:3.0:1746129818.954966:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054290304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6353us (6919us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129818.954985:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6829 00002000:00100000:3.0:1746129818.954994:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009f8d1f80 x1830949054290304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:559/0 lens 488/440 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.955002:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1f80 with x1830949054290304 ext(4194304->4931583) 00002000:00010000:3.0:1746129818.955006:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d1f80 00000100:00100000:0.0:1746129818.957609:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129818.957637:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054002816:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129818.957654:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129818.957688:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054291072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3134us (3473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129818.957697:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7628 00000100:00100000:0.0:1746129818.957701:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.957748:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054291328 00000100:00100000:3.0:1746129818.957753:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054291328 00002000:00100000:3.0:1746129818.957781:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1376256->1380351) req@ffff88009f8d2d80 x1830949054291328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.957789:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d2d80 with x1830949054291328 ext(1376256->1380351) 00002000:00010000:3.0:1746129818.957792:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d2d80 00000100:00100000:2.0:1746129818.957804:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054291456 00000100:00100000:2.0:1746129818.957808:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054291456 00000100:00100000:3.0:1746129818.957812:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6830 00000100:00100000:3.0:1746129818.957817:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054291328:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129818.957829:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15314 00000100:00100000:2.0:1746129818.957834:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054291456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.957842:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.957873:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e4395491a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a65 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.957908:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002944:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129818.957943:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054291328:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 126us (341us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129818.957946:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6830 00002000:00100000:3.0:1746129818.957950:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1376256->1380351) req@ffff88009f8d2d80 x1830949054291328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.957954:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d2d80 with x1830949054291328 ext(1376256->1380351) 00002000:00010000:3.0:1746129818.957956:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d2d80 00000100:00100000:2.0:1746129818.958182:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.959582:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054002944:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.959605:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e4395491a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a65 expref: 23 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.959614:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e4395491a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a65 expref: 23 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.959623:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0a00, rc 0) 00000100:00100000:2.0:1746129818.959647:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054291456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1813us (1946us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.959653:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15314 00000100:00100000:1.0:1746129818.961084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.961258:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054291584 00000100:00100000:2.0:1746129818.961263:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054291584 00000100:00100000:2.0:1746129818.961299:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15315 00000100:00100000:2.0:1746129818.961305:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054291584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129818.961315:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.961326:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954921 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a6c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.961360:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003072:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129818.961419:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.962582:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003072:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129818.962602:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954921 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a6c expref: 23 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.962612:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954921 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a6c expref: 23 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.962624:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0400, rc 0) 00000100:00100000:2.0:1746129818.962896:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054291584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1590us (1813us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129818.962903:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15315 00000100:00100000:0.0:1746129818.963072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.963118:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054291712 00000100:00100000:2.0:1746129818.963123:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054291712 00000100:00100000:2.0:1746129818.963209:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15316 00000100:00100000:2.0:1746129818.963215:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31484:x1830949054291712:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129818.963224:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129818.963231:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a73 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.963255:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.963262:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.963268:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.963273:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.963274:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.963277:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->2322431] (req 2097152->2322431) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.963301:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.963311:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 12 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129818.963320:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003200:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.963381:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129818.963388:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129818.963396:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003328:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129818.963420:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.963427:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 21 pid: 8435 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.963434:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003456:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129818.963457:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129818.964597:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130506a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003200:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.964606:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003328:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129818.965629:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.965707:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054292096 00000100:00100000:2.0:1746129818.965714:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054292096 00000100:00100000:2.0:1746129818.965780:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4579 00000100:00100000:2.0:1746129818.965789:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31489:x1830949054292096:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129818.965978:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003456:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129818.966016:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->2322431] (req 2097152->2322431) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129818.966027:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0c00, rc 0) 00000100:00100000:0.0:1746129818.966239:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31484:x1830949054291712:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3023us (3166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.966241:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31489:x1830949054292096:12345-192.168.204.31@tcp:35:cat.0 Request processed in 451us (611us total) trans 8589944978 rc 0/0 00000100:00100000:0.0:1746129818.966245:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15316 00000100:00100000:2.0:1746129818.966248:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4579 00000100:00100000:0.0:1746129818.968037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.968987:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129818.969072:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.969149:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054292224 00000100:00100000:2.0:1746129818.969167:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054292224 00010000:00010000:2.0:1746129818.969194:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129818.969216:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054291840 00000100:00100000:2.0:1746129818.969218:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054291840 00010000:00010000:2.0:1746129818.969226:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 13 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129818.969239:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054292352 00000100:00100000:2.0:1746129818.969241:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054292352 00010000:00010000:2.0:1746129818.969250:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 22 pid: 8435 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129818.969263:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7629 00000100:00100000:2.0:1746129818.969269:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054292224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.969281:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129818.969299:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129818.969308:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129818.969327:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9d200/0x48868a4e439547e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559d9 expref: 16 pid: 1140 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129818.969337:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7630 00010000:00010000:2.0:1746129818.969340:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129818.969343:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054291840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129818.969350:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129818.969357:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 13 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129818.969364:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 13 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129818.969370:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054292224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (1338us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129818.969375:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d600/0x48868a4e439547c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559af expref: 13 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129818.969376:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7629 00010000:00010000:3.0:1746129818.969385:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.969388:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7631 00000100:00100000:2.0:1746129818.969392:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054292352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129818.969397:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129818.969398:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054291840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129818.969403:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7630 00010000:00010000:2.0:1746129818.969403:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 22 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129818.969410:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 22 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129818.969420:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb4a00/0x48868a4e4395474c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355969 expref: 22 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129818.969427:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.969429:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129818.969435:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.969442:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129818.969467:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129818.969478:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054003584:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129818.969529:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129818.971738:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054003584:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129818.971755:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129818.971783:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054292352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2390us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129818.971797:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7631 00000100:00100000:0.0:1746129818.975131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129818.975844:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054292608 00000100:00100000:3.0:1746129818.975877:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054292608 00002000:00100000:3.0:1746129818.975913:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2318336->2322431) req@ffff8800a645fb80 x1830949054292608/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/0 e 0 to 0 dl 1746129829 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.975922:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949054292608 ext(2318336->2322431) 00002000:00010000:3.0:1746129818.975926:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:3.0:1746129818.975954:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6831 00000100:00100000:3.0:1746129818.975960:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054292608:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129818.976098:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054292608:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 138us (973us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129818.976104:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6831 00002000:00100000:3.0:1746129818.976108:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2318336->2322431) req@ffff8800a645fb80 x1830949054292608/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:559/0 lens 488/4536 e 0 to 0 dl 1746129829 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129818.976115:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645fb80 with x1830949054292608 ext(2318336->2322431) 00002000:00010000:3.0:1746129818.976117:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645fb80 00000100:00100000:0.0:1746129818.978082:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129818.978250:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054292864 00000100:00100000:2.0:1746129818.978256:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054292864 00000100:00100000:2.0:1746129818.978605:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4580 00000100:00100000:2.0:1746129818.978612:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31484:x1830949054292864:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129818.978761:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31484:x1830949054292864:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 150us (687us total) trans 8589944979 rc 0/0 00000100:00100000:2.0:1746129818.978767:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4580 00000100:00100000:0.0:1746129819.014130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.014269:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054292992 00000100:00100000:2.0:1746129819.014277:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054292992 00000100:00100000:2.0:1746129819.014478:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10987 00000100:00100000:2.0:1746129819.014487:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31495:x1830949054292992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.014506:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.014520:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f600/0x48868a4e4395492f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a7a expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.014573:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014584:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014593:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014604:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014609:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014613:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014700:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014710:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.014716:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.014740:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.014750:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 286 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.014764:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054003712:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.014843:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.017328:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054003712:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.017353:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129819.018090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.018229:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054293120 00000100:00100000:2.0:1746129819.018237:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054293120 00010000:00010000:2.0:1746129819.018267:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 287 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.018326:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7632 00000100:00100000:2.0:1746129819.018335:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1964:x1830949054293120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.018348:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.018356:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 287 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.018366:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 287 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.018385:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e4395490c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a5e expref: 287 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.018781:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.018795:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.018808:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.018814:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019120:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019128:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:0.0:1746129819.019180:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:0.0:1746129819.019186:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129819.019201:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019212:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019220:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019225:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019230:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019235:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f25fc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129819.019238:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019244:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019253:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129819.019256:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129819.019260:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019264:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25fc00/0x48868a4e43954936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.019331:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.019402:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1964:x1830949054293120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1065us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.019410:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7632 00010000:00010000:0.0:1746129819.019767:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019774:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019778:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019782:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f25e000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129819.019785:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019790:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019798:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8000) 00010000:00010000:0.0:1746129819.019800:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129819.019803:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019807:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25e000/0x48868a4e4395493d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129819.019872:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25f600/0x48868a4e4395492f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.019894:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.019900:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129819.019902:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129819.019904:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f25ea00, rc 0) 00000100:00100000:0.0:1746129819.019940:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31495:x1830949054292992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5454us (5819us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.019947:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10987 00000100:00100000:0.0:1746129819.023680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.023811:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054293248 00000100:00100000:2.0:1746129819.023821:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054293248 00000100:00100000:2.0:1746129819.023904:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15317 00000100:00100000:2.0:1746129819.023913:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054293248:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.023931:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.023947:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801373f8200/0x48868a4e4395494b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a81 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.023998:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003840:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.024118:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.025035:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.025482:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054293376 00000100:00100000:2.0:1746129819.025487:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054293376 00000100:00100000:2.0:1746129819.025513:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15318 00000100:00100000:2.0:1746129819.025519:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054293376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.025527:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.025537:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e43954952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a88 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.025573:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054003968:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.025640:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.027495:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054003968:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.027530:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e43954952 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a88 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.027542:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e43954952 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a88 expref: 15 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.028005:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3800, rc 0) 00000100:00100000:2.0:1746129819.028053:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054293376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2530us (3017us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.028061:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15318 00000100:00100000:2.0:1746129819.028115:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054003840:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.028144:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801373f8200/0x48868a4e4395494b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a81 expref: 13 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.028165:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801373f8200/0x48868a4e4395494b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a81 expref: 13 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.028175:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373f8200, rc 0) 00000100:00100000:2.0:1746129819.028200:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054293248:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4288us (4528us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.028205:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15317 00000100:00100000:0.0:1746129819.032574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.032683:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054293632 00000100:00100000:2.0:1746129819.032691:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054293632 00000100:00100000:2.0:1746129819.033379:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10988 00000100:00100000:2.0:1746129819.033390:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31495:x1830949054293632:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.033410:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.033426:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43954959 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a8f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.033522:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.033537:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.033544:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.033575:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.033587:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 10 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.033598:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054004096:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.034150:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.035799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.035970:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054004096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.035998:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129819.036094:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054293760 00000100:00100000:3.0:1746129819.036101:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054293760 00010000:00010000:3.0:1746129819.036130:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.037483:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7633 00000100:00100000:3.0:1746129819.037495:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054293760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.037512:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.037519:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.037531:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.037551:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f25ea00/0x48868a4e43954944 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a7a expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.037591:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.037597:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129819.037605:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129819.037612:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129819.037634:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.037700:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054293760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 207us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.037706:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7633 00010000:00010000:2.0:1746129819.038033:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.038042:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129819.038059:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129819.038208:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e43954959 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.038231:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.038237:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.038240:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129819.038242:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3400, rc 0) 00000100:00100000:2.0:1746129819.038277:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31495:x1830949054293632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4889us (5707us total) trans 8589944980 rc 0/0 00000100:00100000:2.0:1746129819.038283:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10988 00000100:00100000:0.0:1746129819.041822:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.041876:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054293888 00000100:00100000:2.0:1746129819.041884:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054293888 00000100:00100000:2.0:1746129819.042228:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10989 00000100:00100000:2.0:1746129819.042236:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31495:x1830949054293888:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.042256:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.042269:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3000/0x48868a4e4395496e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a96 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.042336:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.042349:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.042356:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.042381:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.042391:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.042401:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054004224:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.043526:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.046769:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.046915:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd47480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054004224:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.046940:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129819.047070:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054294016 00000100:00100000:3.0:1746129819.047077:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054294016 00010000:00010000:3.0:1746129819.047102:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 12 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.047200:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7634 00000100:00100000:3.0:1746129819.047208:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054294016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.047218:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.047223:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 12 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.047233:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 12 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.047251:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e43954960 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a8f expref: 12 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.047274:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.047278:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129819.047289:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129819.047295:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129819.047309:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.047341:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054294016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 134us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.047347:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7634 00010000:00010000:2.0:1746129819.047530:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.047537:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129819.047570:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129819.047574:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129819.047632:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.047659:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3000/0x48868a4e4395496e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.047679:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.047685:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.047687:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129819.047689:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2000, rc 0) 00000100:00100000:2.0:1746129819.047713:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31495:x1830949054293888:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5478us (5898us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.047719:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10989 00000100:00100000:2.0:1746129819.050423:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.050706:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.050814:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054294144 00000100:00100000:3.0:1746129819.050823:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054294144 00000100:00100000:3.0:1746129819.051175:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054294272 00000100:00100000:3.0:1746129819.051178:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054294272 00000100:00100000:0.0:1746129819.051258:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15319 00000100:00100000:0.0:1746129819.051269:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054294144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.051286:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.051303:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e4395497c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355a9d expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.051359:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ec9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054004352:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129819.051441:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.051690:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15320 00000100:00100000:3.0:1746129819.051696:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054294272:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129819.051703:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.051709:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfc00/0x48868a4e43954983 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355aa4 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.051729:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054004480:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129819.051751:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.053792:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ec9dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054004352:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.053821:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e4395497c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a9d expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.053835:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bd9cc00/0x48868a4e4395497c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a9d expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.053895:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bd9cc00, rc 0) 00000100:00100000:2.0:1746129819.053942:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054294144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2674us (3523us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.053950:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15319 00000100:00100000:3.0:1746129819.056169:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054004480:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129819.056200:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfc00/0x48868a4e43954983 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aa4 expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.056213:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfc00/0x48868a4e43954983 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aa4 expref: 13 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.056230:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfc00, rc 0) 00000100:00100000:3.0:1746129819.056294:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fd45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054294272:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4594us (5586us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.056300:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15320 00000100:00100000:0.0:1746129819.058750:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.058951:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054294528 00000100:00100000:2.0:1746129819.058960:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054294528 00000100:00100000:2.0:1746129819.059029:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10990 00000100:00100000:2.0:1746129819.059040:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31495:x1830949054294528:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.059059:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.059075:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395498a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355aab expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.059175:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059188:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059197:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059209:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059214:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059219:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059224:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.059227:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059232:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059243:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.059245:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129819.059249:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059254:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43954991 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.059753:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395498a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aab expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.059762:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395498a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aab expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.059772:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2c00, rc 0) 00000100:00100000:2.0:1746129819.059843:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31495:x1830949054294528:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 803us (1098us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.059881:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10990 00000100:00100000:0.0:1746129819.063123:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.063479:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054294784 00000100:00100000:1.0:1746129819.063486:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054294784 00000100:00100000:1.0:1746129819.063541:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4581 00000100:00100000:1.0:1746129819.063549:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31495:x1830949054294784:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129819.064071:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31495:x1830949054294784:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 520us (953us total) trans 8589944981 rc 0/0 00000100:00100000:1.0:1746129819.064078:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4581 00000100:00100000:0.0:1746129819.075030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.075238:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054294912 00000100:00100000:3.0:1746129819.075246:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054294912 00000100:00100000:3.0:1746129819.075296:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15321 00000100:00100000:3.0:1746129819.075304:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31492:x1830949054294912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.075319:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.075334:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ab2 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.075358:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.075365:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.075366:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.075369:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.075395:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 14 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.075406:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 14 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.075422:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054004608:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.075503:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.078036:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054004608:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.078059:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.078073:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfe00, rc 0) 00000100:00100000:3.0:1746129819.078105:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31492:x1830949054294912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2802us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.078112:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15321 00000100:00100000:0.0:1746129819.078579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.079021:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054295040 00000100:00100000:1.0:1746129819.079028:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054295040 00002000:00100000:1.0:1746129819.079061:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1376256->2097151) req@ffff88008ec9ea00 x1830949054295040/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.079070:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9ea00 with x1830949054295040 ext(1376256->2097151) 00010000:00010000:1.0:1746129819.079075:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 15 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.079086:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 15 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129819.079092:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec9ea00 00000100:00100000:1.0:1746129819.079113:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1845 00000100:00100000:1.0:1746129819.079120:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054295040:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129819.091192:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054295040:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 12063us (12605us total) trans 21474841294 rc 0/0 00000100:00100000:0.0:1746129819.091204:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1845 00002000:00100000:0.0:1746129819.091213:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1376256->2097151) req@ffff88008ec9ea00 x1830949054295040/t21474841294(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.091221:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9ea00 with x1830949054295040 ext(1376256->2097151) 00010000:00010000:0.0:1746129819.091229:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 17 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746129819.091241:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 17 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746129819.091246:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec9ea00 00000100:00100000:0.0:1746129819.094683:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.095230:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054295168 00000100:00100000:1.0:1746129819.095237:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054295168 00010000:00010000:1.0:1746129819.095270:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 17 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.095310:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7635 00000100:00100000:1.0:1746129819.095317:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054295168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.095331:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.095349:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 17 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.095359:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 17 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.095378:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ed200/0x48868a4e439548fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a57 expref: 17 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.095392:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.095394:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.095399:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.095406:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.095445:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.095457:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054004736:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.095534:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.098506:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.098668:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054295424 00000100:00100000:2.0:1746129819.098675:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054295424 00000100:00100000:2.0:1746129819.098745:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10991 00000100:00100000:2.0:1746129819.098753:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31501:x1830949054295424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.098772:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.098786:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2400/0x48868a4e4395499f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ab9 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129819.099083:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746129819.099086:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054004736:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.099100:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129819.099294:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.099305:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.099314:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.099328:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129819.099328:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054295168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4010us (4650us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129819.099332:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.099337:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129819.099337:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7635 00010000:00010000:2.0:1746129819.099802:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.099811:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.099817:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129819.099825:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129819.099995:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100002:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100006:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100011:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.100014:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100018:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100027:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129819.100030:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129819.100033:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100037:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e439549a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100049:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100053:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100057:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100061:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.100062:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100066:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100070:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8700) 00010000:00010000:2.0:1746129819.100072:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129819.100073:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100077:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e439549ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.100106:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2400/0x48868a4e4395499f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.100117:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.100122:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.100124:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129819.100126:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3a00, rc 0) 00000100:00100000:2.0:1746129819.100252:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31501:x1830949054295424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1499us (1751us total) trans 8589944982 rc 0/0 00000100:00100000:2.0:1746129819.100258:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10991 00000100:00100000:0.0:1746129819.100299:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.100442:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054295552 00000100:00100000:3.0:1746129819.100447:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054295552 00000100:00100000:3.0:1746129819.100735:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15322 00000100:00100000:3.0:1746129819.100743:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31492:x1830949054295552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.101330:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.101341:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ac0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.101359:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.101365:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.101366:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.101369:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->2830335] (req 2097152->2830335) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.101394:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.101405:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 15 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.101414:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054004864:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.101486:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.102347:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.102392:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054295936 00000100:00100000:3.0:1746129819.102396:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054295936 00000100:00100000:3.0:1746129819.102428:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15323 00000100:00100000:3.0:1746129819.102434:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054295936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.102440:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.102448:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e439549c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ace expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.102478:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054004992:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129819.102524:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.102823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.103009:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054295808 00000100:00100000:2.0:1746129819.103013:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054295808 00000100:00100000:2.0:1746129819.103202:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10992 00000100:00100000:2.0:1746129819.103208:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31499:x1830949054295808:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129819.103221:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.103231:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3000/0x48868a4e439549d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ac7 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.103297:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.103308:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.103314:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.103323:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129819.103338:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.103344:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 13 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.103352:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054005120:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.103425:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.103433:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 10 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.103440:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054005248:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.103458:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800accc0900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.104721:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054004864:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.104741:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->2830335] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 23 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.104743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129819.104752:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80df200, rc 0) 00000100:00100000:3.0:1746129819.104785:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31492:x1830949054295552:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4040us (4482us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.104792:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15322 00000100:00100000:2.0:1746129819.104826:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054004992:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.104841:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e439549c9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ace expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.104873:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e439549c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ace expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.104882:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0400, rc 0) 00000100:00100000:2.0:1746129819.104899:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054295936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2465us (2554us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.104904:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15323 00000100:00100000:0.0:1746129819.104924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.104950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.105005:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054296192 00000100:00100000:3.0:1746129819.105009:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054296192 00000100:00100000:2.0:1746129819.105022:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fd45c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054005120:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.105030:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054005248:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.105033:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 14 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.105043:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129819.105047:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054296320 00000100:00100000:3.0:1746129819.105049:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054296320 00010000:00010000:3.0:1746129819.105057:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.105068:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7636 00000100:00100000:3.0:1746129819.105077:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054296192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.105085:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.105089:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 14 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.105096:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 14 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.105109:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e439549b4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab9 expref: 14 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.105114:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7637 00010000:00010000:3.0:1746129819.105119:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00000100:00100000:1.0:1746129819.105120:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054296320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.105122:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.105126:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.105128:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.105130:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.105133:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129819.105136:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.105146:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43954975 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a96 expref: 11 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.105148:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054296192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.105167:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7636 00010000:00010000:1.0:1746129819.105170:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129819.105173:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.105178:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.105183:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.105196:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.105211:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054296320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.105216:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7637 00000100:00100000:1.0:1746129819.105231:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054296064 00000100:00100000:1.0:1746129819.105234:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054296064 00002000:00100000:1.0:1746129819.105364:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2322431) req@ffff88008ec9f800 x1830949054296064/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.105378:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f800 with x1830949054296064 ext(2097152->2322431) 00010000:00010000:1.0:1746129819.105383:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 16 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.105393:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 16 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129819.105399:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec9f800 00000100:00100000:1.0:1746129819.105422:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1846 00000100:00100000:1.0:1746129819.105428:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054296064:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:1.0:1746129819.105631:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.105753:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:1.0:1746129819.105766:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129819.105885:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3000/0x48868a4e439549d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.105895:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.105900:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129819.105902:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129819.105904:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3400, rc 0) 00000100:00100000:1.0:1746129819.105930:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31499:x1830949054295808:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2722us (3107us total) trans 8589944983 rc 0/0 00000100:00100000:1.0:1746129819.105935:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10992 00000100:00100000:1.0:1746129819.110363:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054296064:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 4926us (5610us total) trans 21474841295 rc 0/0 00000100:00100000:1.0:1746129819.110375:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1846 00002000:00100000:1.0:1746129819.110386:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2322431) req@ffff88008ec9f800 x1830949054296064/t21474841295(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.110395:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f800 with x1830949054296064 ext(2097152->2322431) 00010000:00010000:1.0:1746129819.110403:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.110417:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129819.110424:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ec9f800 00000100:00100000:0.0:1746129819.112746:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.113547:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054296448 00000100:00100000:2.0:1746129819.113555:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054296448 00010000:00010000:2.0:1746129819.113585:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.113660:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7638 00000100:00100000:2.0:1746129819.113668:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054296448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.113680:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.113698:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.113709:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.113728:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2322431) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a73 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.113742:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.113744:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.113750:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.113758:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.113789:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.113798:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054005376:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129819.113929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.113950:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054296832 00000100:00100000:1.0:1746129819.113954:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054296832 00002000:00100000:1.0:1746129819.113979:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88008ec9e680 x1830949054296832/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.113987:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9e680 with x1830949054296832 ext(0->1048575) 00002000:00010000:1.0:1746129819.113990:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9e680 00000100:00100000:0.0:1746129819.114138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.114207:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800accc0900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.114372:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054297088 00000100:00100000:1.0:1746129819.114375:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054297088 00002000:00100000:1.0:1746129819.114390:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88008ec9f100 x1830949054297088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129819.114393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129819.114397:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f100 with x1830949054297088 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.114498:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9f100 00000100:00100000:3.0:1746129819.114536:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054296960 00000100:00100000:3.0:1746129819.114540:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054296960 00002000:00100000:3.0:1746129819.114554:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88008ec9c380 x1830949054296960/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.114561:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9c380 with x1830949054296960 ext(1048576->2097151) 00002000:00010000:3.0:1746129819.114564:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9c380 00000100:00100000:2.0:1746129819.114566:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6832 00000100:00100000:3.0:1746129819.114741:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6833 00000100:00100000:3.0:1746129819.114748:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054297088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.114914:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054296832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.115041:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6834 00000100:00100000:3.0:1746129819.115046:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054296960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.117118:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054005376:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129819.117137:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.117170:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054296448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3503us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.117180:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7638 00000100:00100000:0.0:1746129819.121787:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.121837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.121889:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054297472 00000100:00100000:3.0:1746129819.121898:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054297472 00002000:00100000:3.0:1746129819.121932:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2826240->2830335) req@ffff88008ec9d180 x1830949054297472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.121942:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9d180 with x1830949054297472 ext(2826240->2830335) 00002000:00010000:3.0:1746129819.121949:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9d180 00000100:00100000:3.0:1746129819.121967:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6835 00000100:00100000:3.0:1746129819.121973:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054297472:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129819.122151:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054297472:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 177us (371us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129819.122165:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054297600 00000100:00100000:2.0:1746129819.122169:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054297600 00000100:00100000:3.0:1746129819.122171:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6835 00002000:00100000:3.0:1746129819.122176:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2826240->2830335) req@ffff88008ec9d180 x1830949054297472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.122182:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9d180 with x1830949054297472 ext(2826240->2830335) 00002000:00010000:3.0:1746129819.122185:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9d180 00000100:00100000:2.0:1746129819.122202:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15324 00000100:00100000:2.0:1746129819.122209:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31499:x1830949054297600:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129819.122219:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.122235:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ad5 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.122262:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 29 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.122271:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.122283:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.122314:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.122316:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.122320:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2854912->3145727] (req 2854912->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.122348:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.122359:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 13 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.122370:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054005504:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.122449:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.122457:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 21 pid: 1140 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.122465:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054005632:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.122489:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 29 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.122501:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 29 pid: 3624 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.122509:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054005760:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.122527:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.123872:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054297088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9098us (9707us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.123881:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6833 00002000:00100000:2.0:1746129819.123889:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88008ec9f100 x1830949054297088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.123896:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f100 with x1830949054297088 ext(1048576->2097151) 00002000:00010000:2.0:1746129819.123899:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9f100 00000100:00100000:0.0:1746129819.125764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.125788:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054005504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.125799:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054005632:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.125807:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054005760:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.125831:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2854912->3145727] (req 2854912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.125862:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2400, rc 0) 00000100:00100000:2.0:1746129819.125889:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31499:x1830949054297600:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3680us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.125896:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15324 00000100:00100000:3.0:1746129819.125926:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054297728 00000100:00100000:3.0:1746129819.125933:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054297728 00010000:00010000:3.0:1746129819.125961:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 14 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.125980:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7639 00000100:00100000:3.0:1746129819.125986:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054297728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.125995:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.126010:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 14 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.126020:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 14 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.126038:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e439547ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559b6 expref: 14 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.126064:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.126081:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054297728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.126086:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7639 00000100:00100000:1.0:1746129819.126112:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054296960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11064us (11717us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.126119:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6834 00002000:00100000:1.0:1746129819.126126:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88008ec9c380 x1830949054296960/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.126133:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9c380 with x1830949054296960 ext(1048576->2097151) 00000100:00080000:0.0:1746129819.126134:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1746129819.126137:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9c380 00000100:00100000:3.0:1746129819.127084:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054296832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12509us (13153us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.127092:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6832 00002000:00100000:3.0:1746129819.127097:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88008ec9e680 x1830949054296832/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.127105:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9e680 with x1830949054296832 ext(0->1048575) 00002000:00010000:3.0:1746129819.127108:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9e680 00000100:00100000:1.0:1746129819.127646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.127717:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054297856 00000100:00100000:0.0:1746129819.127722:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054297856 00010000:00010000:0.0:1746129819.127738:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 17 pid: 1140 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.127769:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7640 00000100:00100000:0.0:1746129819.127775:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054297856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129819.127784:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129819.127799:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 17 pid: 1140 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.127807:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 17 pid: 1140 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.127824:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bd9da00/0x48868a4e439547ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e0 expref: 17 pid: 1140 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.127838:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129819.127887:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054297856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.127893:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7640 00000100:00100000:0.0:1746129819.129469:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.129504:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.129523:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054298240 00000100:00100000:1.0:1746129819.129529:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054298240 00000100:00100000:3.0:1746129819.129555:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054297984 00000100:00100000:3.0:1746129819.129559:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054297984 00000100:00100000:1.0:1746129819.129573:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4582 00010000:00010000:3.0:1746129819.129576:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 30 pid: 3624 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.129580:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31492:x1830949054298240:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129819.129890:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7641 00000100:00100000:3.0:1746129819.129896:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054297984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.129904:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.129918:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 30 pid: 3624 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.129928:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 30 pid: 3624 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.129950:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e9200/0x48868a4e4395473e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355962 expref: 30 pid: 3624 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.129960:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.129962:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.129968:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.129975:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.130000:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.130011:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054005888:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.130556:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31492:x1830949054298240:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 976us (1091us total) trans 8589944984 rc 0/0 00000100:00100000:1.0:1746129819.130561:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4582 00000100:00100000:3.0:1746129819.130681:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.132384:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054005888:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129819.132399:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.132435:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054297984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2538us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.132443:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7641 00000100:00100000:0.0:1746129819.132810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.132871:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054298496 00000100:00100000:3.0:1746129819.132877:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054298496 00002000:00100000:3.0:1746129819.132904:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2854912->2859007) req@ffff880091fa4700 x1830949054298496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.132917:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4700 with x1830949054298496 ext(2854912->2859007) 00002000:00010000:3.0:1746129819.132921:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa4700 00000100:00100000:3.0:1746129819.132945:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6836 00000100:00100000:3.0:1746129819.132950:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054298496:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129819.133062:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054298496:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 111us (252us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129819.133068:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6836 00002000:00100000:3.0:1746129819.133074:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2854912->2859007) req@ffff880091fa4700 x1830949054298496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.133080:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4700 with x1830949054298496 ext(2854912->2859007) 00002000:00010000:3.0:1746129819.133083:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa4700 00000100:00100000:0.0:1746129819.134909:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.135057:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054298624 00000100:00100000:2.0:1746129819.135063:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054298624 00000100:00100000:2.0:1746129819.135099:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15325 00000100:00100000:2.0:1746129819.135104:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31501:x1830949054298624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.135116:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.135130:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355adc expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.135164:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.135171:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129819.135172:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129819.135175:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.135207:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.135217:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 22 pid: 1877 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.135228:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054006016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.135310:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.135750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.135899:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054298752 00000100:00100000:3.0:1746129819.135903:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054298752 00000100:00100000:3.0:1746129819.135927:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15326 00000100:00100000:3.0:1746129819.135932:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31499:x1830949054298752:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.135938:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.135945:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ae3 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.135957:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.135962:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.135964:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.135966:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.135981:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 22 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.135988:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 22 pid: 1877 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.135996:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054006144:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.136060:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.136695:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054006016:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.136711:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 20 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.136725:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2600, rc 0) 00000100:00100000:2.0:1746129819.136750:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31501:x1830949054298624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1645us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.136756:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15325 00000100:00100000:0.0:1746129819.137367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.137386:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054006144:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.137400:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->3223551] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.137410:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0a00, rc 0) 00000100:00100000:3.0:1746129819.137429:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31499:x1830949054298752:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1497us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.137429:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054298880 00000100:00100000:2.0:1746129819.137433:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054298880 00000100:00100000:3.0:1746129819.137434:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15326 00002000:00100000:2.0:1746129819.137455:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1900544->2097151) req@ffff880091fa5180 x1830949054298880/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.137463:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5180 with x1830949054298880 ext(1900544->2097151) 00010000:00010000:2.0:1746129819.137538:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 23 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.137549:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 23 pid: 1877 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746129819.137555:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa5180 00000100:00100000:0.0:1746129819.137661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.137883:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054299008 00000100:00100000:2.0:1746129819.137886:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054299008 00000100:00100000:3.0:1746129819.137889:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1847 00000100:00100000:3.0:1746129819.137896:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054298880:12345-192.168.204.31@tcp:4:multiop.0 00002000:00100000:2.0:1746129819.137899:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2830335) req@ffff880091fa5500 x1830949054299008/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.137906:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5500 with x1830949054299008 ext(2097152->2830335) 00010000:00010000:2.0:1746129819.137910:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 24 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.137917:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 24 pid: 1877 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746129819.137923:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa5500 00000100:00100000:2.0:1746129819.137934:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1848 00000100:00100000:2.0:1746129819.137939:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054299008:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129819.142104:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054298880:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 4200us (4729us total) trans 21474841296 rc 0/0 00000100:00100000:3.0:1746129819.142114:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1847 00002000:00100000:3.0:1746129819.142123:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1900544->2097151) req@ffff880091fa5180 x1830949054298880/t21474841296(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.142132:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5180 with x1830949054298880 ext(1900544->2097151) 00010000:00010000:3.0:1746129819.142140:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.142150:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.142169:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa5180 00000100:00100000:0.0:1746129819.146122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.146197:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054299136 00000100:00100000:3.0:1746129819.146205:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054299136 00010000:00010000:3.0:1746129819.146231:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.146261:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7642 00000100:00100000:3.0:1746129819.146268:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054299136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.146279:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.146297:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.146307:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.146327:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ab2 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.146348:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.146350:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.146356:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.146364:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.146389:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.146482:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054006272:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129819.146753:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.150021:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054299008:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 12072us (12351us total) trans 21474841297 rc 0/0 00000100:00100000:0.0:1746129819.150033:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1848 00002000:00100000:0.0:1746129819.150042:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2830335) req@ffff880091fa5500 x1830949054299008/t21474841297(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.150051:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5500 with x1830949054299008 ext(2097152->2830335) 00010000:00010000:0.0:1746129819.150060:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746129819.150071:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 27 pid: 1877 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746129819.150077:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa5500 00000100:00100000:2.0:1746129819.150438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.150561:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054006272:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129819.150574:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129819.150593:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054299136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4326us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.150600:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7642 00000100:00100000:1.0:1746129819.151133:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054299392 00000100:00100000:1.0:1746129819.151139:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054299392 00002000:00100000:1.0:1746129819.151174:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a00c4a80 x1830949054299392/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.151181:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949054299392 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.151184:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4a80 00000100:00100000:1.0:1746129819.151287:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6837 00000100:00100000:1.0:1746129819.151293:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054299392:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129819.153358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.153495:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054299520 00000100:00100000:2.0:1746129819.153500:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054299520 00010000:00010000:2.0:1746129819.153523:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 26 pid: 1877 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.154088:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7643 00000100:00100000:2.0:1746129819.154095:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054299520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.154106:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.154124:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 26 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.154137:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 26 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.154166:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e439549c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2830335) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac0 expref: 26 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.154258:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.154261:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.154267:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.154279:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.154307:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 20 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.154318:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054006400:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129819.155593:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.156994:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054299392:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 5696us (6551us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.157004:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6837 00002000:00100000:1.0:1746129819.157013:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a00c4a80 x1830949054299392/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.157022:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949054299392 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.157026:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4a80 00000100:00100000:2.0:1746129819.157216:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054006400:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129819.157231:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.157534:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054299520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3438us (4178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.157541:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7643 00000100:00100000:0.0:1746129819.157738:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.157910:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054299776 00000100:00100000:1.0:1746129819.157915:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054299776 00002000:00100000:1.0:1746129819.157938:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3219456->3223551) req@ffff880091fa5880 x1830949054299776/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.157946:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5880 with x1830949054299776 ext(3219456->3223551) 00002000:00010000:1.0:1746129819.157949:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5880 00000100:00100000:1.0:1746129819.157976:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6838 00000100:00100000:1.0:1746129819.157982:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054299776:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129819.158324:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054299776:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 341us (586us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129819.158330:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6838 00002000:00100000:1.0:1746129819.158335:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3219456->3223551) req@ffff880091fa5880 x1830949054299776/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.158342:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5880 with x1830949054299776 ext(3219456->3223551) 00002000:00010000:1.0:1746129819.158344:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5880 00000100:00100000:0.0:1746129819.165457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.165509:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.165600:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054300160 00000100:00100000:3.0:1746129819.165601:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054300288 00000100:00100000:3.0:1746129819.165608:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054300288 00000100:00100000:1.0:1746129819.165608:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054300160 00002000:00100000:3.0:1746129819.165641:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3223552->4194303) req@ffff880091fa5f80 x1830949054300288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.165641:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880091fa5c00 x1830949054300160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.165649:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5c00 with x1830949054300160 ext(2097152->3145727) 00002000:00100000:3.0:1746129819.165650:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5f80 with x1830949054300288 ext(3223552->4194303) 00002000:00010000:3.0:1746129819.165654:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5f80 00002000:00010000:1.0:1746129819.165654:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5c00 00000100:00100000:1.0:1746129819.165674:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6839 00000100:00100000:3.0:1746129819.165679:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6840 00000100:00100000:1.0:1746129819.165681:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054300160:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.165688:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054300288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.165867:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.165878:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054300672 00000100:00100000:0.0:1746129819.165881:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054300672 00002000:00100000:0.0:1746129819.165896:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3436544->4194303) req@ffff880091fa6300 x1830949054300672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.165902:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6300 with x1830949054300672 ext(3436544->4194303) 00002000:00010000:0.0:1746129819.165905:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6300 00000100:00100000:0.0:1746129819.165913:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6841 00000100:00100000:0.0:1746129819.165917:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054300672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.166675:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.166690:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054300544 00000100:00100000:0.0:1746129819.166693:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054300544 00002000:00100000:0.0:1746129819.166707:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3436543) req@ffff880091fa6680 x1830949054300544/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 504/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.166712:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6680 with x1830949054300544 ext(2097152->3436543) 00002000:00010000:0.0:1746129819.166715:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6680 00000100:00100000:0.0:1746129819.166733:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6842 00000100:00100000:0.0:1746129819.166737:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054300544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.176221:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054300672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10291us (10342us total) trans 0 rc 757760/757760 00000100:00100000:2.0:1746129819.176232:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6841 00002000:00100000:2.0:1746129819.176242:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3436544->4194303) req@ffff880091fa6300 x1830949054300672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 757760/757760 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129819.176246:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054300288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10561us (10735us total) trans 0 rc 970752/970752 00002000:00100000:2.0:1746129819.176251:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6300 with x1830949054300672 ext(3436544->4194303) 00000100:00100000:3.0:1746129819.176254:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6840 00002000:00010000:2.0:1746129819.176256:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6300 00002000:00100000:3.0:1746129819.176259:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3223552->4194303) req@ffff880091fa5f80 x1830949054300288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 970752/970752 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.176266:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5f80 with x1830949054300288 ext(3223552->4194303) 00002000:00010000:3.0:1746129819.176270:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5f80 00000100:00100000:1.0:1746129819.181000:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054300160:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15312us (15542us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.181011:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6839 00002000:00100000:1.0:1746129819.181020:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880091fa5c00 x1830949054300160/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.181029:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5c00 with x1830949054300160 ext(2097152->3145727) 00002000:00010000:1.0:1746129819.181035:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5c00 00000100:00100000:2.0:1746129819.182449:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054300544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15707us (15771us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.182457:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6842 00002000:00100000:2.0:1746129819.182464:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3436543) req@ffff880091fa6680 x1830949054300544/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 504/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.182473:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6680 with x1830949054300544 ext(2097152->3436543) 00002000:00010000:2.0:1746129819.182477:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6680 00000100:00100000:0.0:1746129819.191608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.191730:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054301056 00000100:00100000:2.0:1746129819.191738:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054301056 00002000:00100000:2.0:1746129819.191776:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880091fa6a00 x1830949054301056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.191786:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6a00 with x1830949054301056 ext(4194304->4931583) 00002000:00010000:2.0:1746129819.191791:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa6a00 00000100:00100000:2.0:1746129819.191818:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6843 00000100:00100000:2.0:1746129819.191825:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054301056:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.192654:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.192691:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054301312 00000100:00100000:1.0:1746129819.192695:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054301312 00000100:00100000:1.0:1746129819.192739:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10993 00000100:00100000:1.0:1746129819.192745:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31507:x1830949054301312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.192760:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.192774:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136379c00/0x48868a4e439549fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355aea expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.192868:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.192878:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.192889:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.192900:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.192905:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.192910:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.192994:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193002:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193008:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:1.0:1746129819.193015:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129819.193082:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193088:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193092:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193097:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136379e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129819.193101:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193106:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193115:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129819.193117:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129819.193120:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193124:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379e00/0x48868a4e43954a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193143:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193147:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193151:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193167:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136379800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129819.193169:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193173:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193178:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e8c7700) 00010000:00010000:1.0:1746129819.193180:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129819.193181:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193185:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379800/0x48868a4e43954a08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129819.193214:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379c00/0x48868a4e439549fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 290 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.193223:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 289 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.193228:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129819.193229:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129819.193231:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379600, rc 0) 00000100:00100000:1.0:1746129819.193253:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31507:x1830949054301312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 507us (600us total) trans 8589944985 rc 0/0 00000100:00100000:1.0:1746129819.193259:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10993 00000100:00100000:3.0:1746129819.196858:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054301056:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5014us (5239us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129819.196869:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6843 00002000:00100000:3.0:1746129819.196877:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880091fa6a00 x1830949054301056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.196885:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6a00 with x1830949054301056 ext(4194304->4931583) 00002000:00010000:3.0:1746129819.196889:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa6a00 00000100:00100000:2.0:1746129819.199203:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.199236:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.199267:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.199716:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054301440 00000100:00100000:0.0:1746129819.199723:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054301440 00000100:00100000:0.0:1746129819.199754:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054301568 00000100:00100000:0.0:1746129819.199755:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054301568 00000100:00100000:0.0:1746129819.199769:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054301696 00000100:00100000:0.0:1746129819.199771:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054301696 00000100:00100000:0.0:1746129819.199786:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15327 00000100:00100000:0.0:1746129819.199792:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054301440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.199805:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.199817:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355af1 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.199834:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.199836:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.199843:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.199872:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.199880:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff86c00, rc 0) 00000100:00100000:0.0:1746129819.199911:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054301440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.199916:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15327 00000100:00100000:0.0:1746129819.199927:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15328 00000100:00100000:0.0:1746129819.199932:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054301568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.199937:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.199942:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff87200/0x48868a4e43954a24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355af8 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.199974:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054006528:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129819.200017:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.200105:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15329 00000100:00100000:2.0:1746129819.200112:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054301696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.200119:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.200128:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbc2800/0x48868a4e43954a2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355aff expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.200150:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054006656:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.200186:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.203788:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054006656:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.203821:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbc2800/0x48868a4e43954a2b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aff expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.203835:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbc2800/0x48868a4e43954a2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aff expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.203866:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc2800, rc 0) 00000100:00100000:2.0:1746129819.203902:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054301696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3790us (4633us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.203909:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15329 00000100:00100000:0.0:1746129819.204120:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054006528:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129819.204134:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff87200/0x48868a4e43954a24 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af8 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.204143:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff87200/0x48868a4e43954a24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af8 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.204213:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129819.204609:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129819.204660:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff87200, rc 0) 00000100:00100000:0.0:1746129819.204895:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054301568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4961us (5657us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129819.204897:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054301952 00000100:00100000:0.0:1746129819.204901:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15328 00000100:00100000:1.0:1746129819.204903:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054301952 00000100:00100000:1.0:1746129819.205257:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4583 00000100:00100000:1.0:1746129819.205265:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31501:x1830949054301952:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129819.205417:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31501:x1830949054301952:12345-192.168.204.31@tcp:35:cat.0 Request processed in 152us (808us total) trans 8589944986 rc 0/0 00000100:00100000:1.0:1746129819.205422:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4583 00000100:00100000:0.0:1746129819.217808:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.217916:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054302208 00000100:00100000:3.0:1746129819.217923:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054302208 00002000:00100000:3.0:1746129819.217959:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880091fa7100 x1830949054302208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.217968:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7100 with x1830949054302208 ext(1048576->2097151) 00002000:00010000:3.0:1746129819.217973:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa7100 00000100:00100000:3.0:1746129819.218052:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6844 00000100:00100000:3.0:1746129819.218059:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054302208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.231159:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054302208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13083us (13342us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.231170:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6844 00002000:00100000:3.0:1746129819.231180:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880091fa7100 x1830949054302208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.231189:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7100 with x1830949054302208 ext(1048576->2097151) 00002000:00010000:3.0:1746129819.231194:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa7100 00000100:00100000:0.0:1746129819.236648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.236739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.237625:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054302464 00000100:00100000:2.0:1746129819.237625:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054302336 00000100:00100000:3.0:1746129819.237633:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054302464 00000100:00100000:2.0:1746129819.237633:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054302336 00000100:00100000:2.0:1746129819.237675:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15330 00000100:00100000:2.0:1746129819.237684:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054302336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.237700:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.237714:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3000/0x48868a4e43954a32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b06 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.237742:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15331 00000100:00100000:3.0:1746129819.237747:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054302464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.237753:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129819.237758:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054006784:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129819.237760:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0400/0x48868a4e43954a39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b0d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.237779:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054006912:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.237815:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.237888:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.239425:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054006784:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.239447:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3000/0x48868a4e43954a32 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b06 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.239457:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3000/0x48868a4e43954a32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b06 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.239470:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc3000, rc 0) 00000100:00100000:2.0:1746129819.239508:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054302336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1827us (2868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.239514:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15330 00000100:00100000:3.0:1746129819.239592:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054006912:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129819.239605:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0400/0x48868a4e43954a39 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b0d expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.239613:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0400/0x48868a4e43954a39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b0d expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.239622:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0400, rc 0) 00000100:00100000:3.0:1746129819.239638:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054302464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1891us (2899us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.239643:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15331 00000100:00100000:0.0:1746129819.244663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.245766:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054302592 00000100:00100000:3.0:1746129819.245775:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054302592 00000100:00100000:3.0:1746129819.245907:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15332 00000100:00100000:3.0:1746129819.245915:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31507:x1830949054302592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.246103:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.246119:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b14 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.246143:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.246164:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.246166:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.246170:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.246196:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.246206:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 18 pid: 1877 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.246222:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054007040:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.246651:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.249236:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054007040:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.249259:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.249273:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0c00, rc 0) 00000100:00100000:3.0:1746129819.249306:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31507:x1830949054302592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3391us (4650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.249312:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15332 00000100:00100000:0.0:1746129819.251037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.251373:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054302720 00000100:00100000:3.0:1746129819.251380:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054302720 00002000:00100000:3.0:1746129819.251412:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3223551) req@ffff880091fa4000 x1830949054302720/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.251421:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4000 with x1830949054302720 ext(3145728->3223551) 00010000:00010000:3.0:1746129819.251429:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 19 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.251441:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 19 pid: 1877 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.251447:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa4000 00000100:00100000:3.0:1746129819.251475:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1849 00000100:00100000:3.0:1746129819.251482:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054302720:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129819.254252:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054302720:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2762us (3212us total) trans 21474841298 rc 0/0 00000100:00100000:3.0:1746129819.254262:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1849 00002000:00100000:3.0:1746129819.254271:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3223551) req@ffff880091fa4000 x1830949054302720/t21474841298(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.254280:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4000 with x1830949054302720 ext(3145728->3223551) 00010000:00010000:3.0:1746129819.254288:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 21 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.254300:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 21 pid: 1877 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.254311:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa4000 00000100:00100000:0.0:1746129819.259005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.259074:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054302848 00000100:00100000:2.0:1746129819.259082:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054302848 00010000:00010000:2.0:1746129819.259112:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 21 pid: 1877 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.259160:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7644 00000100:00100000:2.0:1746129819.259168:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054302848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.259181:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.259202:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 21 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.259213:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 21 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.259233:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e439549f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3223551) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ae3 expref: 21 pid: 1877 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.259259:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.259261:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.259268:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.259279:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.259308:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.259320:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054007168:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129819.259392:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.260726:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054007168:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129819.260740:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.260781:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054302848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1613us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.260789:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7644 00000100:00100000:0.0:1746129819.264169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.264229:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054303104 00000100:00100000:3.0:1746129819.264236:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054303104 00002000:00100000:3.0:1746129819.264275:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008ec9fb80 x1830949054303104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.264284:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9fb80 with x1830949054303104 ext(2097152->3145727) 00002000:00010000:3.0:1746129819.264288:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9fb80 00000100:00100000:3.0:1746129819.264324:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6845 00000100:00100000:3.0:1746129819.264331:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054303104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.272193:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054303104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7855us (8035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.272203:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6845 00002000:00100000:3.0:1746129819.272212:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008ec9fb80 x1830949054303104/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.272220:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9fb80 with x1830949054303104 ext(2097152->3145727) 00002000:00010000:3.0:1746129819.272224:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9fb80 00000100:00100000:0.0:1746129819.280685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.280918:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054303232 00000100:00100000:3.0:1746129819.280926:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054303232 00000100:00100000:3.0:1746129819.281355:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15333 00000100:00100000:3.0:1746129819.281363:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31507:x1830949054303232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.281378:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.281393:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b1b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.281420:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.281426:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.281427:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.281430:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.281455:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.281465:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 15 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.281474:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054007296:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.281779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.281943:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054303360 00000100:00100000:2.0:1746129819.281947:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054303360 00000100:00100000:3.0:1746129819.282782:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.283493:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10994 00000100:00100000:2.0:1746129819.283504:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31509:x1830949054303360:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129819.283521:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.283535:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b22 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.283583:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283594:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283603:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283614:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283618:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283623:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283713:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283722:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.283728:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.283750:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.283758:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 13 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.283768:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054007424:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.283835:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.287582:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054007296:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.287610:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 30 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.287624:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948ca800, rc 0) 00000100:00100000:3.0:1746129819.287672:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31507:x1830949054303232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6309us (6993us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.287680:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15333 00000100:00100000:2.0:1746129819.288380:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054007424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.288399:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129819.288898:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.289082:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054303488 00000100:00100000:3.0:1746129819.289089:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054303488 00002000:00100000:3.0:1746129819.289122:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2854912->3145727) req@ffff88008ec9dc00 x1830949054303488/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.289132:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9dc00 with x1830949054303488 ext(2854912->3145727) 00010000:00010000:3.0:1746129819.289138:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 16 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.289161:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 16 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.289168:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec9dc00 00000100:00100000:3.0:1746129819.289476:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1850 00000100:00100000:3.0:1746129819.289484:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054303488:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129819.290394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.290484:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054303744 00000100:00100000:3.0:1746129819.290488:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054303744 00000100:00100000:3.0:1746129819.290518:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4584 00000100:00100000:3.0:1746129819.290525:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:7658:x1830949054303744:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129819.290661:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:7658:x1830949054303744:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 137us (269us total) trans 8589944987 rc 0/0 00000100:00100000:3.0:1746129819.290667:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4584 00000100:00100000:2.0:1746129819.294414:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.294650:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054303872 00000100:00100000:2.0:1746129819.294657:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054303872 00010000:00010000:2.0:1746129819.294684:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 15 pid: 14313 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.294709:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7645 00000100:00100000:2.0:1746129819.294714:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054303872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.294725:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.294730:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 15 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.294740:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 15 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.294757:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3400/0x48868a4e439549d7 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ac7 expref: 15 pid: 14313 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.295436:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.295441:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295449:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295454:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295478:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.295517:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054303872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 801us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.295523:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7645 00010000:00010000:2.0:1746129819.295543:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295549:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129819.295579:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129819.295583:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129819.295594:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295601:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295608:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295613:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295618:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295623:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbc3400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.295627:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295632:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295640:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129819.295642:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129819.295645:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295649:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954a55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295657:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295661:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295665:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295669:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbc3600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.295672:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295676:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295681:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8800) 00010000:00010000:2.0:1746129819.295683:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129819.295685:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295689:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.295716:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.295726:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.295730:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.295732:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129819.295734:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc3800, rc 0) 00000100:00100000:2.0:1746129819.295754:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31509:x1830949054303360:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 12254us (13975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.295760:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10994 00000100:00100000:3.0:1746129819.296735:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054303488:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7250us (7836us total) trans 17179874101 rc 0/0 00000100:00100000:3.0:1746129819.296744:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1850 00002000:00100000:3.0:1746129819.296752:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2854912->3145727) req@ffff88008ec9dc00 x1830949054303488/t17179874101(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.296765:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9dc00 with x1830949054303488 ext(2854912->3145727) 00010000:00010000:3.0:1746129819.296773:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.296784:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.296790:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ec9dc00 00000100:00100000:0.0:1746129819.299611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.300402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.300451:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054304128 00000100:00100000:2.0:1746129819.300459:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054304128 00000100:00100000:2.0:1746129819.300488:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054304000 00000100:00100000:2.0:1746129819.300490:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054304000 00000100:00100000:3.0:1746129819.300494:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15334 00000100:00100000:3.0:1746129819.300503:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054304128:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129819.300517:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.300531:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b30 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.300551:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.300553:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.300560:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.300573:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 14 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.300583:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80df200, rc 0) 00000100:00100000:3.0:1746129819.300615:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054304128:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 114us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.300631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.300650:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054304256 00000100:00100000:1.0:1746129819.300653:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054304256 00000100:00100000:3.0:1746129819.301728:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15334 00000100:00100000:2.0:1746129819.301748:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15335 00000100:00100000:2.0:1746129819.301755:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054304000:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129819.301763:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129819.301775:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15336 00010000:00010000:2.0:1746129819.301781:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b29 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.301783:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054304256:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129819.301791:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.301796:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.301797:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.301800:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb6ec00/0x48868a4e43954a78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b37 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.301803:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.301814:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.301826:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc3200, rc 0) 00000100:00100000:1.0:1746129819.301835:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054007552:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.301861:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1964:x1830949054304000:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 105us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.301865:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15335 00000100:00100000:1.0:1746129819.301897:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.304346:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.304421:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054304384 00000100:00100000:2.0:1746129819.304428:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054304384 00010000:00010000:2.0:1746129819.304455:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.304478:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7646 00000100:00100000:2.0:1746129819.304483:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054304384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.304495:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.304867:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.304879:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.304899:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.304901:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.304906:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.304913:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.304945:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.304955:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054007680:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129819.306758:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746129819.307201:0:8437:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88012b8e4000 x1830949054007552) - normal race ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.307230:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2400/0x48868a4e439549e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ad5 expref: 18 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.307246:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054007552:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129819.307269:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6ec00/0x48868a4e43954a78 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b37 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.307279:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6ec00/0x48868a4e43954a78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b37 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.307285:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6ec00, rc 0) 00000100:00100000:1.0:1746129819.307334:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054304256:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 5551us (6702us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129819.307341:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15336 00000100:00100000:2.0:1746129819.308893:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054007680:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129819.308907:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129819.311510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.311598:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054304640 00000100:00100000:3.0:1746129819.311605:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054304640 00000100:00100000:3.0:1746129819.311653:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10995 00000100:00100000:3.0:1746129819.311660:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31509:x1830949054304640:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129819.311676:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.311689:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b3e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.311763:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.311775:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.311780:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.311803:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.311813:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 12 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.311823:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054007808:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.311905:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.312262:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054304384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7776us (7920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.312270:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7646 00000100:00100000:0.0:1746129819.321939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.322098:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054007808:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.322123:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129819.322286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.322364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.322660:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054304896 00000100:00100000:1.0:1746129819.322665:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054304896 00002000:00100000:1.0:1746129819.322701:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8801305bd180 x1830949054304896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.322714:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd180 with x1830949054304896 ext(2097152->3145727) 00002000:00010000:1.0:1746129819.322719:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bd180 00000100:00100000:0.0:1746129819.322864:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.322915:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054305152 00000100:00100000:1.0:1746129819.322918:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054305152 00000100:00100000:3.0:1746129819.322921:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054305408 00000100:00100000:3.0:1746129819.322924:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054305408 00002000:00100000:1.0:1746129819.322930:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8801305bd500 x1830949054305152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.322936:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd500 with x1830949054305152 ext(3145728->4194303) 00002000:00100000:3.0:1746129819.322937:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8801305bd880 x1830949054305408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746129819.322939:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bd500 00002000:00100000:3.0:1746129819.322950:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd880 with x1830949054305408 ext(3145728->4194303) 00002000:00010000:3.0:1746129819.322953:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bd880 00000100:00100000:1.0:1746129819.322955:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6846 00000100:00100000:1.0:1746129819.322960:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054304896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.322968:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6847 00000100:00100000:3.0:1746129819.322973:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054305152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.323961:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6848 00000100:00100000:3.0:1746129819.323967:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054305408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.324247:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054305536 00000100:00100000:2.0:1746129819.324253:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054305536 00010000:00010000:2.0:1746129819.324290:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 13 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.324319:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7647 00000100:00100000:2.0:1746129819.324327:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054305536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.324337:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.324343:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 13 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.324358:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 13 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.324377:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3800/0x48868a4e43954a63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b22 expref: 13 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.324397:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.324402:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.324410:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.324416:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.324433:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.324462:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054305536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 137us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.324468:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7647 00010000:00010000:2.0:1746129819.324486:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.324492:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129819.324507:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129819.324608:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b3e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.324623:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b3e expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.324629:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.324632:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129819.324634:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80de800, rc 0) 00000100:00100000:2.0:1746129819.324651:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31509:x1830949054304640:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 12992us (13150us total) trans 8589944988 rc 0/0 00000100:00100000:2.0:1746129819.324657:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10995 00000100:00100000:0.0:1746129819.332230:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.332304:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.332624:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054305152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9649us (10337us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.332633:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6847 00002000:00100000:3.0:1746129819.332643:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8801305bd500 x1830949054305152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.332650:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd500 with x1830949054305152 ext(3145728->4194303) 00002000:00010000:3.0:1746129819.332655:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bd500 00000100:00100000:3.0:1746129819.332682:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054305792 00000100:00100000:3.0:1746129819.332687:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054305792 00000100:00100000:3.0:1746129819.332710:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306048 00000100:00100000:3.0:1746129819.332712:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306048 00000100:00100000:3.0:1746129819.332737:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10996 00000100:00100000:3.0:1746129819.332742:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31512:x1830949054305792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.332758:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129819.332758:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10997 00000100:00100000:2.0:1746129819.332766:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31509:x1830949054306048:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129819.332771:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b45 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.332775:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.332777:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129819.332791:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954a86 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b3e expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.332805:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.332808:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129819.332814:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a9b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b4c expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.332843:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.332870:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129819.332874:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.332877:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129819.332881:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.332886:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129819.332890:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129819.332894:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129819.332895:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.332899:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.332959:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.332960:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3600/0x48868a4e43954a9b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 14 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.332965:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.332970:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.332971:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746129819.332975:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129819.332976:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.332978:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129819.332979:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc3400, rc 0) 00010000:00010000:3.0:1746129819.333004:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333009:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129819.333010:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31509:x1830949054306048:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 245us (705us total) trans 8589944989 rc 0/0 00010000:00010000:3.0:1746129819.333013:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129819.333015:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10997 00010000:00010000:3.0:1746129819.333020:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.333023:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333028:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333034:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.333035:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129819.333037:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333041:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954abe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333051:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333055:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333059:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333062:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948cb800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.333064:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333068:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333072:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129819.333073:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.333075:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333079:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948cb800/0x48868a4e43954aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333084:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333087:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333091:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333094:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bd9da00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.333095:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333099:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333103:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d0cfc00) 00010000:00010000:3.0:1746129819.333104:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.333105:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333109:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bd9da00/0x48868a4e43954ab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.333128:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954a94 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b45 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.333133:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfe00/0x48868a4e43954a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b45 expref: 16 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.333138:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfe00, rc 0) 00000100:00100000:3.0:1746129819.333169:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31512:x1830949054305792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 426us (945us total) trans 8589944990 rc 301/301 00000100:00100000:3.0:1746129819.333174:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10996 00000100:00100000:3.0:1746129819.334402:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054305408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10433us (12035us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.334409:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6848 00002000:00100000:3.0:1746129819.334416:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8801305bd880 x1830949054305408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.334424:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd880 with x1830949054305408 ext(3145728->4194303) 00002000:00010000:3.0:1746129819.334428:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bd880 00000100:00100000:0.0:1746129819.338042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.338213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.338229:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306176 00000100:00100000:0.0:1746129819.338236:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306176 00000100:00100000:1.0:1746129819.338448:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054304896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15486us (16516us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.338458:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6846 00002000:00100000:1.0:1746129819.338466:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8801305bd180 x1830949054304896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.338475:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd180 with x1830949054304896 ext(2097152->3145727) 00002000:00010000:1.0:1746129819.338480:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bd180 00000100:00100000:0.0:1746129819.339331:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306432 00000100:00100000:0.0:1746129819.339335:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306432 00000100:00100000:2.0:1746129819.340166:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15337 00000100:00100000:2.0:1746129819.340176:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054306176:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129819.340211:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.340227:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.340235:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 26 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.340247:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.340252:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.340254:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.340256:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.340281:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.340291:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 19 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.340301:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054007936:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.340359:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 26 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.340367:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 26 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.340374:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054008064:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.340392:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.340404:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 14 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.340410:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054008192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.340425:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.340468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.340510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.340561:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306304 00000100:00100000:1.0:1746129819.340564:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306304 00000100:00100000:2.0:1746129819.340737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.340762:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10998 00000100:00100000:1.0:1746129819.340768:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31512:x1830949054306304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.340781:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.340791:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954ad3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b53 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.340859:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129819.340869:0:14314:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129819.340879:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:1.0:1746129819.340899:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:1.0:1746129819.340902:0:14314:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129819.340912:0:14314:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:1.0:1746129819.340931:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954ad3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 17 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.340946:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 16 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.340952:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129819.340955:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129819.340957:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6fc00, rc 0) 00000100:00100000:1.0:1746129819.340977:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31512:x1830949054306304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 210us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.340982:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10998 00000100:00100000:2.0:1746129819.341458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.341481:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306560 00000100:00100000:0.0:1746129819.341485:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306560 00000100:00100000:0.0:1746129819.341501:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306688 00000100:00100000:0.0:1746129819.341503:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306688 00000100:00100000:0.0:1746129819.341519:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15338 00000100:00100000:0.0:1746129819.341524:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054306432:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129819.341541:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.341552:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341559:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 29 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341566:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341572:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.341574:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.341576:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.341591:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341598:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.341607:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054008320:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129819.341637:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 29 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341645:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 29 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.341652:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054008448:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129819.341669:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341676:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 14 pid: 1877 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.341688:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054008576:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.341700:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.341713:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15339 00000100:00100000:0.0:1746129819.341718:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054306560:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:0.0:1746129819.341730:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.341739:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341745:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341752:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341756:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.341758:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.341760:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.341771:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341777:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.341785:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054008704:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129819.341803:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341810:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.341816:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054008832:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129819.341844:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.341864:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 14 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.341872:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0094000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054008960:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.341889:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.342016:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15340 00000100:00100000:3.0:1746129819.342023:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054306688:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129819.342039:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.342048:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.342055:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.342061:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.342071:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.342072:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.342074:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.342086:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.342094:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 26 pid: 10930 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.342101:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054009088:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.342127:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 15 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.342134:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 15 pid: 10930 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.342141:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054009216:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.342174:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.342182:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.342193:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054009344:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.342205:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.342304:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306816 00000100:00100000:2.0:1746129819.342307:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306816 00000100:00100000:2.0:1746129819.342322:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15341 00000100:00100000:2.0:1746129819.342327:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949054306816:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129819.342340:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342349:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342356:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.342361:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.342362:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.342364:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342381:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.342388:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.342395:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054009472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.342416:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342424:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 26 pid: 8435 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.342430:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054009600:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.342443:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.342503:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.342516:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054306944 00000100:00100000:2.0:1746129819.342518:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054306944 00000100:00100000:2.0:1746129819.342532:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15342 00000100:00100000:2.0:1746129819.342536:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054306944:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129819.342550:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342559:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342568:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.342570:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.342572:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342584:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.342590:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 29 pid: 8435 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.342598:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054009728:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.342613:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.359295:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.359332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.359361:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307200 00000100:00100000:3.0:1746129819.359369:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307200 00000100:00100000:0.0:1746129819.359377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.359401:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307072 00000100:00100000:3.0:1746129819.359403:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307072 00000100:00100000:3.0:1746129819.359422:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15343 00000100:00100000:3.0:1746129819.359428:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054307200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.359445:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.359458:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919eca00/0x48868a4e43954b04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b61 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.359466:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054008704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.359477:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.359486:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919eca00/0x48868a4e43954b04 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b61 expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129819.359491:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054008832:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.359496:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919eca00/0x48868a4e43954b04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b61 expref: 18 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.359508:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919eca00, rc 0) 00000100:00100000:0.0:1746129819.359508:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.359518:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307456 00000100:00100000:0.0:1746129819.359521:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307456 00010000:00010000:0.0:1746129819.359534:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 21 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.359540:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054307200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (253us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.359545:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15343 00000100:00100000:0.0:1746129819.359548:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307712 00000100:00100000:0.0:1746129819.359550:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307712 00010000:00010000:0.0:1746129819.359557:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.359559:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15344 00000100:00100000:3.0:1746129819.359563:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054307072:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129819.359567:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7648 00010000:00010000:3.0:1746129819.359569:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129819.359571:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054307456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.359576:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919edc00/0x48868a4e43954b0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b5a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.359578:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.359585:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.359589:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919edc00/0x48868a4e43954b0b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b5a expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.359592:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 22 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.359596:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919edc00/0x48868a4e43954b0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b5a expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.359601:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 22 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.359602:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919edc00, rc 0) 00000100:00100000:3.0:1746129819.359614:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054307072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 51us (282us total) trans 0 rc 301/301 00010000:00010000:0.0:1746129819.359614:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.359619:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15344 00000100:00100000:0.0:1746129819.359623:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054307456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.359627:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7648 00000100:00100000:3.0:1746129819.359635:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7649 00000100:00100000:3.0:1746129819.359639:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054307712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.359645:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.359652:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.359659:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.359667:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0094000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054008960:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.359670:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.359681:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054307712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (173us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129819.359684:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.359686:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7649 00000100:00100000:0.0:1746129819.359727:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.359764:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054009088:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.359772:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054009216:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.359873:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054009600:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.359890:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98400/0x48868a4e439547ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559bd expref: 19 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.359904:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054007936:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.359911:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054008064:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.359918:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08cc00/0x48868a4e439547b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355993 expref: 16 pid: 8436 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.359924:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054008192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.359937:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.360240:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054009344:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.360254:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.360830:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.360858:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.360864:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054009728:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.360872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129819.360874:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.360883:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307840 00000100:00100000:3.0:1746129819.360886:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308096 00000100:00100000:0.0:1746129819.360886:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307840 00000100:00100000:3.0:1746129819.360887:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308096 00010000:00010000:3.0:1746129819.360898:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 30 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.360898:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 16 pid: 1877 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.360910:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308352 00000100:00100000:0.0:1746129819.360912:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308352 00000100:00100000:3.0:1746129819.360913:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7650 00000100:00100000:3.0:1746129819.360918:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054307840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129819.360918:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.360925:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129819.360929:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7651 00000100:00100000:0.0:1746129819.360932:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054308096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.360935:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 17 pid: 1877 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.360937:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.360942:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 17 pid: 1877 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.360984:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054009472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.360995:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.361013:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7652 00000100:00100000:2.0:1746129819.361018:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054308352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.361024:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.361034:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.361040:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.361052:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08d400/0x48868a4e439547bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559a1 expref: 17 pid: 8436 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.361062:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.361082:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949054308352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 64us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.361087:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7652 00000100:00100000:2.0:1746129819.361111:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.361189:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308608 00000100:00100000:2.0:1746129819.361192:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308608 00010000:00010000:2.0:1746129819.361203:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 16 pid: 10930 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.361218:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7653 00000100:00100000:2.0:1746129819.361222:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949054308608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.361227:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.361235:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 16 pid: 10930 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.361242:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 16 pid: 10930 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.361252:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3200/0x48868a4e43954a71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b29 expref: 16 pid: 10930 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.361259:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.361274:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054308608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.361278:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7653 00000100:00100000:1.0:1746129819.361551:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054008320:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.361560:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054008448:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.361569:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054008576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129819.361605:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 30 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.361608:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800932d0a00/0x48868a4e439547a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35599a expref: 15 pid: 1877 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.361612:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 30 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.361618:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129819.361622:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acd4f800/0x48868a4e4395482c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559ee expref: 30 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.361633:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.361635:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054307840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 718us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.361640:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7650 00000100:00100000:0.0:1746129819.361643:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054308096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 710us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.361650:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7651 00010000:00010000:1.0:1746129819.361732:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.361753:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307584 00000100:00100000:1.0:1746129819.361756:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307584 00002000:00100000:1.0:1746129819.361779:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a0094000 x1830949054307584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.361787:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094000 with x1830949054307584 ext(4194304->4931583) 00010000:00010000:1.0:1746129819.361793:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.361801:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129819.361806:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0094000 00000100:00100000:1.0:1746129819.361829:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1851 00000100:00100000:1.0:1746129819.361835:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054307584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.362748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.363575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.363596:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308992 00000100:00100000:0.0:1746129819.363600:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308992 00010000:00010000:0.0:1746129819.363618:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.363642:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054307968 00000100:00100000:0.0:1746129819.363644:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054307968 00010000:00010000:0.0:1746129819.363652:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.363664:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7654 00000100:00100000:0.0:1746129819.363669:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054308992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129819.363672:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7655 00000100:00100000:3.0:1746129819.363678:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054307968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129819.363678:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.363685:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129819.363690:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.363693:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.363698:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.363700:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.363712:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98000/0x48868a4e439547d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559c4 expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.363712:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e439549ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355adc expref: 19 pid: 10930 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.363723:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.363723:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129819.363724:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.363728:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.363735:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.363756:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.364499:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054307968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 820us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.364505:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7655 00000100:00100000:2.0:1746129819.364521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.364529:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308224 00000100:00100000:3.0:1746129819.364532:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308224 00010000:00010000:3.0:1746129819.364543:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.364556:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7656 00000100:00100000:2.0:1746129819.364556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.364560:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054308224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.364566:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129819.364566:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308480 00000100:00100000:2.0:1746129819.364568:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308480 00010000:00010000:3.0:1746129819.364575:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.364579:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.364582:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.364592:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7657 00010000:00010000:3.0:1746129819.364593:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff99a00/0x48868a4e439547d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559cb expref: 16 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.364596:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054308480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.364602:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.364604:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129819.364607:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.364614:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.364617:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054308224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.364622:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7656 00010000:00010000:2.0:1746129819.364624:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e4395481e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559f5 expref: 29 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.364630:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.364632:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.364634:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.364640:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.364658:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.364672:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054308480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.364677:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7657 00000100:00100000:2.0:1746129819.364708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.364726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.364920:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054308992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1249us (2173us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.364926:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7654 00000100:00100000:0.0:1746129819.364959:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308864 00000100:00100000:0.0:1746129819.364961:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308864 00010000:00010000:0.0:1746129819.364971:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 29 pid: 10930 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.364983:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054309120 00000100:00100000:0.0:1746129819.364984:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054309120 00010000:00010000:0.0:1746129819.364991:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 30 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746129819.365001:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7658 00000100:00100000:0.0:1746129819.365005:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054308864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129819.365009:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129819.365017:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 30 pid: 10930 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.365023:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 30 pid: 10930 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.365033:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff86c00/0x48868a4e43954a1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355af1 expref: 30 pid: 10930 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.365041:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.365042:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.365044:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365050:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365060:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129819.365072:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054308864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.365076:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7658 00000100:00100000:0.0:1746129819.365083:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7659 00000100:00100000:0.0:1746129819.365086:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054309120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129819.365091:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129819.365098:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 28 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.365103:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 28 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.365111:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43954817 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3559e7 expref: 28 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746129819.365117:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.365118:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.365120:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365125:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365144:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129819.365166:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054309120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.365170:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7659 00010000:00010000:0.0:1746129819.365184:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365190:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365204:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365210:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365215:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365220:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c3de200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129819.365223:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365229:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365240:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.365246:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3de200/0x48868a4e43954ae8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.365274:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054306560:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 23556us (24763us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.365280:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15339 00010000:00010000:3.0:1746129819.365436:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365443:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365456:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365462:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365467:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365471:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ece00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129819.365473:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365478:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365485:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365490:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43954aef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.365524:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054306688:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 23502us (24787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.365530:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15340 00010000:00010000:1.0:1746129819.365530:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.365536:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.365548:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.365554:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.365560:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365626:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365632:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365643:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365649:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365654:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365658:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbc3a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129819.365660:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365666:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365673:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.365677:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3a00/0x48868a4e43954acc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.365701:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054306176:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 25528us (27665us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.365706:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15337 00000100:00100000:2.0:1746129819.365755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.365797:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054309504 00000100:00100000:3.0:1746129819.365800:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054309504 00000100:00100000:3.0:1746129819.365822:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 10999 00000100:00100000:3.0:1746129819.365827:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31514:x1830949054309504:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.365844:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.365868:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43954b12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b68 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.365949:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.365958:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.365965:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.365975:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.365980:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.365985:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.366073:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.366084:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.366089:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.366109:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.366117:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 12 pid: 16808 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.366126:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054009856:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129819.366208:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ab400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129819.366212:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.366219:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.366227:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.366232:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1ab400/0x48868a4e43954ae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.366646:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.367062:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054306432:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 25536us (28847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.367069:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15338 00000100:00100000:0.0:1746129819.367493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.367532:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054308736 00000100:00100000:3.0:1746129819.367536:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054308736 00010000:00010000:3.0:1746129819.367556:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 13 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.367575:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7660 00000100:00100000:3.0:1746129819.367580:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054308736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.367588:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.367601:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 13 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.367610:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 13 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.367629:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a80df200/0x48868a4e43954a6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b30 expref: 13 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.367640:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.367673:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054308736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.367677:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7660 00000100:00100000:2.0:1746129819.367925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.368054:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054309248 00000100:00100000:3.0:1746129819.368058:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054309248 00010000:00010000:3.0:1746129819.368070:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 28 pid: 8435 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.368085:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7661 00000100:00100000:3.0:1746129819.368089:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054309248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.368097:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.368107:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 28 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.368115:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 28 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.368126:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948ca800/0x48868a4e43954a47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b1b expref: 28 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.368134:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.368136:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.368139:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368146:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368170:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.368186:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054309248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.368191:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7661 00010000:00010000:3.0:1746129819.368210:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368217:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.368230:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129819.368232:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368239:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368245:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368251:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80dfc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129819.368253:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368263:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368272:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368277:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a80dfc00/0x48868a4e43954afd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.368308:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054306944:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 25771us (25805us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.368314:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15342 00000100:00100000:3.0:1746129819.368325:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054309632 00000100:00100000:3.0:1746129819.368327:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054309632 00000100:00100000:3.0:1746129819.368339:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15345 00000100:00100000:3.0:1746129819.368343:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31512:x1830949054309632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.368352:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.368361:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b6f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129819.368373:0:7976:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x7e7 00010000:00010000:3.0:1746129819.368383:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.368384:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.368389:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368403:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.368411:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919eca00, rc 0) 00000100:00100000:3.0:1746129819.368429:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31512:x1830949054309632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.368433:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15345 00000100:00100000:0.0:1746129819.372263:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.372309:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054309760 00000100:00100000:2.0:1746129819.372317:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054309760 00010000:00010000:2.0:1746129819.372343:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 13 pid: 16808 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.372368:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7662 00000100:00100000:2.0:1746129819.372375:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054309760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.372386:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.372391:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 13 pid: 16808 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.372400:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 13 pid: 16808 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.372417:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.372422:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.372430:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.372436:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129819.372449:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.372481:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054309760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.372487:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7662 00010000:00010000:3.0:1746129819.372537:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbc3400/0x48868a4e43954aa9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b4c expref: 12 pid: 16808 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.372549:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054009856:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.372565:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.372571:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.372576:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129819.372588:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129819.372677:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.372684:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.372689:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.372694:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919eda00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.372697:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.372703:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129819.373141:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054307584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11306us (13412us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129819.373160:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1851 00002000:00100000:1.0:1746129819.373168:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a0094000 x1830949054307584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.373176:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094000 with x1830949054307584 ext(4194304->4931583) 00010000:00010000:1.0:1746129819.373181:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 25 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.373192:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 25 pid: 8435 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129819.373197:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0094000 00010000:00010000:3.0:1746129819.373253:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.373256:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129819.373259:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373264:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b27 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373276:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373281:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373285:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373289:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.373291:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373296:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373302:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129819.373304:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.373307:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373310:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373318:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373322:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373326:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373329:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ec400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.373331:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373335:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373340:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49200) 00010000:00010000:3.0:1746129819.373342:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.373344:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373348:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.373383:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43954b12 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b68 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.373390:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec000/0x48868a4e43954b12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b68 expref: 291 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.373397:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec000, rc 0) 00000100:00100000:3.0:1746129819.373420:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31514:x1830949054309504:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7592us (7664us total) trans 8589944991 rc 301/301 00000100:00100000:3.0:1746129819.373426:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 10999 00000100:00100000:0.0:1746129819.378339:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.378398:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310016 00000100:00100000:1.0:1746129819.378406:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310016 00002000:00100000:1.0:1746129819.378441:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a0095180 x1830949054310016/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.378450:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095180 with x1830949054310016 ext(0->1048575) 00002000:00010000:1.0:1746129819.378454:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0095180 00000100:00100000:1.0:1746129819.378472:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6849 00000100:00100000:1.0:1746129819.378479:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054310016:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.380336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.380369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.380390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.380413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.380425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.380441:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310144 00000100:00100000:0.0:1746129819.380446:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310144 00000100:00100000:0.0:1746129819.380470:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310272 00000100:00100000:0.0:1746129819.380472:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310272 00000100:00100000:0.0:1746129819.380481:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310400 00000100:00100000:0.0:1746129819.380483:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310400 00000100:00100000:0.0:1746129819.380490:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310656 00000100:00100000:0.0:1746129819.380492:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310656 00000100:00100000:0.0:1746129819.380500:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310528 00000100:00100000:0.0:1746129819.380502:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310528 00000100:00100000:0.0:1746129819.380513:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15346 00000100:00100000:0.0:1746129819.380519:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054310144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.380530:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.380544:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b76 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.380561:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380562:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380568:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.380581:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.380590:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3df800, rc 0) 00000100:00100000:0.0:1746129819.380620:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054310144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.380625:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15346 00000100:00100000:0.0:1746129819.380638:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15347 00000100:00100000:0.0:1746129819.380643:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054310272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.380649:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.380658:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b7d expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129819.380675:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x821 00010000:00010000:0.0:1746129819.380685:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380686:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380690:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 29 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.380699:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 29 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.380706:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3df200, rc 0) 00000100:00100000:0.0:1746129819.380720:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054310272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.380724:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15347 00000100:00100000:0.0:1746129819.380734:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15348 00000100:00100000:0.0:1746129819.380739:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054310400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.380743:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.380749:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b84 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129819.380759:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x821 00010000:00010000:0.0:1746129819.380766:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380767:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380771:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 29 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.380779:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 29 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.380784:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3de600, rc 0) 00000100:00100000:0.0:1746129819.380797:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054310400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 58us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.380804:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15348 00000100:00100000:0.0:1746129819.380812:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15349 00000100:00100000:0.0:1746129819.380816:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054310656:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.380821:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.380826:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c3dec00/0x48868a4e43954b51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b92 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.380836:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129819.380838:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15350 00010000:00010000:0.0:1746129819.380843:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c3dec00/0x48868a4e43954b51 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b92 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129819.380868:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054310528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.380873:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3dec00/0x48868a4e43954b51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b92 expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.380876:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.380881:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3dec00, rc 0) 00010000:00010000:2.0:1746129819.380884:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b8b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.380895:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054310656:12345-192.168.204.31@tcp:101:cat.0 Request processed in 78us (481us total) trans 0 rc 301/301 00002000:00010000:2.0:1746129819.380897:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x821 00000100:00100000:0.0:1746129819.380899:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15349 00010000:00010000:2.0:1746129819.380906:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.380908:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.380912:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.380921:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129819.380925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129819.380928:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0a00, rc 0) 00000100:00100000:0.0:1746129819.380939:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310784 00000100:00100000:0.0:1746129819.380941:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310784 00000100:00100000:2.0:1746129819.380945:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054310528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 100us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.380950:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15350 00000100:00100000:0.0:1746129819.380954:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15351 00000100:00100000:0.0:1746129819.380958:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054310784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.380963:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.380970:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355b99 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129819.380984:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x1029 00010000:00010000:0.0:1746129819.380992:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380993:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.380997:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 30 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.381005:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 30 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.381012:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3dfa00, rc 0) 00000100:00100000:0.0:1746129819.381025:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054310784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 66us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.381029:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15351 00000100:00100000:0.0:1746129819.381118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.381134:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054310912 00000100:00100000:3.0:1746129819.381138:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054310912 00010000:00010000:3.0:1746129819.381163:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.381180:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7663 00000100:00100000:3.0:1746129819.381186:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054310912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.381194:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.381203:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.381212:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.381223:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0c00/0x48868a4e43954a40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b14 expref: 27 pid: 8435 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.381231:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.381232:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.381235:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.381244:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.381259:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.381276:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054310912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 91us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.381280:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7663 00010000:00010000:2.0:1746129819.381347:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381354:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381370:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381379:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381385:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381389:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbc3800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129819.381392:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381398:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381405:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.381409:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc3800/0x48868a4e43954af6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.381439:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054306816:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 39112us (39982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.381445:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15341 00000100:00100000:0.0:1746129819.385521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.385600:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054311168 00000100:00100000:3.0:1746129819.385608:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054311168 00000100:00100000:3.0:1746129819.385658:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11000 00000100:00100000:3.0:1746129819.385665:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31509:x1830949054311168:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:3.0:1746129819.385708:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.385730:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67400/0x48868a4e4395488e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a18 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.385748:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.385753:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.385807:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31509:x1830949054311168:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 142us (300us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746129819.385814:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11000 00000100:00100000:0.0:1746129819.387917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.389225:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054311296 00000100:00100000:2.0:1746129819.389234:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054311296 00000100:00100000:2.0:1746129819.390240:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15352 00000100:00100000:2.0:1746129819.390249:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31507:x1830949054311296:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129819.390256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129819.390264:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.390279:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ba0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129819.390299:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x15e5 00000100:00100000:1.0:1746129819.390303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129819.390315:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.390317:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.390323:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.390336:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.390345:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0400, rc 0) 00000100:00100000:2.0:1746129819.390376:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31507:x1830949054311296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 128us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.390381:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15352 00000100:00100000:1.0:1746129819.390613:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054310016:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12132us (12278us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.390620:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6849 00002000:00100000:1.0:1746129819.390629:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a0095180 x1830949054310016/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.390637:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095180 with x1830949054310016 ext(0->1048575) 00002000:00010000:1.0:1746129819.390642:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0095180 00000100:00100000:0.0:1746129819.390797:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054311552 00000100:00100000:0.0:1746129819.390801:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054311552 00000100:00100000:3.0:1746129819.390820:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054311808 00000100:00100000:0.0:1746129819.390822:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4585 00000100:00100000:3.0:1746129819.390823:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054311808 00000100:00100000:0.0:1746129819.390827:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31509:x1830949054311552:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129819.390841:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11001 00000100:00100000:3.0:1746129819.390845:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31516:x1830949054311808:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.390865:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.390875:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ba7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.390932:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.390941:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.390949:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.390959:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129819.390959:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31509:x1830949054311552:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 132us (656us total) trans 8589944992 rc 0/0 00010000:00010000:3.0:1746129819.390964:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129819.390965:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4585 00010000:00010000:3.0:1746129819.390969:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391049:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43954b82 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391056:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43954b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391062:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43954b82 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129819.391068:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129819.391112:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391118:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391124:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391128:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.391131:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391137:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391145:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129819.391158:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.391161:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391166:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954b74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391174:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391178:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391183:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391187:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919eda00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.391189:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391193:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391202:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49200) 00010000:00010000:3.0:1746129819.391204:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.391261:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391266:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919eda00/0x48868a4e43954b7b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.391292:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec400/0x48868a4e43954b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba7 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.391300:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43954b82 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba7 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.391305:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.391306:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129819.391308:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:3.0:1746129819.391377:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31516:x1830949054311808:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 530us (1119us total) trans 8589944993 rc 0/0 00000100:00100000:3.0:1746129819.391382:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11001 00000100:00100000:0.0:1746129819.398567:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.398616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.398676:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054312320 00000100:00100000:2.0:1746129819.398684:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054312320 00000100:00100000:1.0:1746129819.398687:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054312064 00000100:00100000:1.0:1746129819.398689:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054312064 00000100:00100000:2.0:1746129819.398718:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4586 00002000:00100000:1.0:1746129819.398719:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff8800a0097800 x1830949054312064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129819.398724:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31509:x1830949054312320:12345-192.168.204.31@tcp:35:mirror_io.0 00002000:00100000:1.0:1746129819.398727:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097800 with x1830949054312064 ext(4927488->4931583) 00002000:00010000:1.0:1746129819.398731:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097800 00000100:00100000:1.0:1746129819.398757:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6850 00000100:00100000:1.0:1746129819.398762:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054312064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129819.398911:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054312064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 143us (346us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129819.398918:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6850 00002000:00100000:1.0:1746129819.398922:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff8800a0097800 x1830949054312064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.398929:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097800 with x1830949054312064 ext(4927488->4931583) 00002000:00010000:1.0:1746129819.398932:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097800 00000100:00100000:2.0:1746129819.399512:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31509:x1830949054312320:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 786us (893us total) trans 8589944994 rc 0/0 00000100:00100000:2.0:1746129819.399519:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4586 00000100:00100000:0.0:1746129819.399929:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.400509:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054312576 00000100:00100000:2.0:1746129819.400514:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054312576 00000100:00100000:2.0:1746129819.400579:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 727 00000100:00100000:2.0:1746129819.400584:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054312576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.400595:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.400613:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ece00/0x48868a4e43954b82 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba7 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.400624:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.400627:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.400657:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054312576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.400662:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 727 00000100:00100000:0.0:1746129819.401873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.401967:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054312448 00000100:00100000:2.0:1746129819.401971:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054312448 00000100:00100000:2.0:1746129819.401992:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15353 00000100:00100000:2.0:1746129819.401997:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31512:x1830949054312448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.402007:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.402018:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bae expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.402033:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.402035:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.402040:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.402051:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.402058:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0000, rc 0) 00000100:00100000:2.0:1746129819.402265:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31512:x1830949054312448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 267us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.402270:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15353 00000100:00100000:0.0:1746129819.407202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.407245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.407296:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054312832 00000100:00100000:1.0:1746129819.407304:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054312832 00000100:00100000:1.0:1746129819.407335:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4587 00000100:00100000:1.0:1746129819.407341:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31507:x1830949054312832:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129819.407495:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31507:x1830949054312832:12345-192.168.204.31@tcp:35:cat.0 Request processed in 154us (299us total) trans 8589944995 rc 0/0 00000100:00100000:1.0:1746129819.407501:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4587 00000100:00100000:1.0:1746129819.407518:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054313088 00000100:00100000:1.0:1746129819.407520:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054313088 00002000:00100000:1.0:1746129819.407538:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8801305bf480 x1830949054313088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.407547:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bf480 with x1830949054313088 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.407552:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bf480 00000100:00100000:1.0:1746129819.407563:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6851 00000100:00100000:1.0:1746129819.407568:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054313088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129819.420220:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054313088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12643us (12964us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.420231:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6851 00002000:00100000:1.0:1746129819.420241:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8801305bf480 x1830949054313088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.420250:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bf480 with x1830949054313088 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.420255:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bf480 00000100:00100000:0.0:1746129819.426038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.426107:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054313216 00000100:00100000:2.0:1746129819.426114:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054313216 00000100:00100000:2.0:1746129819.428240:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15354 00000100:00100000:2.0:1746129819.428252:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31512:x1830949054313216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.428267:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.428284:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bb5 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.428304:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.428306:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.428312:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.428325:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.428334:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b8e8000, rc 0) 00000100:00100000:2.0:1746129819.428392:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31512:x1830949054313216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 144us (2359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.428398:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15354 00000100:00100000:0.0:1746129819.436746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.436803:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054313472 00000100:00100000:1.0:1746129819.436812:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054313472 00002000:00100000:1.0:1746129819.436876:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8801305bed80 x1830949054313472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.436885:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bed80 with x1830949054313472 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.436890:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bed80 00000100:00100000:1.0:1746129819.436913:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6852 00000100:00100000:1.0:1746129819.436919:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054313472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129819.446172:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054313472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8359us (8539us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.446186:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6852 00002000:00100000:1.0:1746129819.446200:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8801305bed80 x1830949054313472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.446209:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bed80 with x1830949054313472 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.446215:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bed80 00000100:00100000:0.0:1746129819.454442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.454601:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054313600 00000100:00100000:1.0:1746129819.454609:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054313600 00000100:00100000:1.0:1746129819.454995:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15355 00000100:00100000:1.0:1746129819.455006:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31512:x1830949054313600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.455024:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.455041:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bbc expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.455065:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.455068:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.455075:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.455088:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.455098:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff98000, rc 0) 00000100:00100000:1.0:1746129819.455159:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31512:x1830949054313600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 142us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.455166:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15355 00000100:00100000:0.0:1746129819.462614:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.462756:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054313856 00000100:00100000:1.0:1746129819.462766:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054313856 00002000:00100000:1.0:1746129819.462811:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8801305bdc00 x1830949054313856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.462821:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bdc00 with x1830949054313856 ext(1048576->2097151) 00002000:00010000:1.0:1746129819.462826:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bdc00 00000100:00100000:3.0:1746129819.465187:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6853 00000100:00100000:3.0:1746129819.465201:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054313856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.475496:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054313856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10291us (12883us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.475505:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6853 00002000:00100000:3.0:1746129819.475515:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8801305bdc00 x1830949054313856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.475530:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bdc00 with x1830949054313856 ext(1048576->2097151) 00002000:00010000:3.0:1746129819.475535:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bdc00 00000100:00100000:0.0:1746129819.492073:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.492137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.492279:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054313984 00000100:00100000:1.0:1746129819.492286:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054313984 00000100:00100000:1.0:1746129819.492330:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054314112 00000100:00100000:1.0:1746129819.492333:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054314112 00000100:00100000:1.0:1746129819.492349:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15356 00000100:00100000:1.0:1746129819.492356:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054313984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.492370:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129819.492372:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15357 00000100:00100000:3.0:1746129819.492380:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054314112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.492383:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bc3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.492388:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.492396:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bca expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.492400:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.492402:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.492408:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.492409:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.492409:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.492414:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.492422:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.492424:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.492431:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec000, rc 0) 00010000:00010000:1.0:1746129819.492431:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6e000, rc 0) 00000100:00100000:3.0:1746129819.492476:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054314112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.492482:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15357 00000100:00100000:1.0:1746129819.492533:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054313984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 177us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.492539:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15356 00000100:00100000:0.0:1746129819.511198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.511240:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.511266:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.511338:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.511377:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054314624 00000100:00100000:0.0:1746129819.511384:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054314624 00002000:00100000:0.0:1746129819.511419:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faa0000 x1830949054314624/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.511428:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0000 with x1830949054314624 ext(3145728->4194303) 00002000:00010000:0.0:1746129819.511432:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0000 00000100:00100000:0.0:1746129819.511446:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054314368 00000100:00100000:0.0:1746129819.511449:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054314368 00002000:00100000:0.0:1746129819.511458:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faa0380 x1830949054314368/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.511465:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0380 with x1830949054314368 ext(2097152->3145727) 00002000:00010000:0.0:1746129819.511467:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0380 00000100:00100000:0.0:1746129819.511476:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054314752 00000100:00100000:0.0:1746129819.511478:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054314752 00002000:00100000:0.0:1746129819.511487:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009faa0700 x1830949054314752/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.511493:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0700 with x1830949054314752 ext(2097152->3145727) 00002000:00010000:0.0:1746129819.511496:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa0700 00000100:00100000:0.0:1746129819.511504:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054315136 00000100:00100000:0.0:1746129819.511506:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054315136 00002000:00100000:0.0:1746129819.511513:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faa0a80 x1830949054315136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.511519:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0a80 with x1830949054315136 ext(3145728->4194303) 00002000:00010000:0.0:1746129819.511521:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa0a80 00000100:00100000:3.0:1746129819.511530:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6854 00000100:00100000:3.0:1746129819.511539:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054314624:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.511543:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6855 00000100:00100000:0.0:1746129819.511549:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054314368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.511591:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6856 00000100:00100000:0.0:1746129819.511595:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054314752:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129819.515220:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6857 00000100:00100000:1.0:1746129819.515234:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054315136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.529864:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054314368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18289us (18597us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.529875:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6855 00002000:00100000:2.0:1746129819.529885:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faa0380 x1830949054314368/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.529894:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0380 with x1830949054314368 ext(2097152->3145727) 00002000:00010000:2.0:1746129819.529900:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0380 00000100:00100000:1.0:1746129819.530447:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054314752:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18850us (19178us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.530454:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6856 00002000:00100000:1.0:1746129819.530459:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009faa0700 x1830949054314752/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.530466:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0700 with x1830949054314752 ext(2097152->3145727) 00002000:00010000:1.0:1746129819.530469:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa0700 00000100:00100000:0.0:1746129819.540299:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.540382:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054315264 00000100:00100000:1.0:1746129819.540392:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054315264 00000100:00100000:1.0:1746129819.540448:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15358 00000100:00100000:1.0:1746129819.540457:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31514:x1830949054315264:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129819.540474:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.540490:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bd1 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.540522:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.540531:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.540537:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.540539:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.540543:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1589248->2097151] (req 1589248->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.540547:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054315136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25317us (29208us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129819.540555:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6857 00002000:00100000:0.0:1746129819.540563:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faa0a80 x1830949054315136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.540572:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0a80 with x1830949054315136 ext(3145728->4194303) 00002000:00010000:0.0:1746129819.540577:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa0a80 00010000:00010000:1.0:1746129819.540579:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 18 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.540592:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.540604:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054009984:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129819.540709:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.540719:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746129819.540727:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010112:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.540755:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.540798:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054314624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29254us (29604us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.540811:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6854 00002000:00100000:3.0:1746129819.540821:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faa0000 x1830949054314624/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.540829:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0000 with x1830949054314624 ext(3145728->4194303) 00002000:00010000:3.0:1746129819.540835:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0000 00000100:00100000:2.0:1746129819.545016:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.545070:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054009984:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.545085:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010112:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.545109:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129819.545117:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1589248->2097151] (req 1589248->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.545136:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054315392 00010000:00010000:1.0:1746129819.545137:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6e600, rc 0) 00000100:00100000:2.0:1746129819.545142:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054315392 00010000:00010000:2.0:1746129819.545182:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 18 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.545203:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054315520 00000100:00100000:2.0:1746129819.545205:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054315520 00010000:00010000:2.0:1746129819.545214:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 32 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746129819.545226:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31514:x1830949054315264:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4768us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.545227:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7664 00000100:00100000:2.0:1746129819.545234:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054315392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129819.545237:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15358 00010000:00010000:2.0:1746129819.545244:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.545263:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 18 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.545272:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 18 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.545288:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7665 00000100:00100000:1.0:1746129819.545296:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054315520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.545306:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.545398:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43954b90 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bae expref: 18 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.545401:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746129819.545412:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.545418:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129819.545426:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3df200/0x48868a4e43954b43 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b7d expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.545436:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054315392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 202us (428us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129819.545439:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129819.545441:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7664 00010000:00010000:1.0:1746129819.545441:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.545447:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.545455:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.545481:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.545493:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054010240:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.545561:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.547135:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.547385:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.547457:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054315904 00000100:00100000:3.0:1746129819.547470:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054315904 00000100:00100000:1.0:1746129819.547516:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054315648 00002000:00100000:3.0:1746129819.547517:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1589248->1593343) req@ffff88009faa1500 x1830949054315904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129819.547523:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054315648 00002000:00100000:3.0:1746129819.547528:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1500 with x1830949054315904 ext(1589248->1593343) 00002000:00010000:3.0:1746129819.547534:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa1500 00000100:00100000:3.0:1746129819.547568:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6858 00000100:00100000:1.0:1746129819.547574:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15359 00000100:00100000:3.0:1746129819.547575:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054315904:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129819.547583:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054315648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.547599:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.547613:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb6fe00/0x48868a4e43954bba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bd8 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.547657:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010368:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129819.547731:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.547826:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054315904:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 250us (441us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129819.547833:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6858 00002000:00100000:3.0:1746129819.547838:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1589248->1593343) req@ffff88009faa1500 x1830949054315904/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.547879:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1500 with x1830949054315904 ext(1589248->1593343) 00002000:00010000:3.0:1746129819.547882:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa1500 00000100:00100000:2.0:1746129819.548255:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054010240:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129819.548271:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.549655:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054315520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4354us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.549665:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7665 00002000:00010000:1.0:1746129819.552784:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129819 -> 1746129820 00002000:00010000:1.0:1746129819.552793:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129819 -> 1746129820 00002000:00010000:1.0:1746129819.552795:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129819 -> 1746129820 00000100:00100000:1.0:1746129819.552824:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010368:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129819.552894:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6fe00/0x48868a4e43954bba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd8 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.552910:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6fe00/0x48868a4e43954bba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd8 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.552922:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6fe00, rc 0) 00000100:00100000:1.0:1746129819.552982:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054315648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5400us (5850us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129819.552991:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15359 00000100:00100000:0.0:1746129819.556264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.556351:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054316032 00000100:00100000:1.0:1746129819.556359:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054316032 00000100:00100000:1.0:1746129819.556409:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15360 00000100:00100000:1.0:1746129819.556416:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31514:x1830949054316032:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129819.556430:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.556443:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bdf expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.556467:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.556475:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.556481:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.556483:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.556486:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.556510:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.556520:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 16 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.556530:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010496:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129819.556611:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.556623:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746129819.556630:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010624:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.556646:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.557306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.557373:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054316288 00000100:00100000:2.0:1746129819.557376:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054316288 00002000:00100000:2.0:1746129819.557401:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa1c00 x1830949054316288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.557410:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1c00 with x1830949054316288 ext(4194304->4931583) 00002000:00010000:2.0:1746129819.557414:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1c00 00000100:00100000:2.0:1746129819.557437:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6859 00000100:00100000:2.0:1746129819.557443:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054316288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.559067:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010496:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.559402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.559497:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054316416 00000100:00100000:2.0:1746129819.559501:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054316416 00010000:00010000:2.0:1746129819.559523:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.559543:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7666 00000100:00100000:2.0:1746129819.559548:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054316416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.559557:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.559573:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.559582:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.559600:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b8e8000/0x48868a4e43954b97 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bb5 expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.559622:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.559642:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054316416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.559648:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7666 00000100:00100000:3.0:1746129819.559715:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054010624:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.559734:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->1531903] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.559748:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6e400, rc 0) 00000100:00100000:3.0:1746129819.559771:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31514:x1830949054316032:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3357us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.559777:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15360 00000100:00100000:0.0:1746129819.560352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.560423:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054316544 00000100:00100000:2.0:1746129819.560426:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054316544 00010000:00010000:2.0:1746129819.560438:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.560723:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7667 00000100:00100000:2.0:1746129819.560729:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054316544:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.560736:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.560744:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.560758:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.560769:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3de600/0x48868a4e43954b4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b84 expref: 31 pid: 3624 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.560777:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.560779:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.560784:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.560791:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.560812:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.560821:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054010752:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129819.560996:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.562232:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054316288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 4786us (4924us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129819.562239:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6859 00002000:00100000:2.0:1746129819.562246:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa1c00 x1830949054316288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.562254:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1c00 with x1830949054316288 ext(4194304->4931583) 00002000:00010000:2.0:1746129819.562258:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1c00 00000100:00100000:2.0:1746129819.562477:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054010752:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129819.562488:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.562535:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054316544:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1807us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.562540:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7667 00000100:00100000:0.0:1746129819.564314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.564354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.564472:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054316672 00000100:00100000:2.0:1746129819.564477:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054316800 00000100:00100000:3.0:1746129819.564478:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054316672 00000100:00100000:2.0:1746129819.564481:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054316800 00000100:00100000:2.0:1746129819.564505:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15361 00000100:00100000:2.0:1746129819.564511:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054316800:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129819.564512:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15362 00000100:00100000:3.0:1746129819.564515:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054316672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.564528:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.564533:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.564539:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43fe00/0x48868a4e43954bcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355be6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.564540:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3df600/0x48868a4e43954bc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bed expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.564570:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054011008:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.564571:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054010880:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129819.564948:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.565047:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.565825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.565928:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054317056 00000100:00100000:2.0:1746129819.565931:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054317056 00002000:00100000:2.0:1746129819.565960:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff88009faa2d80 x1830949054317056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.565969:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2d80 with x1830949054317056 ext(1527808->1531903) 00002000:00010000:2.0:1746129819.565973:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa2d80 00000100:00100000:2.0:1746129819.565998:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6860 00000100:00100000:2.0:1746129819.566003:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054317056:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129819.566218:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054011008:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129819.566239:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43fe00/0x48868a4e43954bcf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355be6 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.566250:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43fe00/0x48868a4e43954bcf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355be6 expref: 19 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.566272:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43fe00, rc 0) 00000100:00100000:3.0:1746129819.566303:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054316672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1786us (1993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.566316:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15362 00002000:00010000:2.0:1746129819.566335:0:10930:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129819 -> 1746129820 00002000:00010000:2.0:1746129819.566339:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129819 -> 1746129820 00002000:00010000:2.0:1746129819.566341:0:10930:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129819 -> 1746129820 00000100:00100000:2.0:1746129819.566348:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054010880:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.566361:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3df600/0x48868a4e43954bc8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bed expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.566369:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3df600/0x48868a4e43954bc8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bed expref: 17 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.566377:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3df600, rc 0) 00000100:00100000:2.0:1746129819.566394:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054316800:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1883us (2039us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.566399:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15361 00000100:00100000:2.0:1746129819.566475:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054317056:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 471us (649us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129819.566481:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6860 00002000:00100000:2.0:1746129819.566486:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1527808->1531903) req@ffff88009faa2d80 x1830949054317056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.566493:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2d80 with x1830949054317056 ext(1527808->1531903) 00002000:00010000:2.0:1746129819.566495:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa2d80 00000100:00100000:0.0:1746129819.570426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.570462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.570520:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054317312 00000100:00100000:2.0:1746129819.570526:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054317312 00000100:00100000:2.0:1746129819.570554:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15363 00000100:00100000:2.0:1746129819.570560:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054317312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.570571:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.570583:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3de800/0x48868a4e43954bd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bfb expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.570630:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054011136:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129819.570664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.570691:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.570701:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054317568 00000100:00100000:2.0:1746129819.570703:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054317184 00000100:00100000:3.0:1746129819.570705:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054317568 00000100:00100000:2.0:1746129819.570706:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054317184 00000100:00100000:2.0:1746129819.570720:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15364 00000100:00100000:2.0:1746129819.570724:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054317184:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129819.570727:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4588 00010000:00010000:2.0:1746129819.570730:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129819.570732:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31514:x1830949054317568:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:2.0:1746129819.570736:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3dee00/0x48868a4e43954bdd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355bf4 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.570756:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054011264:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.570775:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.571615:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31514:x1830949054317568:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 880us (1150us total) trans 8589944996 rc 0/0 00000100:00100000:3.0:1746129819.571622:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4588 00000100:00100000:3.0:1746129819.575838:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054011264:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.575839:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054011136:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129819.575884:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3dee00/0x48868a4e43954bdd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bf4 expref: 19 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.575884:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3de800/0x48868a4e43954bd6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bfb expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.575896:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3dee00/0x48868a4e43954bdd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bf4 expref: 19 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.575896:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3de800/0x48868a4e43954bd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bfb expref: 19 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.575912:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3dee00, rc 0) 00010000:00010000:2.0:1746129819.575912:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3de800, rc 0) 00000100:00100000:2.0:1746129819.576274:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054317312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5711us (5852us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.576282:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15363 00000100:00100000:3.0:1746129819.576425:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054317184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5698us (5759us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.576431:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15364 00000100:00100000:0.0:1746129819.580012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.580940:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054317824 00000100:00100000:3.0:1746129819.580948:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054317824 00000100:00100000:3.0:1746129819.580995:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4589 00000100:00100000:3.0:1746129819.581002:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c560450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31512:x1830949054317824:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129819.581189:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c560450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31512:x1830949054317824:12345-192.168.204.31@tcp:35:cat.0 Request processed in 186us (1182us total) trans 8589944997 rc 0/0 00000100:00100000:3.0:1746129819.581196:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4589 00000100:00100000:0.0:1746129819.599677:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.599748:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054317952 00000100:00100000:3.0:1746129819.599755:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054317952 00000100:00100000:3.0:1746129819.599806:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15365 00000100:00100000:3.0:1746129819.599813:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31516:x1830949054317952:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.599828:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.599844:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c02 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.599904:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 26 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.599911:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.599917:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.599919:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.599922:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3850240->4194303] (req 3850240->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 22 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.599945:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.599955:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.599966:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054011392:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.600048:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 26 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.600056:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 26 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.600063:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054011520:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.600079:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.602791:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054011392:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.603115:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054011520:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.603137:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129819.603142:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3850240->4194303] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 22 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.603168:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f400, rc 0) 00000100:00100000:2.0:1746129819.603203:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054318080 00000100:00100000:2.0:1746129819.603210:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054318080 00000100:00100000:3.0:1746129819.603213:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31516:x1830949054317952:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3400us (3542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.603221:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15365 00010000:00010000:2.0:1746129819.603233:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 27 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.603268:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7668 00000100:00100000:2.0:1746129819.603274:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054318080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.603285:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.603303:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 27 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.603311:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 27 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.603328:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43954b66 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ba0 expref: 27 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.603345:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.603362:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054318080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.603367:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7668 00000100:00100000:0.0:1746129819.604040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.604175:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054318208 00000100:00100000:2.0:1746129819.604179:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054318208 00010000:00010000:2.0:1746129819.604193:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 865 lvb_type: 1 00000100:00100000:2.0:1746129819.604222:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7669 00000100:00100000:2.0:1746129819.604228:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054318208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.604235:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.604244:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.604253:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.604265:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954ba5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bc3 expref: 22 pid: 4589 timeout: 865 lvb_type: 1 00010000:00010000:2.0:1746129819.604275:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.604276:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.604281:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.604289:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.604312:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.604323:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054011648:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129819.604381:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.605643:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054011648:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129819.605658:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.605690:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054318208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1461us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.605697:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7669 00000100:00100000:0.0:1746129819.606370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.606513:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054318464 00000100:00100000:2.0:1746129819.606518:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054318464 00002000:00100000:2.0:1746129819.606542:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3850240->3854335) req@ffff88009faa1f80 x1830949054318464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.606551:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1f80 with x1830949054318464 ext(3850240->3854335) 00002000:00010000:2.0:1746129819.606556:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1f80 00000100:00100000:2.0:1746129819.606582:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6861 00000100:00100000:2.0:1746129819.606589:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054318464:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129819.606702:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054318464:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 114us (334us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129819.606706:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6861 00002000:00100000:2.0:1746129819.606710:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3850240->3854335) req@ffff88009faa1f80 x1830949054318464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.606714:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1f80 with x1830949054318464 ext(3850240->3854335) 00002000:00010000:2.0:1746129819.606716:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1f80 00000100:00100000:0.0:1746129819.609762:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.609933:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054318592 00000100:00100000:3.0:1746129819.609939:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054318592 00000100:00100000:3.0:1746129819.610013:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15366 00000100:00100000:3.0:1746129819.610020:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31516:x1830949054318592:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.610032:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.610046:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c09 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.610073:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 29 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.610081:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.610086:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.610088:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.610091:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->3842047] (req 3145728->3842047) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.610114:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.610124:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.610135:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054011776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.610592:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 29 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.610600:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 29 pid: 3623 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.610608:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054011904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.610628:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.611807:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054011776:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.611817:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054011904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.611837:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->3842047] (req 3145728->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 17 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.611873:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43ee00, rc 0) 00000100:00100000:3.0:1746129819.611901:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31516:x1830949054318592:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1880us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.611907:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15366 00000100:00100000:2.0:1746129819.612159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.612281:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054318720 00000100:00100000:3.0:1746129819.612285:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054318720 00010000:00010000:3.0:1746129819.612301:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 30 pid: 3623 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746129819.612329:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7670 00000100:00100000:3.0:1746129819.612335:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054318720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.612343:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.612359:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 30 pid: 3623 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.612367:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 30 pid: 3623 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.612382:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954b5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b99 expref: 30 pid: 3623 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746129819.612395:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.612413:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054318720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.612418:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7670 00000100:00100000:0.0:1746129819.614633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.614780:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054318848 00000100:00100000:1.0:1746129819.614785:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054318848 00010000:00010000:1.0:1746129819.614807:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746129819.614839:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7671 00000100:00100000:1.0:1746129819.614874:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054318848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.614885:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.614903:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746129819.614913:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746129819.614928:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919ec000/0x48868a4e43954bac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bca expref: 17 pid: 8435 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746129819.614941:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.614943:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.614948:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.614955:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.614981:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.614993:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054012032:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.615052:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.617752:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054012032:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.617768:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.617799:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054318848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2926us (3170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.617807:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7671 00000100:00100000:0.0:1746129819.623037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.623216:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054319104 00000100:00100000:2.0:1746129819.623224:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054319104 00002000:00100000:2.0:1746129819.623263:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->3842047) req@ffff880135e54000 x1830949054319104/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.623271:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e54000 with x1830949054319104 ext(3837952->3842047) 00002000:00010000:2.0:1746129819.623275:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e54000 00000100:00100000:2.0:1746129819.623308:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6862 00000100:00100000:2.0:1746129819.623315:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054319104:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129819.623459:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054319104:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 144us (429us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129819.623465:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6862 00002000:00100000:2.0:1746129819.623470:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3837952->3842047) req@ffff880135e54000 x1830949054319104/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.623476:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e54000 with x1830949054319104 ext(3837952->3842047) 00002000:00010000:2.0:1746129819.623479:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e54000 00000100:00100000:0.0:1746129819.631928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.631981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.631990:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054319360 00000100:00100000:3.0:1746129819.631997:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054319360 00000100:00100000:3.0:1746129819.632036:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4590 00000100:00100000:3.0:1746129819.632043:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31516:x1830949054319360:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129819.632792:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31516:x1830949054319360:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 748us (870us total) trans 8589944998 rc 0/0 00000100:00100000:3.0:1746129819.632797:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4590 00000100:00100000:3.0:1746129819.632816:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054319616 00000100:00100000:3.0:1746129819.632818:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054319616 00000100:00100000:3.0:1746129819.632832:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11002 00000100:00100000:3.0:1746129819.632835:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31523:x1830949054319616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.632843:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.632868:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f000/0x48868a4e43954bf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c10 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.632933:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.632941:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633178:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633194:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633200:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633205:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633274:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633280:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633283:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129819.633288:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129819.633319:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633325:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633330:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633335:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b43ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.633337:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633343:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633353:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129819.633356:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.633358:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633363:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ea00/0x48868a4e43954bf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633372:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633376:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633380:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633384:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b43ec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.633386:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633391:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633396:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49f00) 00010000:00010000:3.0:1746129819.633398:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.633400:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633404:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43ec00/0x48868a4e43954c00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.633429:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f000/0x48868a4e43954bf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 295 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.633440:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 294 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.633445:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.633447:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129819.633449:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f200, rc 0) 00000100:00100000:3.0:1746129819.633577:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31523:x1830949054319616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 739us (1594us total) trans 8589944999 rc 0/0 00000100:00100000:3.0:1746129819.633583:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11002 00000100:00100000:0.0:1746129819.637805:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.637885:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.637933:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054319744 00000100:00100000:1.0:1746129819.637941:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054319744 00000100:00100000:1.0:1746129819.637972:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054319872 00000100:00100000:1.0:1746129819.637975:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054319872 00000100:00100000:1.0:1746129819.638545:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15367 00000100:00100000:1.0:1746129819.638577:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15368 00000100:00100000:1.0:1746129819.638583:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054319872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.638598:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.638611:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb6fe00/0x48868a4e43954c15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c1e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.638653:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054012160:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129819.638725:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.638737:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054319744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.638743:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.638752:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f600/0x48868a4e43954c1c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c17 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.638773:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054012288:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129819.638789:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce780 going to sleep for 11 seconds 00002000:00010000:2.0:1746129819.645376:0:10930:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime: 1746129819 -> 1746129820 00002000:00010000:2.0:1746129819.645382:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129819 -> 1746129820 00002000:00010000:2.0:1746129819.645384:0:10930:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime: 1746129819 -> 1746129820 00000100:00100000:2.0:1746129819.645410:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054012288:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.645450:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f600/0x48868a4e43954c1c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c17 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.645463:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f600/0x48868a4e43954c1c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c17 expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.645484:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6f600, rc 0) 00000100:00100000:2.0:1746129819.645535:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054319744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6973us (7726us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.645542:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15367 00002000:00010000:1.0:1746129819.645652:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129819 -> 1746129820 00002000:00010000:1.0:1746129819.645655:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129819 -> 1746129820 00002000:00010000:1.0:1746129819.645656:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129819 -> 1746129820 00000100:00100000:1.0:1746129819.645676:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054012160:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129819.645697:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6fe00/0x48868a4e43954c15 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c1e expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.645705:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6fe00/0x48868a4e43954c15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c1e expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.645724:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6fe00, rc 0) 00000100:00100000:1.0:1746129819.645747:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054319872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7165us (7862us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129819.645751:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15368 00000100:00100000:0.0:1746129819.654903:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.654937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.654955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.654986:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.655046:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054320256 00000100:00100000:2.0:1746129819.655054:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054320256 00002000:00100000:2.0:1746129819.655092:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880135e54e00 x1830949054320256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.655102:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e54e00 with x1830949054320256 ext(0->1048575) 00002000:00010000:2.0:1746129819.655107:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e54e00 00000100:00100000:2.0:1746129819.655121:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054320384 00000100:00100000:2.0:1746129819.655124:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054320384 00002000:00100000:2.0:1746129819.655134:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880135e55180 x1830949054320384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.655140:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e55180 with x1830949054320384 ext(1048576->2097151) 00002000:00010000:2.0:1746129819.655155:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e55180 00000100:00100000:2.0:1746129819.655164:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054320768 00000100:00100000:2.0:1746129819.655166:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054320768 00002000:00100000:2.0:1746129819.655177:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1531904->2097151) req@ffff880135e55500 x1830949054320768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.655183:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e55500 with x1830949054320768 ext(1531904->2097151) 00002000:00010000:2.0:1746129819.655186:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e55500 00000100:00100000:2.0:1746129819.655193:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054320640 00000100:00100000:2.0:1746129819.655195:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054320640 00002000:00100000:2.0:1746129819.655202:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1589247) req@ffff880135e55880 x1830949054320640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.655208:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e55880 with x1830949054320640 ext(1048576->1589247) 00002000:00010000:2.0:1746129819.655211:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e55880 00000100:00100000:2.0:1746129819.655220:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6863 00000100:00100000:2.0:1746129819.655225:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054320256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.655358:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6864 00000100:00100000:3.0:1746129819.655366:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054320384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.655434:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6865 00000100:00100000:2.0:1746129819.655440:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054320768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.655478:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6866 00000100:00100000:3.0:1746129819.655483:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054320640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.667559:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054320640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12068us (12565us total) trans 0 rc 540672/540672 00000100:00100000:2.0:1746129819.667559:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054320768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12116us (12599us total) trans 0 rc 565248/565248 00000100:00100000:3.0:1746129819.667568:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6866 00000100:00100000:2.0:1746129819.667571:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6865 00002000:00100000:3.0:1746129819.667579:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1589247) req@ffff880135e55880 x1830949054320640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.667587:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e55880 with x1830949054320640 ext(1048576->1589247) 00002000:00010000:3.0:1746129819.667592:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e55880 00002000:00100000:2.0:1746129819.667801:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1531904->2097151) req@ffff880135e55500 x1830949054320768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 565248/565248 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.667808:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e55500 with x1830949054320768 ext(1531904->2097151) 00002000:00010000:2.0:1746129819.667811:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135e55500 00000100:00100000:3.0:1746129819.671940:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054320384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16567us (16993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.671951:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6864 00002000:00100000:3.0:1746129819.671961:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880135e55180 x1830949054320384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.671970:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e55180 with x1830949054320384 ext(1048576->2097151) 00002000:00010000:3.0:1746129819.671976:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e55180 00000100:00100000:2.0:1746129819.672457:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054320256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17230us (17559us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.672464:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6863 00002000:00100000:2.0:1746129819.672469:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880135e54e00 x1830949054320256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.672476:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e54e00 with x1830949054320256 ext(0->1048575) 00002000:00010000:2.0:1746129819.672479:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e54e00 00000100:00100000:0.0:1746129819.687907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.687947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.688029:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321152 00000100:00100000:1.0:1746129819.688030:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321024 00000100:00100000:2.0:1746129819.688037:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321152 00000100:00100000:1.0:1746129819.688037:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321024 00000100:00100000:1.0:1746129819.688088:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15369 00000100:00100000:1.0:1746129819.688094:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054321024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.688109:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.688123:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954c23 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c25 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.688173:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054012416:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129819.688236:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.688342:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15370 00000100:00100000:2.0:1746129819.688349:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054321152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129819.688356:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.688371:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954c2a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c2c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129819.688396:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054012544:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129819.688433:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.691136:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054012544:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129819.691136:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054012416:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.691171:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954c2a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c2c expref: 30 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.691171:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954c23 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c25 expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.691182:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c3dfa00/0x48868a4e43954c2a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c2c expref: 30 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.691182:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6e000/0x48868a4e43954c23 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c25 expref: 27 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.691206:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c3dfa00, rc 0) 00000100:00100000:2.0:1746129819.691243:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054321152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2893us (3294us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.691250:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15370 00010000:00010000:1.0:1746129819.691524:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6e000, rc 0) 00000100:00100000:1.0:1746129819.691557:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054321024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3463us (3658us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129819.691562:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15369 00000100:00100000:0.0:1746129819.693660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.693752:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321280 00000100:00100000:1.0:1746129819.693758:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321280 00000100:00100000:1.0:1746129819.693799:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15371 00000100:00100000:1.0:1746129819.693805:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31523:x1830949054321280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129819.693819:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.693832:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c33 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.693881:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.693888:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129819.693890:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129819.693893:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.693916:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.693926:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 20 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.694253:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054012672:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.694713:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.697213:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054012672:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129819.697236:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.697250:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6fa00, rc 0) 00000100:00100000:1.0:1746129819.697296:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31523:x1830949054321280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3489us (3639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.697304:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15371 00000100:00100000:0.0:1746129819.700348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.700464:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321408 00000100:00100000:2.0:1746129819.700472:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321408 00002000:00100000:2.0:1746129819.700508:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3850240->4194303) req@ffff880135e56680 x1830949054321408/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.700517:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e56680 with x1830949054321408 ext(3850240->4194303) 00010000:00010000:2.0:1746129819.700523:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 21 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.700534:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 21 pid: 1140 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746129819.700540:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e56680 00000100:00100000:2.0:1746129819.700572:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1852 00000100:00100000:2.0:1746129819.700579:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054321408:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129819.710533:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054321408:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9945us (10183us total) trans 21474841299 rc 0/0 00000100:00100000:2.0:1746129819.710546:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1852 00002000:00100000:2.0:1746129819.710557:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3850240->4194303) req@ffff880135e56680 x1830949054321408/t21474841299(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.710566:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e56680 with x1830949054321408 ext(3850240->4194303) 00010000:00010000:2.0:1746129819.710575:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 23 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.710590:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 23 pid: 1140 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746129819.710596:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135e56680 00000100:00100000:0.0:1746129819.711428:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.711509:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321664 00000100:00100000:3.0:1746129819.711517:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321664 00000100:00100000:3.0:1746129819.711556:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11003 00000100:00100000:3.0:1746129819.711562:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31527:x1830949054321664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.711580:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.711592:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e800/0x48868a4e43954c38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c3a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.711659:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.711670:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.711679:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129819.711688:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129819.711769:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e800/0x48868a4e43954c38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 22 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.711786:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 21 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.711793:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.711796:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129819.711799:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43e600, rc 0) 00000100:00100000:3.0:1746129819.711835:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31527:x1830949054321664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 272us (409us total) trans 8589945000 rc 0/0 00000100:00100000:3.0:1746129819.711841:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11003 00000100:00100000:0.0:1746129819.713463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.713537:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321792 00000100:00100000:1.0:1746129819.713542:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321792 00010000:00010000:1.0:1746129819.713562:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 23 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.713646:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7672 00000100:00100000:1.0:1746129819.713652:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054321792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.713662:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.713676:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 23 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.713684:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 23 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.713699:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f400/0x48868a4e43954be4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3850240->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c02 expref: 23 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.714390:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.714393:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.714400:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.714407:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.714433:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.714444:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054012800:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.714500:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.714727:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.714743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.714782:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.714801:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054321920 00000100:00100000:0.0:1746129819.714804:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054321920 00000100:00100000:0.0:1746129819.714822:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322048 00000100:00100000:0.0:1746129819.714824:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322048 00000100:00100000:0.0:1746129819.714834:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322176 00000100:00100000:0.0:1746129819.714835:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322176 00000100:00100000:0.0:1746129819.714867:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15372 00000100:00100000:3.0:1746129819.714897:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15373 00000100:00100000:3.0:1746129819.714904:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054322048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.714916:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.714931:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c48 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.714949:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15374 00000100:00100000:1.0:1746129819.714955:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054322176:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129819.714960:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054012928:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129819.714961:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129819.714967:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c4f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.714976:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.714977:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.714981:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.714991:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129819.714992:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129819.714998:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb6f000, rc 0) 00000100:00100000:1.0:1746129819.715015:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054322176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.715020:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15374 00000100:00100000:0.0:1746129819.715130:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054321920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.715137:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.715153:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3a00/0x48868a4e43954c5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c41 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.715176:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135e57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054013056:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129819.715203:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.716442:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054012800:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.716456:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.716480:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054321792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2827us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.716487:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7672 00000100:00100000:0.0:1746129819.716569:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135e57b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054013056:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129819.716583:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3a00/0x48868a4e43954c5b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c41 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.716592:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3a00/0x48868a4e43954c5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c41 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.716603:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3a00, rc 0) 00000100:00100000:0.0:1746129819.716618:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054321920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1491us (1892us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129819.716623:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15372 00000100:00100000:3.0:1746129819.716704:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054012928:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129819.716718:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c4d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c48 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.716725:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c48 expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.716732:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f600, rc 0) 00000100:00100000:3.0:1746129819.716746:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054322048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1844us (2003us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.716751:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15373 00000100:00100000:0.0:1746129819.718439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.719017:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322432 00000100:00100000:2.0:1746129819.719026:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322432 00002000:00100000:2.0:1746129819.719061:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880135e57b80 x1830949054322432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.719070:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e57b80 with x1830949054322432 ext(2097152->3145727) 00002000:00010000:2.0:1746129819.719074:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e57b80 00000100:00100000:2.0:1746129819.719102:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6867 00000100:00100000:2.0:1746129819.719109:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054322432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.726595:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.728022:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322560 00000100:00100000:3.0:1746129819.728031:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322560 00000100:00100000:3.0:1746129819.728080:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15375 00000100:00100000:3.0:1746129819.728088:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31527:x1830949054322560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.728103:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.728117:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c56 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.728152:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.728159:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.728161:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.728164:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.728187:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.728197:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 28 pid: 4589 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.728207:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054013184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.728277:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.728762:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054322432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9646us (10320us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.728774:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6867 00002000:00100000:2.0:1746129819.729016:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880135e57b80 x1830949054322432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.729032:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135e57b80 with x1830949054322432 ext(2097152->3145727) 00002000:00010000:2.0:1746129819.729038:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135e57b80 00000100:00100000:3.0:1746129819.731107:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054013184:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.731132:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.731159:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43e400, rc 0) 00000100:00100000:3.0:1746129819.731207:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31527:x1830949054322560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3119us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.731214:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15375 00000100:00100000:0.0:1746129819.733252:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.733585:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322688 00000100:00100000:2.0:1746129819.733597:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322688 00002000:00100000:2.0:1746129819.733649:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1589248->2097151) req@ffff88009bb2c000 x1830949054322688/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.733659:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c000 with x1830949054322688 ext(1589248->2097151) 00010000:00010000:2.0:1746129819.733669:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 29 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.733683:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 29 pid: 4589 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746129819.733691:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2c000 00000100:00100000:2.0:1746129819.733728:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1853 00000100:00100000:2.0:1746129819.733736:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054322688:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129819.733775:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.733983:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322816 00000100:00100000:3.0:1746129819.733990:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322816 00000100:00100000:3.0:1746129819.734332:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15376 00000100:00100000:3.0:1746129819.734339:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31523:x1830949054322816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.734353:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.734366:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c5d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.734387:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.734393:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.734395:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.734398:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.734419:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 16 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.734427:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 16 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.734436:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054013312:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.735500:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.740512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.740557:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054013312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.740589:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.740608:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43e200, rc 0) 00000100:00100000:3.0:1746129819.740662:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31523:x1830949054322816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6323us (6887us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.740671:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15376 00000100:00100000:3.0:1746129819.740711:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054322944 00000100:00100000:3.0:1746129819.740717:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054322944 00002000:00100000:3.0:1746129819.740746:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3842047) req@ffff88009bb2c700 x1830949054322944/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.740760:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830949054322944 ext(3145728->3842047) 00010000:00010000:3.0:1746129819.740766:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.740776:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 17 pid: 1140 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.740785:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2c700 00000100:00100000:3.0:1746129819.740809:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1854 00000100:00100000:3.0:1746129819.740815:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054322944:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129819.747667:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054322688:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13922us (14411us total) trans 17179874102 rc 0/0 00000100:00100000:2.0:1746129819.747688:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1853 00002000:00100000:2.0:1746129819.747698:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1589248->2097151) req@ffff88009bb2c000 x1830949054322688/t17179874102(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.747708:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c000 with x1830949054322688 ext(1589248->2097151) 00010000:00010000:2.0:1746129819.747717:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 32 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.747728:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 32 pid: 4589 timeout: 865 lvb_type: 0 00002000:00010000:2.0:1746129819.747734:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2c000 00000100:00100000:3.0:1746129819.752597:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054322944:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11362us (11673us total) trans 17179874103 rc 0/0 00000100:00100000:3.0:1746129819.752944:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1854 00002000:00100000:3.0:1746129819.752954:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3842047) req@ffff88009bb2c700 x1830949054322944/t17179874103(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.752962:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830949054322944 ext(3145728->3842047) 00010000:00010000:3.0:1746129819.752971:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 19 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.752981:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 19 pid: 1140 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.752988:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2c700 00000100:00100000:0.0:1746129819.754175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.754826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.755189:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054323072 00000100:00100000:1.0:1746129819.755196:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054323072 00010000:00010000:1.0:1746129819.755224:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 19 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.755262:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054323200 00000100:00100000:1.0:1746129819.755264:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054323200 00010000:00010000:1.0:1746129819.755275:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 32 pid: 4589 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.755302:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7673 00000100:00100000:1.0:1746129819.755309:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054323072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.755321:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.755338:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 19 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.755353:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 19 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.755373:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43ee00/0x48868a4e43954beb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3842047) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c09 expref: 19 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.755387:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7674 00010000:00010000:1.0:1746129819.755391:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.755393:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129819.755394:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054323200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.755399:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.755401:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.755406:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.755411:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 32 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.755420:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 32 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.755432:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e600/0x48868a4e43954bb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1589248->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bd1 expref: 32 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.755433:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 32 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.755444:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054013440:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129819.755456:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.755457:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.755461:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.755471:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.755487:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.755495:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054013568:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129819.755524:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.755524:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ced80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.762060:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054013440:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.762076:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.762118:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054323072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6809us (7945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.762127:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7673 00000100:00100000:3.0:1746129819.762696:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054013568:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129819.762710:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.762743:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949054323200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7350us (7917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.762749:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7674 00000100:00100000:0.0:1746129819.764020:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.764079:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054323456 00000100:00100000:2.0:1746129819.764086:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054323456 00000100:00100000:2.0:1746129819.764130:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11004 00000100:00100000:2.0:1746129819.764137:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31529:x1830949054323456:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129819.764164:0:14314:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.764178:0:14314:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e400/0x48868a4e43954c70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c64 expref: -99 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.764277:0:14314:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129819.764289:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.764296:0:14314:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 293 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.764302:0:14314:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129819.764326:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 293 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.764336:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 293 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.764347:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949054013696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.764416:0:14314:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.764423:0:14314:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 22 pid: 14314 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.764430:0:14314:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949054013824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129819.764449:0:14314:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.764593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.764666:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.766272:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054323712 00000100:00100000:2.0:1746129819.766278:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054323712 00002000:00100000:2.0:1746129819.766304:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880136a39450 x1830949054323712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.766313:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a39450 with x1830949054323712 ext(1048576->2097151) 00002000:00010000:2.0:1746129819.766317:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a39450 00000100:00100000:2.0:1746129819.766337:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054323968 00000100:00100000:2.0:1746129819.766339:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054323968 00002000:00100000:2.0:1746129819.766347:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009bb2d500 x1830949054323968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.766353:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830949054323968 ext(2097152->3145727) 00002000:00010000:2.0:1746129819.766355:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:2.0:1746129819.766366:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6868 00000100:00100000:2.0:1746129819.766371:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054323712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.766372:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6869 00000100:00100000:3.0:1746129819.766379:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054323968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.766542:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129819.766551:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054013952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746129819.766587:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129819.767402:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054013952 00000100:00100000:3.0:1746129819.767405:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054013952 00000100:00100000:3.0:1746129819.767443:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1746129819.767447:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949054013952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746129819.767458:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 527761408 pending 23855104 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746129819.767485:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949054013952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.767490:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1746129819.767733:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054013952:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1746129819.768077:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129819.768096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.768792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.770389:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054324352 00000100:00100000:2.0:1746129819.770397:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054324352 00002000:00100000:2.0:1746129819.770431:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009bb2d880 x1830949054324352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.770440:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830949054324352 ext(3145728->4194303) 00002000:00010000:2.0:1746129819.770444:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d880 00000100:00100000:2.0:1746129819.770467:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054324480 00000100:00100000:2.0:1746129819.770469:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054324480 00002000:00100000:2.0:1746129819.770479:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009bb2dc00 x1830949054324480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.770485:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830949054324480 ext(3145728->4194303) 00002000:00010000:2.0:1746129819.770487:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:2.0:1746129819.770512:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6870 00000100:00100000:2.0:1746129819.770518:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054324352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.771372:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6871 00000100:00100000:3.0:1746129819.771380:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054324480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.773573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.773621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.773637:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054324608 00000100:00100000:3.0:1746129819.773643:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054324608 00010000:00010000:3.0:1746129819.773670:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 23 pid: 14314 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.773689:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054324736 00000100:00100000:3.0:1746129819.773691:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054324736 00010000:00010000:3.0:1746129819.773698:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 294 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.773709:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7675 00000100:00100000:3.0:1746129819.773714:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054324608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.773724:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.773728:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 23 pid: 14314 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.773737:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 23 pid: 14314 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.773754:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.773758:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129819.773765:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129819.773769:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.773790:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054324608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.773794:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7675 00000100:00100000:3.0:1746129819.773808:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7676 00000100:00100000:3.0:1746129819.773811:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1961:x1830949054324736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.773817:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.773819:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 294 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.773827:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 294 pid: 14315 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.773835:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.773838:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129819.773844:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129819.773864:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14314 initiator: MDT0 00010000:00010000:3.0:1746129819.773875:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.773886:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1961:x1830949054324736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.773890:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7676 00010000:00010000:2.0:1746129819.774381:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43f200/0x48868a4e43954c07 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c10 expref: 293 pid: 14315 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.774398:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949054013696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.774408:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb6fc00/0x48868a4e43954ada lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b53 expref: 22 pid: 14314 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.774415:0:14314:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14314:1830949054013824:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.774430:0:14314:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129819.774437:0:14314:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00010000:00010000:2.0:1746129819.774445:0:14314:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14314 initiator: MDT0 00000004:00200000:2.0:1746129819.774460:0:14314:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129819.774563:0:14314:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e400/0x48868a4e43954c70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 23 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.774573:0:14314:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 22 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.774578:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.774580:0:14314:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129819.774582:0:14314:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189e600, rc 0) 00000100:00100000:2.0:1746129819.774600:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31529:x1830949054323456:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10463us (10582us total) trans 8589945001 rc 0/0 00000100:00100000:2.0:1746129819.774606:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11004 00000100:00100000:3.0:1746129819.777228:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054323968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10843us (12555us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.777237:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6869 00002000:00100000:3.0:1746129819.777246:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009bb2d500 x1830949054323968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.777255:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d500 with x1830949054323968 ext(2097152->3145727) 00002000:00010000:3.0:1746129819.777259:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2d500 00000100:00100000:2.0:1746129819.783732:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054323712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17352us (19130us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.783746:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6868 00002000:00100000:2.0:1746129819.783757:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880136a39450 x1830949054323712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.783765:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a39450 with x1830949054323712 ext(1048576->2097151) 00002000:00010000:2.0:1746129819.783770:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a39450 00000100:00100000:3.0:1746129819.788239:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054324480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16851us (19439us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.788302:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6871 00002000:00100000:3.0:1746129819.788312:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009bb2dc00 x1830949054324480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.788321:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2dc00 with x1830949054324480 ext(3145728->4194303) 00002000:00010000:3.0:1746129819.788326:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2dc00 00000100:00100000:2.0:1746129819.791905:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054324352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21378us (23801us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.791917:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6870 00002000:00100000:2.0:1746129819.791927:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009bb2d880 x1830949054324352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.791936:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d880 with x1830949054324352 ext(3145728->4194303) 00002000:00010000:2.0:1746129819.791941:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d880 00000100:00100000:0.0:1746129819.799745:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.799845:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054324864 00000100:00100000:3.0:1746129819.799877:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054324864 00000100:00100000:3.0:1746129819.799997:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15377 00000100:00100000:3.0:1746129819.800005:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31527:x1830949054324864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.800021:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.800034:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c6b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.800057:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.800064:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.800065:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.800068:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.800094:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 30 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.800105:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 30 pid: 4589 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.800114:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054014080:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129819.803398:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.803427:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054014080:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.803451:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.803465:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f400, rc 0) 00000100:00100000:3.0:1746129819.803834:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31527:x1830949054324864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3828us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.803841:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15377 00000100:00100000:0.0:1746129819.804193:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.804387:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054324992 00000100:00100000:3.0:1746129819.804392:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054324992 00002000:00100000:3.0:1746129819.804422:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1531903) req@ffff88009bb2e680 x1830949054324992/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.804430:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830949054324992 ext(1048576->1531903) 00010000:00010000:3.0:1746129819.804436:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 31 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.804451:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 31 pid: 4589 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.804457:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2e680 00000100:00100000:3.0:1746129819.804471:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1855 00000100:00100000:3.0:1746129819.804478:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054324992:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129819.811066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.811494:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054325120 00000100:00100000:3.0:1746129819.811502:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054325120 00000100:00100000:3.0:1746129819.811537:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15378 00000100:00100000:3.0:1746129819.811544:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31529:x1830949054325120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.811558:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.811571:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c72 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.811592:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129819.811597:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.811602:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129819.811606:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1273856->1622015] (req 1273856->1622015) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.811635:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.811650:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1273856->1622015] (req 1273856->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.811659:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f600, rc 0) 00000100:00100000:3.0:1746129819.811695:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31529:x1830949054325120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 151us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.811700:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15378 00000100:00100000:2.0:1746129819.812598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.812689:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054325504 00000100:00100000:3.0:1746129819.812692:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054325504 00000100:00100000:3.0:1746129819.812710:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15379 00000100:00100000:3.0:1746129819.812715:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054325504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.812723:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.812731:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c80 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.812742:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.812744:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.812750:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.812761:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.812768:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43e800, rc 0) 00000100:00100000:3.0:1746129819.812791:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054325504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.812796:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15379 00000100:00100000:1.0:1746129819.813054:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054014720:0@lo:400:kworker.0 00000100:00100000:1.0:1746129819.813084:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129819.813104:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129819.813108:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949054014336:0@lo:400:kworker.0 00000100:00100000:1.0:1746129819.813126:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129819.813157:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949054014848:0@lo:400:kworker.0 00000100:00100000:1.0:1746129819.813177:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129819.813198:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054014336 00000100:00100000:1.0:1746129819.813200:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054014336 00000100:00100000:1.0:1746129819.813219:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1746129819.813224:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949054014336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129819.813247:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949054014336:12345-0@lo:400:kworker.0 Request processed in 23us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.813251:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1746129819.813278:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949054014336:0@lo:400:kworker.0 00000100:00100000:3.0:1746129819.813549:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949054014592:0@lo:400:kworker.0 00000100:00100000:3.0:1746129819.813571:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129819.813585:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746129819.813589:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3297:1830949054014464:0@lo:400:kworker.0 00000100:00100000:0.0:1746129819.813654:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054014720 00000100:00100000:0.0:1746129819.813658:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054014720 00000100:00100000:0.0:1746129819.813698:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1746129819.813703:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3298:x1830949054014720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129819.813739:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3298:x1830949054014720:12345-0@lo:400:kworker.0 Request processed in 36us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.813777:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129819.813805:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1746129819.813924:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054014848 00000100:00100000:2.0:1746129819.813927:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054014848 00000100:00100000:2.0:1746129819.813948:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054014592 00000100:00100000:2.0:1746129819.813950:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054014592 00000100:00100000:2.0:1746129819.813965:0:14314:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054014464 00000100:00100000:2.0:1746129819.813967:0:14314:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054014464 00000100:00100000:2.0:1746129819.813981:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1746129819.813986:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949054014848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129819.814014:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949054014848:12345-0@lo:400:kworker.0 Request processed in 28us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.814022:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1746129819.814031:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1746129819.814035:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949054014592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129819.814058:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1830949054014592:12345-0@lo:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.814066:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1746129819.814074:0:14314:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1746129819.814082:0:14314:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830949054014464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129819.814106:0:14314:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830949054014464:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.814110:0:14314:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1746129819.814168:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3297:1830949054014464:0@lo:400:kworker.0 00000100:00100000:3.0:1746129819.814175:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3297:1830949054014592:0@lo:400:kworker.0 00000100:00100000:2.0:1746129819.814448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.814531:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054325632 00000100:00100000:0.0:1746129819.814538:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054325632 00000100:00100000:0.0:1746129819.814620:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15380 00000100:00100000:0.0:1746129819.814627:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054325632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.814678:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1746129819.814808:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746129819.814812:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129819.814830:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949054014848:0@lo:400:kworker.0 00000100:00100000:1.0:1746129819.814838:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054014720:0@lo:400:kworker.0 00000100:00100000:1.0:1746129819.815032:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129819.815087:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0c00/0x48868a4e43954c9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c87 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.815123:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054014976:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129819.815172:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.815183:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054325376 00000100:00100000:0.0:1746129819.815186:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054325376 00000100:00100000:0.0:1746129819.815205:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11005 00000100:00100000:0.0:1746129819.815209:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31531:x1830949054325376:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129819.815219:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.815228:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ca1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c79 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.815306:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815315:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815324:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815333:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815337:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815342:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815422:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43954cb6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815429:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43954cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815434:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43954cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129819.815442:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129819.815508:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815514:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815519:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815524:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1ab600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129819.815527:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815532:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815541:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129819.815543:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129819.815545:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815550:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab600/0x48868a4e43954ca8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815562:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815567:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815572:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815575:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aa200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129819.815577:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815581:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815585:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244a00) 00010000:00010000:0.0:1746129819.815587:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129819.815589:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815593:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43954caf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129819.815622:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ca1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c79 expref: 296 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.815631:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43954cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c79 expref: 295 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.815637:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129819.815638:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129819.815640:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aac00, rc 0) 00000100:00100000:0.0:1746129819.815661:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31531:x1830949054325376:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 450us (629us total) trans 8589945002 rc 0/0 00000100:00100000:0.0:1746129819.815666:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11005 00000100:00100000:2.0:1746129819.815783:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.815902:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054325760 00000100:00100000:3.0:1746129819.815906:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054325760 00000100:00100000:2.0:1746129819.817807:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11006 00000100:00100000:2.0:1746129819.817818:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31532:x1830949054325760:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.817836:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.817865:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e800/0x48868a4e43954cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c8e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.817906:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.817917:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.817924:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.817934:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.817939:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.817943:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129819.818000:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054014976:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129819.818020:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.818023:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0c00/0x48868a4e43954c9a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c87 expref: 35 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.818028:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.818034:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.818039:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0c00/0x48868a4e43954c9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c87 expref: 35 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.818048:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0c00, rc 0) 00010000:00010000:2.0:1746129819.818055:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 21 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.818063:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 21 pid: 14314 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.818071:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054015104:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.818086:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054325632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3458us (3638us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129819.818096:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15380 00000100:00100000:2.0:1746129819.818113:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.818192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.818279:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054325888 00000100:00100000:1.0:1746129819.818283:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054325888 00000100:00100000:1.0:1746129819.818329:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 728 00000100:00100000:1.0:1746129819.818334:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1961:x1830949054325888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.818342:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.818352:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43954cb6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c79 expref: 295 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.818365:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129819.818369:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129819.818380:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129819.818384:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129819.818388:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.818412:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:1961:x1830949054325888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.818417:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 728 00000100:00100000:3.0:1746129819.821586:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054324992:12345-192.168.204.31@tcp:4:cat.0 Request processed in 17102us (17386us total) trans 17179874104 rc 0/0 00000100:00100000:3.0:1746129819.821596:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1855 00002000:00100000:3.0:1746129819.821605:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1531903) req@ffff88009bb2e680 x1830949054324992/t17179874104(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.821613:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2e680 with x1830949054324992 ext(1048576->1531903) 00010000:00010000:3.0:1746129819.821621:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 34 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.821632:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 34 pid: 4589 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.821637:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2e680 00000100:00100000:0.0:1746129819.823741:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.823816:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326016 00000100:00100000:2.0:1746129819.823824:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326016 00000100:00100000:2.0:1746129819.823879:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15381 00000100:00100000:2.0:1746129819.823885:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31531:x1830949054326016:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129819.823899:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.823913:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c95 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.823937:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.823944:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.823946:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.823949:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2908160->3125247] (req 2908160->3125247) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.823972:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.823986:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.823996:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054015232:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.825834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.825904:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.825931:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054015104:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129819.825948:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129819.825966:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326144 00000100:00100000:2.0:1746129819.825969:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326144 00010000:00010000:2.0:1746129819.825987:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 22 pid: 14314 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.826002:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7677 00000100:00100000:2.0:1746129819.826008:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054326144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.826015:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.826020:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 22 pid: 14314 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.826027:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 22 pid: 14314 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.826040:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e600/0x48868a4e43954c77 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c64 expref: 22 pid: 14314 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.826066:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.826070:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826077:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826083:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826093:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129819.826115:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054326144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.826120:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7677 00010000:00010000:2.0:1746129819.826134:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826149:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129819.826180:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129819.826183:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129819.826195:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826203:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826210:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826215:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826221:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826230:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.826234:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826240:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826247:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129819.826248:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129819.826251:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826255:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189ea00/0x48868a4e43954ccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826262:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826266:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826270:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826274:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009189f800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129819.826276:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826279:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826287:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8c00) 00010000:00010000:2.0:1746129819.826289:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129819.826291:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826294:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189f800/0x48868a4e43954cd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.826318:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189e800/0x48868a4e43954cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.826326:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.826330:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.826332:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129819.826334:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189fa00, rc 0) 00000100:00100000:2.0:1746129819.826350:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31532:x1830949054325760:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8536us (10569us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.826355:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11006 00000100:00100000:0.0:1746129819.827922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.828050:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326272 00000100:00100000:2.0:1746129819.828055:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326272 00010000:00010000:2.0:1746129819.828076:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 36 pid: 4589 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.828095:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7678 00000100:00100000:2.0:1746129819.828101:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054326272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129819.828109:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129819.828126:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 36 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.828135:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 36 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.828159:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb6e400/0x48868a4e43954bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1531903) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bdf expref: 36 pid: 4589 timeout: 865 lvb_type: 0 00010000:00010000:2.0:1746129819.828171:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.828173:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.828177:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.828184:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.828209:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.828218:0:16449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 19 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:2.0:1746129819.828227:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054015360:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129819.828935:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.829031:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.829058:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326400 00000100:00100000:0.0:1746129819.829065:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326400 00000100:00100000:0.0:1746129819.829270:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15382 00000100:00100000:0.0:1746129819.829277:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054326400:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.829298:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.829312:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355c9c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129819.829324:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1746129819.829333:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129819.829334:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054015488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1746129819.829335:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.829342:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.829356:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129819.829364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.829365:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746129819.829365:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ab200, rc 0) 00000100:00100000:0.0:1746129819.829395:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054326400:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 119us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.829401:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15382 00000100:00100000:0.0:1746129819.829485:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326528 00000100:00100000:0.0:1746129819.829488:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326528 00000100:00100000:1.0:1746129819.829494:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054015488 00000100:00100000:1.0:1746129819.829499:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054015488 00000100:00100000:0.0:1746129819.829509:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15383 00000100:00100000:0.0:1746129819.829513:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054326528:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.829521:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129819.829522:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1746129819.829527:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3297:x1830949054015488:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1746129819.829530:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ca3 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.829542:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.829543:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00000024:1.0:1746129819.829544:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 549781504 pending 22151168 free 3853516800 avail 3851419648 00010000:00010000:0.0:1746129819.829546:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.829556:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.829561:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa200, rc 0) 00000100:00100000:0.0:1746129819.829575:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054326528:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.829579:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3297:x1830949054015488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.829580:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15383 00000100:00100000:1.0:1746129819.829584:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1746129819.830196:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054015488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746129819.831119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.831159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.831178:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326656 00000100:00100000:3.0:1746129819.831182:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326656 00000100:00100000:3.0:1746129819.831204:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054326912 00000100:00100000:1.0:1746129819.831204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.831205:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054326912 00000100:00100000:1.0:1746129819.831217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.831222:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054327040 00000100:00100000:3.0:1746129819.831224:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054327040 00000100:00100000:3.0:1746129819.831234:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054327168 00000100:00100000:3.0:1746129819.831236:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054327168 00000100:00100000:3.0:1746129819.831259:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15384 00000100:00100000:3.0:1746129819.831264:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054326656:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129819.831275:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129819.831281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129819.831287:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9fa200/0x48868a4e43954cf5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355caa expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.831301:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054327296 00010000:00010000:3.0:1746129819.831303:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129819.831304:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054327296 00000100:00100000:2.0:1746129819.831310:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054015232:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.831312:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9fa200/0x48868a4e43954cf5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355caa expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.831320:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9fa200/0x48868a4e43954cf5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355caa expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746129819.831328:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b8e5880 x1830949054327296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129819.831329:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2908160->3125247] (req 2908160->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.831331:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9fa200, rc 0) 00002000:00100000:1.0:1746129819.831337:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5880 with x1830949054327296 ext(4194304->4931583) 00002000:00010000:1.0:1746129819.831340:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5880 00010000:00010000:2.0:1746129819.831341:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ec00, rc 0) 00000100:00100000:1.0:1746129819.831352:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6872 00000100:00100000:1.0:1746129819.831356:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054327296:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.831358:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054326656:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 93us (240us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.831359:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31531:x1830949054326016:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7474us (7624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.831363:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15384 00000100:00100000:2.0:1746129819.831367:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15381 00000100:00100000:3.0:1746129819.831378:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15385 00000100:00100000:3.0:1746129819.831382:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054326912:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:2.0:1746129819.831382:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15386 00000100:00100000:2.0:1746129819.831387:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054327040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129819.831388:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.831393:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.831396:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cb1 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.831400:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cb8 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.831405:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.831406:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.831410:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.831411:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.831413:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.831416:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.831424:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.831425:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 15 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.831430:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9fa400, rc 0) 00010000:00010000:2.0:1746129819.831432:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189e200, rc 0) 00000100:00100000:2.0:1746129819.831446:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054327040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129819.831451:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15386 00000100:00100000:2.0:1746129819.831462:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15387 00000100:00100000:2.0:1746129819.831467:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054327168:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129819.831475:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129819.831480:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009189ee00/0x48868a4e43954d0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cbf expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.831490:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129819.831495:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009189ee00/0x48868a4e43954d0a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cbf expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.831502:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189ee00/0x48868a4e43954d0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cbf expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129819.831509:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009189ee00, rc 0) 00000100:00100000:2.0:1746129819.831523:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054327168:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (304us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129819.831527:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15387 00000100:00100000:3.0:1746129819.833029:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054326912:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1641us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.833035:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15385 00000100:00100000:0.0:1746129819.833504:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.833548:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054327424 00000100:00100000:1.0:1746129819.833553:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054327424 00010000:00010000:1.0:1746129819.833571:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.833598:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7679 00000100:00100000:1.0:1746129819.833604:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054327424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.833613:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.833628:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.833637:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.833652:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e200/0x48868a4e43954c69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c5d expref: 35 pid: 8436 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.834333:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.834337:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.834344:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 34 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.834352:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 34 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.834378:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 34 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.834388:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054015616:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.834843:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.835210:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054015360:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129819.835225:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.835258:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054326272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7156us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.835266:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7678 00000100:00100000:2.0:1746129819.835645:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.835706:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054327680 00000100:00100000:3.0:1746129819.835710:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054327680 00000100:00100000:3.0:1746129819.835735:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11007 00000100:00100000:3.0:1746129819.835740:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31532:x1830949054327680:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129819.835753:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.835764:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fa800/0x48868a4e43954d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cc6 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.835830:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129819.835840:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.835845:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129819.835880:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.835888:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 15 pid: 1851 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.835895:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054015744:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129819.835915:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054327296:12345-192.168.204.31@tcp:3:cat.0 Request processed in 4557us (4632us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129819.835923:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6872 00002000:00100000:1.0:1746129819.835930:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b8e5880 x1830949054327296/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.835938:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5880 with x1830949054327296 ext(4194304->4931583) 00002000:00010000:1.0:1746129819.835943:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5880 00000100:00100000:3.0:1746129819.836709:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.837458:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054015616:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.837469:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.837501:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054327424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3896us (4002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.837507:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7679 00000100:00100000:3.0:1746129819.837574:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054015744:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129819.837587:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129819.838692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.838733:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054327808 00000100:00100000:1.0:1746129819.838738:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054327808 00010000:00010000:1.0:1746129819.838757:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 16 pid: 1851 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.838774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.838777:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7680 00000100:00100000:1.0:1746129819.838782:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949054327808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.838790:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.838794:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 16 pid: 1851 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.838802:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 16 pid: 1851 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.838816:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009189fa00/0x48868a4e43954cd9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c8e expref: 16 pid: 1851 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.838826:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129819.838831:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129819.838838:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129819.838843:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129819.838874:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.838894:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054327808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.838899:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7680 00000100:00100000:1.0:1746129819.838916:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054328064 00000100:00100000:1.0:1746129819.838918:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054328064 00002000:00100000:1.0:1746129819.838935:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009bb2c700 x1830949054328064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.838941:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830949054328064 ext(1048576->2097151) 00010000:00010000:1.0:1746129819.838945:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.838953:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746129819.838957:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2c700 00000100:00100000:1.0:1746129819.838964:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1856 00000100:00100000:1.0:1746129819.838967:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054328064:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:2.0:1746129819.838985:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129819.838993:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129819.839007:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129819.839105:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fa800/0x48868a4e43954d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.839115:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129819.839125:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129819.839127:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129819.839129:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9faa00, rc 0) 00000100:00100000:2.0:1746129819.839161:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31532:x1830949054327680:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3421us (3518us total) trans 8589945003 rc 0/0 00000100:00100000:2.0:1746129819.839167:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11007 00000100:00100000:0.0:1746129819.839435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.839448:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054328320 00000100:00100000:2.0:1746129819.839451:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054328320 00002000:00100000:2.0:1746129819.839466:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2908160->2912255) req@ffff88009bb2ca80 x1830949054328320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.839473:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830949054328320 ext(2908160->2912255) 00002000:00010000:2.0:1746129819.839476:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ca80 00000100:00100000:2.0:1746129819.839500:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6873 00000100:00100000:2.0:1746129819.839505:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054328320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.839588:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054328320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 82us (153us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129819.839594:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6873 00002000:00100000:2.0:1746129819.839598:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2908160->2912255) req@ffff88009bb2ca80 x1830949054328320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.839605:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ca80 with x1830949054328320 ext(2908160->2912255) 00002000:00010000:2.0:1746129819.839608:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2ca80 00000100:00100000:0.0:1746129819.840285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.840951:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054328448 00000100:00100000:3.0:1746129819.840955:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054328448 00000100:00100000:3.0:1746129819.840981:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15388 00000100:00100000:3.0:1746129819.840986:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054328448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129819.840994:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.841003:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f9fb400/0x48868a4e43954d26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ccd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.841016:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129819.841022:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f9fb400/0x48868a4e43954d26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ccd expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.841031:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f9fb400/0x48868a4e43954d26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ccd expref: 34 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129819.841046:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9fb400, rc 0) 00000100:00100000:3.0:1746129819.841064:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054328448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 78us (780us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129819.841068:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15388 00000100:00100000:2.0:1746129819.841662:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.841704:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054328576 00000100:00100000:0.0:1746129819.841708:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054328576 00000100:00100000:0.0:1746129819.841730:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11008 00000100:00100000:0.0:1746129819.841735:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31532:x1830949054328576:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.841746:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.841755:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab400/0x48868a4e43954d2d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cd4 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.841817:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.841830:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.841836:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.841882:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.841891:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 16 pid: 1851 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.841901:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054015872:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.841973:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129819.845719:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.845776:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.845891:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054328960 00000100:00100000:3.0:1746129819.845898:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054328960 00010000:00010000:3.0:1746129819.845929:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 17 pid: 1851 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.845954:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7681 00000100:00100000:3.0:1746129819.845960:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949054328960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129819.845971:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129819.845976:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 17 pid: 1851 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.845985:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 17 pid: 1851 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.846004:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.846009:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129819.846017:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129819.846023:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129819.846036:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129819.846074:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1963:x1830949054328960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129819.846080:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7681 00000100:00100000:3.0:1746129819.846102:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054328832 00000100:00100000:3.0:1746129819.846105:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054328832 00002000:00100000:3.0:1746129819.846129:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3121152->3125247) req@ffff8800a00c5c00 x1830949054328832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.846137:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5c00 with x1830949054328832 ext(3121152->3125247) 00002000:00010000:3.0:1746129819.846150:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5c00 00000100:00100000:3.0:1746129819.846169:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6874 00000100:00100000:3.0:1746129819.846174:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054328832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.846213:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129819.846456:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d18 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cc6 expref: 16 pid: 1851 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.846480:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2df80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054015872:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129819.846494:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.846500:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.846504:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129819.846538:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:0.0:1746129819.846541:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129819.846551:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.846573:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab400/0x48868a4e43954d2d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.846583:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 15 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.846589:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129819.846591:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129819.846594:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1abc00, rc 0) 00000100:00100000:0.0:1746129819.846634:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31532:x1830949054328576:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4898us (4973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129819.846640:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11008 00000100:00100000:0.0:1746129819.846658:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054329088 00000100:00100000:0.0:1746129819.846661:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054329088 00000100:00100000:0.0:1746129819.846677:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15389 00000100:00100000:0.0:1746129819.846681:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054329088:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.846688:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.846699:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43954d3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cdb expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.846716:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.846722:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43954d3b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cdb expref: 35 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.846734:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa400/0x48868a4e43954d3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cdb expref: 35 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.846739:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa400, rc 0) 00000100:00100000:0.0:1746129819.846757:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054329088:12345-192.168.204.31@tcp:101:cat.0 Request processed in 76us (545us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129819.846762:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15389 00000100:00100000:0.0:1746129819.847155:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054328064:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8185us (8380us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129819.847162:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1856 00002000:00100000:0.0:1746129819.847168:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009bb2c700 x1830949054328064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129819.847174:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2c700 with x1830949054328064 ext(1048576->2097151) 00010000:00010000:0.0:1746129819.847179:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746129819.847252:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054328832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 1077us (1540us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129819.847258:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6874 00002000:00100000:3.0:1746129819.847263:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3121152->3125247) req@ffff8800a00c5c00 x1830949054328832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129819.847265:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746129819.847271:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb2c700 00002000:00100000:3.0:1746129819.847275:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c5c00 with x1830949054328832 ext(3121152->3125247) 00002000:00010000:3.0:1746129819.847279:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c5c00 00000100:00100000:3.0:1746129819.848316:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.848340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.848799:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054329216 00000100:00100000:0.0:1746129819.848800:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054329344 00000100:00100000:1.0:1746129819.848805:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054329216 00000100:00100000:0.0:1746129819.848806:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054329344 00000100:00100000:0.0:1746129819.848877:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15390 00000100:00100000:0.0:1746129819.848884:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054329344:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.848895:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.848906:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aae00/0x48868a4e43954d42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ce9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.848947:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054016000:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129819.849010:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129819.849024:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15391 00000100:00100000:0.0:1746129819.849029:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054329216:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.849035:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.849042:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43954d49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ce2 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.849052:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.849059:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43954d49 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ce2 expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.849066:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aac00/0x48868a4e43954d49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ce2 expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129819.849073:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aac00, rc 0) 00000100:00100000:0.0:1746129819.849088:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054329216:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (773us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129819.849093:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15391 00000100:00100000:0.0:1746129819.853558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.853716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.853743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.853760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.853795:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054329600 00000100:00100000:1.0:1746129819.853804:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054329600 00000100:00100000:2.0:1746129819.853811:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054330240 00000100:00100000:2.0:1746129819.853815:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054330240 00002000:00100000:2.0:1746129819.853864:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009468c000 x1830949054330240/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129819.853865:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054329984 00000100:00100000:1.0:1746129819.853868:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054329984 00000100:00100000:0.0:1746129819.853873:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4591 00002000:00100000:2.0:1746129819.853874:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c000 with x1830949054330240 ext(2097152->3145727) 00002000:00010000:2.0:1746129819.853878:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468c000 00000100:00100000:0.0:1746129819.853879:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31523:x1830949054329600:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129819.853884:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4592 00000100:00100000:1.0:1746129819.853889:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31531:x1830949054329984:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129819.853890:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6875 00000100:00100000:2.0:1746129819.853895:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054330240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129819.853959:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054329728 00000100:00100000:1.0:1746129819.853962:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054329728 00010000:00010000:1.0:1746129819.853977:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.853995:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7682 00000100:00100000:1.0:1746129819.853999:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054329728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.854007:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.854018:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.854021:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31523:x1830949054329600:12345-192.168.204.31@tcp:35:cat.0 Request processed in 142us (470us total) trans 8589945004 rc 0/0 00000100:00100000:0.0:1746129819.854026:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4591 00010000:00010000:1.0:1746129819.854028:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.854039:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054016000:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129819.854047:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f400/0x48868a4e43954c85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c6b expref: 20 pid: 8436 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746129819.854058:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aae00/0x48868a4e43954d42 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ce9 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.854059:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.854061:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129819.854064:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aae00/0x48868a4e43954d42 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ce9 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129819.854066:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.854069:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aae00, rc 0) 00010000:00010000:1.0:1746129819.854078:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129819.854079:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054329344:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5197us (5739us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129819.854082:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15390 00010000:00010000:1.0:1746129819.854101:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.854111:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054016128:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.854168:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.854232:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31531:x1830949054329984:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 342us (488us total) trans 8589945005 rc 0/0 00000100:00100000:1.0:1746129819.854238:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4592 00000100:00100000:0.0:1746129819.858632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.858654:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054330752 00000100:00100000:0.0:1746129819.858661:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054330752 00000100:00100000:0.0:1746129819.858719:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11009 00000100:00100000:0.0:1746129819.858728:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31532:x1830949054330752:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129819.858746:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.858762:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43954d50 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cf0 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.858866:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858878:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858888:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858899:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858904:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858909:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858914:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aa000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129819.858917:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858922:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858930:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129819.858933:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129819.858936:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858941:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa000/0x48868a4e43954d57 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129819.858969:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43954d50 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf0 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.858975:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa400/0x48868a4e43954d50 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf0 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.858982:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1aa400, rc 0) 00000100:00100000:0.0:1746129819.859021:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31532:x1830949054330752:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 294us (401us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129819.859028:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11009 00000100:00100000:0.0:1746129819.859107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.859234:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054330496 00000100:00100000:3.0:1746129819.859238:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054330496 00002000:00100000:3.0:1746129819.859260:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1273856->1277951) req@ffff88009468c380 x1830949054330496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.859268:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949054330496 ext(1273856->1277951) 00002000:00010000:3.0:1746129819.859272:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468c380 00000100:00100000:3.0:1746129819.859284:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6876 00000100:00100000:3.0:1746129819.859288:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054330496:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.859393:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054330496:12345-192.168.204.31@tcp:3:cat.0 Request processed in 103us (285us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129819.859399:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6876 00002000:00100000:3.0:1746129819.859403:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1273856->1277951) req@ffff88009468c380 x1830949054330496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.859410:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c380 with x1830949054330496 ext(1273856->1277951) 00002000:00010000:3.0:1746129819.859413:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468c380 00000100:00100000:1.0:1746129819.859736:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054016128:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.859752:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.859775:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054329728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5775us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.859783:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7682 00000100:00100000:2.0:1746129819.863111:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054330240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9206us (9340us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.863122:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6875 00002000:00100000:2.0:1746129819.863132:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009468c000 x1830949054330240/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.863152:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468c000 with x1830949054330240 ext(2097152->3145727) 00002000:00010000:2.0:1746129819.863157:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009468c000 00000100:00100000:0.0:1746129819.863754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.863812:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054331008 00000100:00100000:3.0:1746129819.863818:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054331008 00000100:00100000:3.0:1746129819.863879:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4593 00000100:00100000:3.0:1746129819.863885:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31532:x1830949054331008:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129819.865215:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31532:x1830949054331008:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 1328us (1460us total) trans 8589945006 rc 0/0 00000100:00100000:3.0:1746129819.865220:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4593 00000100:00100000:0.0:1746129819.868067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.868266:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054331264 00000100:00100000:2.0:1746129819.868275:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054331264 00002000:00100000:2.0:1746129819.868308:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1617920->1622015) req@ffff88009468df80 x1830949054331264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.868317:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468df80 with x1830949054331264 ext(1617920->1622015) 00002000:00010000:2.0:1746129819.868321:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468df80 00000100:00100000:2.0:1746129819.868352:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6877 00000100:00100000:2.0:1746129819.868360:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054331264:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129819.868397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.868416:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054331392 00000100:00100000:0.0:1746129819.868419:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054331392 00000100:00100000:0.0:1746129819.868453:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15392 00000100:00100000:0.0:1746129819.868458:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31527:x1830949054331392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129819.868465:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129819.868479:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cf7 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.868498:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 32 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.868504:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129819.868506:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129819.868509:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.868532:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 32 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129819.868541:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 32 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746129819.868551:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054016256:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129819.868606:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129819.870291:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054331264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 1927us (2226us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129819.870299:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6877 00002000:00100000:3.0:1746129819.870306:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1617920->1622015) req@ffff88009468df80 x1830949054331264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/4536 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.870314:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468df80 with x1830949054331264 ext(1617920->1622015) 00002000:00010000:3.0:1746129819.870318:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468df80 00000100:00100000:1.0:1746129819.870478:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054016256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129819.870498:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.870509:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1abe00, rc 0) 00000100:00100000:1.0:1746129819.870531:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31527:x1830949054331392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2073us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.870540:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15392 00000100:00100000:1.0:1746129819.872962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.873113:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054331520 00000100:00100000:3.0:1746129819.873120:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054331520 00002000:00100000:3.0:1746129819.873161:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2908160->3125247) req@ffff88012b8e4380 x1830949054331520/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.873169:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4380 with x1830949054331520 ext(2908160->3125247) 00010000:00010000:3.0:1746129819.873176:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 33 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.873186:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 33 pid: 1140 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.873192:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e4380 00000100:00100000:3.0:1746129819.873214:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1857 00000100:00100000:3.0:1746129819.873220:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054331520:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129819.873809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.873869:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054331776 00000100:00100000:2.0:1746129819.873874:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054331776 00000100:00100000:2.0:1746129819.873906:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4594 00000100:00100000:2.0:1746129819.873911:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31529:x1830949054331776:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129819.874056:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31529:x1830949054331776:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 144us (247us total) trans 8589945007 rc 0/0 00000100:00100000:2.0:1746129819.874061:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4594 00000100:00100000:3.0:1746129819.876577:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054331520:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3347us (3610us total) trans 17179874105 rc 0/0 00000100:00100000:3.0:1746129819.876586:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1857 00002000:00100000:3.0:1746129819.876594:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2908160->3125247) req@ffff88012b8e4380 x1830949054331520/t17179874105(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:560/0 lens 488/448 e 0 to 0 dl 1746129830 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.876602:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4380 with x1830949054331520 ext(2908160->3125247) 00010000:00010000:3.0:1746129819.876609:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746129819.876621:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746129819.876627:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b8e4380 00000100:00100000:0.0:1746129819.881228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129819.881290:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054331904 00000100:00100000:1.0:1746129819.881298:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054331904 00010000:00010000:1.0:1746129819.881327:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746129819.881365:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7683 00000100:00100000:1.0:1746129819.881372:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054331904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129819.881383:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129819.881400:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.881411:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.881430:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009189ec00/0x48868a4e43954ce0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2908160->3125247) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c95 expref: 35 pid: 1140 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746129819.881458:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.881460:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129819.881467:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.881474:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129819.881505:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129819.881516:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054016384:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129819.881595:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129819.887378:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054016384:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129819.887396:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129819.887775:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054331904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6401us (6552us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129819.887788:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7683 00000100:00100000:0.0:1746129819.888427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.888607:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054332288 00000100:00100000:3.0:1746129819.888614:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054332288 00002000:00100000:3.0:1746129819.888647:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009468ce00 x1830949054332288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.888656:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ce00 with x1830949054332288 ext(2097152->3145727) 00002000:00010000:3.0:1746129819.888660:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ce00 00000100:00100000:0.0:1746129819.888794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129819.889035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.889280:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054332416 00000100:00100000:3.0:1746129819.889284:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054332416 00002000:00100000:3.0:1746129819.889299:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009468f800 x1830949054332416/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.889306:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468f800 with x1830949054332416 ext(3145728->4194303) 00002000:00010000:3.0:1746129819.889309:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468f800 00000100:00100000:3.0:1746129819.889327:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6878 00000100:00100000:3.0:1746129819.889333:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054332288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129819.889990:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6879 00000100:00100000:1.0:1746129819.889999:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054332416:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.891917:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054332672 00000100:00100000:2.0:1746129819.891925:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054332672 00002000:00100000:2.0:1746129819.891957:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009bb2ea00 x1830949054332672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.891965:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ea00 with x1830949054332672 ext(3145728->4194303) 00002000:00010000:2.0:1746129819.891970:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2ea00 00000100:00100000:2.0:1746129819.891991:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6880 00000100:00100000:2.0:1746129819.891997:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054332672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129819.905283:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054332288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15942us (16848us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129819.905293:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6878 00002000:00100000:3.0:1746129819.905312:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009468ce00 x1830949054332288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129819.905320:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468ce00 with x1830949054332288 ext(2097152->3145727) 00002000:00010000:3.0:1746129819.905324:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468ce00 00000100:00100000:1.0:1746129819.906070:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054332416:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16070us (17273us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129819.906077:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6879 00002000:00100000:1.0:1746129819.906082:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009468f800 x1830949054332416/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129819.906089:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009468f800 with x1830949054332416 ext(3145728->4194303) 00002000:00010000:1.0:1746129819.906093:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009468f800 00000100:00100000:2.0:1746129819.912571:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054332672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20565us (23526us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129819.912583:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6880 00002000:00100000:2.0:1746129819.912594:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009bb2ea00 x1830949054332672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.912603:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2ea00 with x1830949054332672 ext(3145728->4194303) 00002000:00010000:2.0:1746129819.912614:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2ea00 00000100:00100000:0.0:1746129819.927095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129819.927162:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054332928 00000100:00100000:2.0:1746129819.927170:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054332928 00002000:00100000:2.0:1746129819.927210:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009bb2f100 x1830949054332928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/0 e 0 to 0 dl 1746129830 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.927220:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830949054332928 ext(4194304->4931583) 00002000:00010000:2.0:1746129819.927226:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f100 00000100:00100000:2.0:1746129819.927259:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6881 00000100:00100000:2.0:1746129819.927266:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054332928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129819.938825:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054332928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11552us (11731us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129819.938837:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6881 00002000:00100000:2.0:1746129819.938862:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009bb2f100 x1830949054332928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:560/0 lens 488/440 e 0 to 0 dl 1746129830 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129819.938872:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2f100 with x1830949054332928 ext(4194304->4931583) 00002000:00010000:2.0:1746129819.938982:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2f100 00000100:00100000:0.0:1746129819.988687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129819.991463:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054333184 00000100:00100000:3.0:1746129819.991474:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054333184 00000100:00100000:3.0:1746129819.991537:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11010 00000100:00100000:3.0:1746129819.991544:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31539:x1830949054333184:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129819.991564:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129819.991579:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fa800/0x48868a4e43954d65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355cfe expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.991668:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991679:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991688:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991699:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991708:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991712:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991795:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991802:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991808:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129819.991816:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129819.991912:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991918:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991924:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991928:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9faa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.991932:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991937:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991946:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129819.991949:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.991952:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991957:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9faa00/0x48868a4e43954d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991986:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991990:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991994:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.991998:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f9fb400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129819.992000:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.992004:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.992010:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49200) 00010000:00010000:3.0:1746129819.992012:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129819.992014:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.992018:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb400/0x48868a4e43954d73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129819.992048:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fa800/0x48868a4e43954d65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.992062:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 298 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129819.992067:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129819.992069:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129819.992072:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9fba00, rc 0) 00000100:00100000:3.0:1746129819.992129:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:31539:x1830949054333184:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 585us (3449us total) trans 8589945008 rc 0/0 00000100:00100000:3.0:1746129819.992135:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11010 00000100:00100000:0.0:1746129820.014187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.014251:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054333440 00000100:00100000:2.0:1746129820.014259:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054333440 00000100:00100000:2.0:1746129820.014312:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11011 00000100:00100000:2.0:1746129820.014319:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31541:x1830949054333440:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.014340:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.014355:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857600/0x48868a4e43954d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d05 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.014443:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014454:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014466:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014476:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014481:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014486:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014572:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014579:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014585:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129820.014592:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129820.014731:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014737:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014743:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014747:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b857800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.014750:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014756:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014766:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129820.014768:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.014772:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014776:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857800/0x48868a4e43954d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014803:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014808:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014812:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014816:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b857a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.014818:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014822:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014828:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8000) 00010000:00010000:2.0:1746129820.014830:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.014832:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014835:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857a00/0x48868a4e43954d96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129820.014892:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857600/0x48868a4e43954d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 25 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.014903:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.014909:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.014910:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129820.014912:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857c00, rc 0) 00000100:00100000:2.0:1746129820.014964:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31541:x1830949054333440:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 645us (783us total) trans 8589945009 rc 0/0 00000100:00100000:2.0:1746129820.014971:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11011 00000100:00100000:0.0:1746129820.021180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.021262:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054333568 00000100:00100000:1.0:1746129820.021270:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054333568 00000100:00080000:2.0:1746129820.022123:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129820.022520:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15393 00000100:00100000:1.0:1746129820.022531:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31541:x1830949054333568:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129820.022546:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.022560:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d0c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.022584:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.022591:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.022597:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 26 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.022602:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.022604:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.022606:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [765952->917503] (req 765952->917503) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.022628:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 26 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.022635:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 26 pid: 3624 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.022656:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054016512:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.022753:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.022766:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 13 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.022774:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054016640:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.022798:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.022804:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.022810:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054016768:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.022823:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.026807:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054016512:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.026819:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054016640:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.026825:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054016768:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.026881:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [765952->917503] (req 765952->917503) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.026896:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc2600, rc 0) 00000100:00100000:1.0:1746129820.026937:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31541:x1830949054333568:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4410us (5763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.026945:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15393 00000100:00100000:0.0:1746129820.027216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.027294:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.027472:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054333696 00000100:00100000:1.0:1746129820.027479:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054333696 00000100:00100000:3.0:1746129820.027506:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054333824 00000100:00100000:3.0:1746129820.027510:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054333824 00010000:00010000:1.0:1746129820.027514:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 14 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.027522:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 27 pid: 3624 timeout: 866 lvb_type: 1 00000100:00080000:2.0:1746129820.027574:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746129820.027642:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7684 00000100:00100000:3.0:1746129820.027646:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7685 00000100:00100000:1.0:1746129820.027649:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054333696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129820.027650:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054333824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.027659:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.027659:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.027673:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 27 pid: 3624 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.027674:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 14 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.027682:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 14 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.027689:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 27 pid: 3624 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.027788:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e1ab200/0x48868a4e43954ce7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c9c expref: 14 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.027790:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c3df800/0x48868a4e43954b3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b76 expref: 27 pid: 3624 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.027808:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129820.027808:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.027925:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054333696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 276us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.027937:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054333824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 286us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.027942:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7685 00000100:00100000:1.0:1746129820.027965:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7684 00000100:00100000:0.0:1746129820.029330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.029398:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054333952 00000100:00100000:1.0:1746129820.029403:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054333952 00010000:00010000:1.0:1746129820.029420:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.029496:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7686 00000100:00100000:1.0:1746129820.029502:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054333952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.029513:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.029524:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.029533:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.029548:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919eca00/0x48868a4e43954b2e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b6f expref: 24 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.029558:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.029559:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.029565:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.029572:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.029595:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.029604:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054016896:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129820.030073:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.035474:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.035557:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054016896:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129820.035575:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.035614:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054333952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6111us (6284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.035626:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7686 00000100:00100000:2.0:1746129820.035840:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054334208 00000100:00100000:2.0:1746129820.035867:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054334208 00002000:00100000:2.0:1746129820.035897:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (765952->770047) req@ffff88009a04e680 x1830949054334208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.035905:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e680 with x1830949054334208 ext(765952->770047) 00002000:00010000:2.0:1746129820.035908:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04e680 00000100:00100000:2.0:1746129820.035924:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6882 00000100:00100000:2.0:1746129820.035929:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054334208:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129820.036603:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054334208:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 671us (1135us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129820.036612:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6882 00002000:00100000:2.0:1746129820.036617:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (765952->770047) req@ffff88009a04e680 x1830949054334208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.036624:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e680 with x1830949054334208 ext(765952->770047) 00002000:00010000:2.0:1746129820.036627:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04e680 00000100:00100000:0.0:1746129820.042307:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.042400:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054334464 00000100:00100000:2.0:1746129820.042408:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054334464 00002000:00100000:2.0:1746129820.042442:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (913408->917503) req@ffff88009a04fb80 x1830949054334464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.042450:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949054334464 ext(913408->917503) 00002000:00010000:2.0:1746129820.042455:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04fb80 00000100:00100000:2.0:1746129820.042505:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6883 00000100:00100000:2.0:1746129820.042512:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054334464:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129820.042657:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054334464:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 144us (355us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129820.042662:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6883 00002000:00100000:2.0:1746129820.042667:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (913408->917503) req@ffff88009a04fb80 x1830949054334464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.042674:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04fb80 with x1830949054334464 ext(913408->917503) 00002000:00010000:2.0:1746129820.042677:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04fb80 00000100:00100000:0.0:1746129820.046882:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.046927:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054334720 00000100:00100000:1.0:1746129820.046935:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054334720 00000100:00100000:1.0:1746129820.047171:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4595 00000100:00100000:1.0:1746129820.047180:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31541:x1830949054334720:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129820.047920:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31541:x1830949054334720:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 740us (1073us total) trans 8589945010 rc 0/0 00000100:00100000:1.0:1746129820.047927:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4595 00000100:00100000:0.0:1746129820.080117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.080178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.080235:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054334976 00000100:00100000:3.0:1746129820.080243:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054334976 00002000:00100000:3.0:1746129820.080277:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009a04c380 x1830949054334976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 504/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.080290:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c380 with x1830949054334976 ext(0->1048575) 00000100:00100000:2.0:1746129820.080290:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054335232 00002000:00010000:3.0:1746129820.080295:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04c380 00000100:00100000:2.0:1746129820.080295:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054335232 00000100:00100000:3.0:1746129820.080311:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6884 00000100:00080000:2.0:1746129820.080312:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129820.080317:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054334976:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:2.0:1746129820.080329:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009a04d180 x1830949054335232/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 504/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.080337:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d180 with x1830949054335232 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.080341:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04d180 00000100:00100000:2.0:1746129820.080369:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6885 00000100:00100000:2.0:1746129820.080376:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054335232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.082414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.082456:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054335488 00000100:00100000:3.0:1746129820.082463:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054335488 00000100:00100000:3.0:1746129820.082499:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11012 00000100:00100000:3.0:1746129820.082505:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:31548:x1830949054335488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.082520:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.082533:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb200/0x48868a4e43954db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d13 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.082600:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.082611:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.082624:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129820.082632:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129820.082711:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb200/0x48868a4e43954db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 301 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.082742:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.082749:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.082751:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129820.082754:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f9fb000, rc 0) 00000100:00100000:3.0:1746129820.082780:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31548:x1830949054335488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 276us (373us total) trans 8589945011 rc 0/0 00000100:00100000:3.0:1746129820.082786:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11012 00000100:00080000:3.0:1746129820.082812:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129820.090579:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054335232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10196us (10393us total) trans 0 rc 700416/700416 00000100:00100000:2.0:1746129820.090588:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6885 00002000:00100000:2.0:1746129820.090597:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009a04d180 x1830949054335232/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 504/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.090606:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d180 with x1830949054335232 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.090611:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04d180 00000100:00100000:0.0:1746129820.100502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.100582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.101126:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054335616 00000100:00100000:2.0:1746129820.101147:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054335616 00000100:00100000:2.0:1746129820.101176:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054335744 00000100:00100000:2.0:1746129820.101178:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054335744 00000100:00100000:2.0:1746129820.101205:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15394 00000100:00100000:2.0:1746129820.101211:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054335616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.101225:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.101239:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b857400/0x48868a4e43954dc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d1a expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.101277:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054017024:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129820.101336:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00080000:2.0:1746129820.101396:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129820.101410:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15395 00000100:00100000:2.0:1746129820.101415:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054335744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.101426:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.101434:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b857200/0x48868a4e43954dce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d21 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.101455:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054017152:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129820.101474:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.102027:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054334976:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21706us (21915us total) trans 0 rc 897024/897024 00000100:00100000:3.0:1746129820.102037:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6884 00002000:00100000:3.0:1746129820.102047:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009a04c380 x1830949054334976/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 504/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 897024/897024 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.102057:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c380 with x1830949054334976 ext(0->1048575) 00002000:00010000:3.0:1746129820.102062:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04c380 00000100:00100000:2.0:1746129820.102912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.103055:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054335872 00000100:00100000:0.0:1746129820.103061:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054335872 00000100:00100000:0.0:1746129820.103361:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15396 00000100:00100000:0.0:1746129820.103370:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054335872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.103382:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.103393:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d28 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.103411:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.103413:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.103421:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.103436:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.103445:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379c00, rc 0) 00000100:00100000:0.0:1746129820.103497:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949054335872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 127us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.103502:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15396 00002000:00010000:2.0:1746129820.106595:0:10930:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129819 -> 1746129820 00002000:00010000:2.0:1746129820.106602:0:10930:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129819 -> 1746129820 00002000:00010000:2.0:1746129820.106604:0:10930:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129819 -> 1746129820 00000100:00100000:2.0:1746129820.106625:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054017024:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129820.106651:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b857400/0x48868a4e43954dc7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d1a expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.106663:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b857400/0x48868a4e43954dc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d1a expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.106676:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857400, rc 0) 00000100:00100000:2.0:1746129820.106721:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054335616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5509us (6227us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129820.106728:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15394 00000100:00100000:2.0:1746129820.111060:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054017152:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129820.111086:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b857200/0x48868a4e43954dce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d21 expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.111104:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b857200/0x48868a4e43954dce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d21 expref: 36 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.111133:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857200, rc 0) 00000100:00100000:2.0:1746129820.111195:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054335744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9779us (10613us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129820.111203:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15395 00000100:00100000:0.0:1746129820.118178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.118297:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336000 00000100:00100000:2.0:1746129820.118304:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336000 00000100:00100000:2.0:1746129820.119003:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15397 00000100:00100000:2.0:1746129820.119013:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31548:x1830949054336000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.119028:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.119042:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d2f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.119068:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.119075:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.119076:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.119080:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.119109:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.119123:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 22 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.119133:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054017280:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.119994:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.123607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.123681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.123738:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336128 00000100:00100000:3.0:1746129820.123745:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336128 00000100:00100000:2.0:1746129820.123763:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054017280:192.168.204.31@tcp:104: 00002000:00100000:3.0:1746129820.123781:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (765952->917503) req@ffff88009284ed80 x1830949054336128/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129820.123784:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336256 00010000:00010000:2.0:1746129820.123787:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.123788:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336256 00002000:00100000:3.0:1746129820.123791:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ed80 with x1830949054336128 ext(765952->917503) 00010000:00010000:3.0:1746129820.123797:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 24 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.123802:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857000, rc 0) 00010000:00010000:3.0:1746129820.123808:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 24 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.123814:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284ed80 00000100:00100000:1.0:1746129820.123818:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15398 00000100:00100000:1.0:1746129820.123824:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054336256:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129820.123828:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1858 00000100:00100000:3.0:1746129820.123833:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054336128:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129820.123834:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129820.123836:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31548:x1830949054336000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4825us (5664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.123843:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15397 00010000:00010000:1.0:1746129820.123863:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2e00/0x48868a4e43954de3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d36 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.123896:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054017408:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129820.123942:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.125420:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.125517:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336384 00000100:00100000:2.0:1746129820.125521:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336384 00000100:00100000:2.0:1746129820.125544:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15399 00000100:00100000:2.0:1746129820.125552:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31539:x1830949054336384:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.125560:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.125567:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d3d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.125581:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.125585:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.125594:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129820.125597:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [843776->1048575] (req 843776->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.125615:0:8436:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.125623:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [843776->1048575] (req 843776->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.125629:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b856c00, rc 0) 00000100:00100000:2.0:1746129820.125648:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31539:x1830949054336384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 96us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.125653:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15399 00000100:00100000:3.0:1746129820.128432:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054336128:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4592us (4744us total) trans 21474841300 rc 0/0 00000100:00100000:3.0:1746129820.128441:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1858 00002000:00100000:3.0:1746129820.128449:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (765952->917503) req@ffff88009284ed80 x1830949054336128/t21474841300(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.128457:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ed80 with x1830949054336128 ext(765952->917503) 00010000:00010000:3.0:1746129820.128465:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.128477:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.128483:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284ed80 00000100:00100000:1.0:1746129820.130025:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054017408:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129820.130051:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2e00/0x48868a4e43954de3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d36 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.130062:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2e00/0x48868a4e43954de3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d36 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.130090:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbc2e00, rc 0) 00000100:00100000:1.0:1746129820.130114:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054336256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6289us (6513us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129820.130120:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15398 00000100:00100000:0.0:1746129820.132567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.132706:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336512 00000100:00100000:1.0:1746129820.132712:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336512 00000100:00100000:1.0:1746129820.132783:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 218 00000100:00100000:1.0:1746129820.132790:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949054336512:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129820.133071:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949054336512:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 280us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.133077:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 218 00000100:00100000:0.0:1746129820.133995:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.134035:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.134078:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336640 00000100:00100000:2.0:1746129820.134083:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336640 00000100:00100000:2.0:1746129820.134117:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15400 00000100:00100000:2.0:1746129820.134122:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054336640:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129820.134131:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336768 00010000:00010000:2.0:1746129820.134143:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129820.134144:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336768 00010000:00010000:2.0:1746129820.134157:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b857600/0x48868a4e43954df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d44 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.134158:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 26 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.134174:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7687 00000100:00100000:1.0:1746129820.134179:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054336768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.134185:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129820.134195:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054017664:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129820.134200:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.134208:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.134234:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.134236:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.134241:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.134248:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.134249:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746129820.134266:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.134275:0:7107:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 27 pid: 4589 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.134283:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054017792:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129820.134302:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129820.136318:0:10930:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff8800a00c6300 x1830949054017664) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.136345:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbc2600/0x48868a4e43954dab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->917503) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d0c expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.136366:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054017664:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129820.136388:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b857600/0x48868a4e43954df1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d44 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.136396:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b857600/0x48868a4e43954df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d44 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129820.136542:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054017792:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129820.136553:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.136576:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054336768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2396us (2582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.136583:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7687 00010000:00010000:3.0:1746129820.136976:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857600, rc 0) 00000100:00100000:3.0:1746129820.137005:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054336640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2883us (2970us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129820.137011:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15400 00000100:00100000:0.0:1746129820.139157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.139233:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054336896 00000100:00100000:3.0:1746129820.139239:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054336896 00000100:00100000:3.0:1746129820.139267:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15401 00000100:00100000:3.0:1746129820.139277:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054336896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.139291:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.139303:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135d5d800/0x48868a4e43954df8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d4b expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.139321:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.139329:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135d5d800/0x48868a4e43954df8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d4b expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.139336:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135d5d800/0x48868a4e43954df8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d4b expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.139341:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5d800, rc 0) 00000100:00100000:3.0:1746129820.139372:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054336896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 96us (221us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129820.139376:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15401 00000100:00100000:0.0:1746129820.140541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.140581:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054337152 00000100:00100000:3.0:1746129820.140586:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054337152 00002000:00100000:3.0:1746129820.140608:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012b027b80 x1830949054337152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.140617:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027b80 with x1830949054337152 ext(0->1048575) 00010000:00010000:3.0:1746129820.140623:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.140633:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.140638:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b027b80 00000100:00100000:3.0:1746129820.140663:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1859 00000100:00100000:3.0:1746129820.140669:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054337152:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129820.141215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.141365:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054337408 00000100:00100000:2.0:1746129820.141369:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054337408 00002000:00100000:2.0:1746129820.141388:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012b8e6300 x1830949054337408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.141396:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6300 with x1830949054337408 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.141403:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6300 00000100:00100000:2.0:1746129820.141425:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6886 00000100:00100000:2.0:1746129820.141430:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054337408:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.154464:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054337152:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13787us (13918us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.154475:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1859 00002000:00100000:3.0:1746129820.154485:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012b027b80 x1830949054337152/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.154494:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027b80 with x1830949054337152 ext(0->1048575) 00010000:00010000:3.0:1746129820.154502:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.154515:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.154522:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b027b80 00000100:00100000:2.0:1746129820.155430:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054337408:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13997us (14213us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.155438:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6886 00002000:00100000:2.0:1746129820.155443:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012b8e6300 x1830949054337408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.155450:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6300 with x1830949054337408 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.155454:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6300 00000100:00100000:0.0:1746129820.162997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.163094:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054337536 00000100:00100000:1.0:1746129820.163101:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054337536 00010000:00010000:1.0:1746129820.163131:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.163290:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7688 00000100:00100000:1.0:1746129820.163297:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054337536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.163309:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.163327:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.163342:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.163360:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b857000/0x48868a4e43954ddc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d2f expref: 28 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.163386:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.163388:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.163394:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.163400:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.163426:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.163437:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054017920:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129820.163512:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b19ce6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.164924:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054017920:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129820.164939:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129820.164961:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.164971:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054337536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1675us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.164978:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7688 00000100:00100000:3.0:1746129820.165049:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054337792 00000100:00100000:3.0:1746129820.165054:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054337792 00002000:00100000:3.0:1746129820.165085:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (843776->847871) req@ffff88012b027800 x1830949054337792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.165094:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027800 with x1830949054337792 ext(843776->847871) 00002000:00010000:3.0:1746129820.165097:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b027800 00000100:00100000:3.0:1746129820.165121:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6887 00000100:00100000:3.0:1746129820.165127:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054337792:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.165259:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054337792:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 132us (298us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.165264:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6887 00002000:00100000:3.0:1746129820.165269:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (843776->847871) req@ffff88012b027800 x1830949054337792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.165275:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027800 with x1830949054337792 ext(843776->847871) 00002000:00010000:3.0:1746129820.165277:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b027800 00000100:00100000:2.0:1746129820.165457:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.165675:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054337920 00000100:00100000:3.0:1746129820.165679:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054337920 00000100:00100000:3.0:1746129820.165801:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15402 00000100:00100000:3.0:1746129820.165807:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31548:x1830949054337920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.165816:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.165827:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d52 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.165863:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.165870:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.165871:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.165874:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 36 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.165894:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.165904:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 19 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.165913:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054018048:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.166788:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.167290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.167473:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338048 00000100:00100000:2.0:1746129820.167477:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338048 00000100:00100000:2.0:1746129820.167498:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15403 00000100:00100000:2.0:1746129820.167504:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31539:x1830949054338048:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.167512:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.167522:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d59 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.167539:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.167550:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.167556:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 38 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.167561:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.167563:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.167565:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1691647] (req 1048576->1691647) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.167582:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 38 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.167590:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 38 pid: 8436 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.167597:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018176:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.168284:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.168294:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 11 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.168303:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018304:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.168332:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.168340:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 19 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.168347:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018432:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.168363:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.168692:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054018048:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.168708:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 38 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.168722:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135d5dc00, rc 0) 00000100:00100000:3.0:1746129820.168743:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31548:x1830949054337920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2935us (3285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.168749:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15402 00000100:00100000:0.0:1746129820.169194:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.169261:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338176 00000100:00100000:2.0:1746129820.169265:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338176 00002000:00100000:2.0:1746129820.169287:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1273856->1622015) req@ffff88012b025c00 x1830949054338176/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.169294:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025c00 with x1830949054338176 ext(1273856->1622015) 00010000:00010000:2.0:1746129820.169300:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 20 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.169308:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 20 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746129820.169314:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b025c00 00000100:00100000:2.0:1746129820.169641:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1860 00000100:00100000:2.0:1746129820.169648:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054338176:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129820.169971:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018176:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.169978:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018304:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.169984:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018432:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.169998:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1691647] (req 1048576->1691647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.170007:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857600, rc 0) 00000100:00100000:2.0:1746129820.170022:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31539:x1830949054338048:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2519us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.170027:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15403 00000100:00100000:0.0:1746129820.170954:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.171000:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338432 00000100:00100000:1.0:1746129820.171004:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338432 00000100:00100000:0.0:1746129820.171009:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129820.171019:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 37 pid: 8436 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.171031:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338304 00000100:00100000:1.0:1746129820.171032:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338304 00010000:00010000:1.0:1746129820.171037:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 12 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746129820.171042:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7689 00000100:00100000:1.0:1746129820.171061:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7690 00000100:00100000:1.0:1746129820.171065:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054338304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.171072:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.171082:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 12 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.171088:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 12 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.171101:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1aa200/0x48868a4e43954cee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ca3 expref: 12 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.171119:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.171144:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054338304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.171149:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7690 00000100:00100000:0.0:1746129820.171399:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1964:x1830949054338432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129820.171407:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129820.171416:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 37 pid: 8436 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746129820.171424:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 37 pid: 8436 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746129820.171435:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e800/0x48868a4e43954c93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c80 expref: 37 pid: 8436 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746129820.171543:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129820.171559:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054338432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 511us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.171564:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7689 00000100:00100000:0.0:1746129820.173323:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.173392:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338560 00000100:00100000:2.0:1746129820.173398:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338560 00010000:00010000:2.0:1746129820.173417:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 22 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.173436:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7691 00000100:00100000:2.0:1746129820.173441:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054338560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.173449:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.173460:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 22 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.173468:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 22 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.173482:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954c62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c56 expref: 22 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.173999:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.174002:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.174009:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.174017:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.174043:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.174054:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054018560:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129820.174102:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.176657:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054018560:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129820.176673:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.176706:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054338560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3264us (3386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.176714:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7691 00000100:00100000:3.0:1746129820.176775:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054338176:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7126us (7580us total) trans 17179874106 rc 0/0 00000100:00100000:3.0:1746129820.176794:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1860 00002000:00100000:3.0:1746129820.176802:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1273856->1622015) req@ffff88012b025c00 x1830949054338176/t17179874106(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.176810:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025c00 with x1830949054338176 ext(1273856->1622015) 00010000:00010000:3.0:1746129820.176818:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 21 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.176829:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 21 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.176834:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b025c00 00000100:00100000:0.0:1746129820.182161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.183724:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338816 00000100:00100000:3.0:1746129820.183732:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338816 00002000:00100000:3.0:1746129820.183769:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1687552->1691647) req@ffff88012b027100 x1830949054338816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.183779:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027100 with x1830949054338816 ext(1687552->1691647) 00002000:00010000:3.0:1746129820.183783:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b027100 00000100:00100000:3.0:1746129820.183811:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6888 00000100:00100000:3.0:1746129820.183819:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054338816:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.183972:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054338816:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (1817us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.183978:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6888 00002000:00100000:3.0:1746129820.183983:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1687552->1691647) req@ffff88012b027100 x1830949054338816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.183990:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b027100 with x1830949054338816 ext(1687552->1691647) 00002000:00010000:3.0:1746129820.183992:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b027100 00000100:00100000:0.0:1746129820.184015:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.184236:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054338944 00000100:00100000:3.0:1746129820.184239:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054338944 00010000:00010000:3.0:1746129820.184256:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 21 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.184422:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7692 00000100:00100000:3.0:1746129820.184428:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054338944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.184436:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.184449:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 21 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.184459:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 21 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.184828:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43f600/0x48868a4e43954c8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1273856->1622015) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c72 expref: 21 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.184873:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.184875:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.184881:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.184888:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.184913:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.184923:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054018688:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.185287:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.186269:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.186313:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.186371:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339328 00000100:00100000:1.0:1746129820.186377:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339328 00000100:00100000:3.0:1746129820.186384:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339072 00000100:00100000:3.0:1746129820.186387:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339072 00000100:00100000:1.0:1746129820.186487:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4596 00000100:00100000:1.0:1746129820.186495:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31539:x1830949054339328:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129820.186502:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11013 00000100:00100000:3.0:1746129820.186507:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31550:x1830949054339072:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129820.186518:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.186530:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69800/0x48868a4e43954e0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d60 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.186564:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186573:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186585:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186595:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186599:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186604:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129820.186640:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:31539:x1830949054339328:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 146us (326us total) trans 8589945012 rc 0/0 00000100:00100000:1.0:1746129820.186645:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4596 00010000:00010000:3.0:1746129820.186681:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186688:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186693:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129820.186709:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129820.186713:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129820.186722:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186728:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186734:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186738:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186746:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186750:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa69a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.186753:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186758:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00000100:00080000:2.0:1746129820.186766:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129820.186767:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129820.186769:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.186772:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186776:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69a00/0x48868a4e43954e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186785:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186789:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186792:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186796:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa69c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.186798:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186802:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186810:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49200) 00010000:00010000:3.0:1746129820.186812:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.186814:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186818:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69c00/0x48868a4e43954e1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129820.186835:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69800/0x48868a4e43954e0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d60 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.186844:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d60 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.186870:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.186872:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129820.186874:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa69e00, rc 0) 00000100:00100000:3.0:1746129820.186907:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:31550:x1830949054339072:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 399us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.186912:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11013 00000100:00100000:0.0:1746129820.191485:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.191513:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.191524:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.191535:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.191552:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339584 00000100:00100000:0.0:1746129820.191559:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339584 00000100:00100000:0.0:1746129820.191587:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339712 00000100:00100000:0.0:1746129820.191589:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339712 00000100:00100000:2.0:1746129820.191878:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339840 00000100:00100000:1.0:1746129820.191878:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339456 00000100:00100000:2.0:1746129820.191881:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339840 00000100:00100000:1.0:1746129820.191881:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339456 00000100:00100000:1.0:1746129820.191906:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 729 00000100:00100000:1.0:1746129820.191913:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054339456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.191926:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.191945:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69e00/0x48868a4e43954e22 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d60 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.191958:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.191962:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.191970:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15404 00000100:00100000:2.0:1746129820.191975:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054339584:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129820.191985:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.191996:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b857e00/0x48868a4e43954e29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d67 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.191996:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949054339456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.192001:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 729 00000100:00100000:2.0:1746129820.192032:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054018816:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129820.192079:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.192095:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15405 00000100:00100000:2.0:1746129820.192099:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054339712:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129820.192106:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.192113:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b857a00/0x48868a4e43954e30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d6e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.192144:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018944:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129820.192163:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.192237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.192255:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054339968 00000100:00100000:1.0:1746129820.192258:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054339968 00000100:00100000:1.0:1746129820.192273:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15406 00000100:00100000:1.0:1746129820.192278:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054339840:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129820.192283:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.192289:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d75 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.192298:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.192300:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.192306:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.192317:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.192324:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec400, rc 0) 00000100:00100000:1.0:1746129820.192340:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1961:x1830949054339840:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 62us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.192344:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15406 00000100:00100000:1.0:1746129820.192353:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15407 00000100:00100000:1.0:1746129820.192357:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054339968:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129820.192361:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.192366:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d7c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.192377:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.192379:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.192382:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.192389:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.192395:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ece00, rc 0) 00000100:00100000:1.0:1746129820.192407:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054339968:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 49us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.192411:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15407 00000100:00100000:3.0:1746129820.192555:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054018688:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129820.192567:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.192583:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054338944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8155us (8569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.192589:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7692 00000100:00100000:0.0:1746129820.194393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.194822:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054340224 00000100:00100000:2.0:1746129820.194827:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054340224 00002000:00100000:2.0:1746129820.195065:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009bb2df80 x1830949054340224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.195073:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2df80 with x1830949054340224 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.195077:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2df80 00000100:00100000:2.0:1746129820.195090:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6889 00000100:00100000:2.0:1746129820.195097:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054340224:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.195111:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054018816:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129820.195230:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b857e00/0x48868a4e43954e29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d67 expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.195241:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b857e00/0x48868a4e43954e29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d67 expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.195250:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857e00, rc 0) 00000100:00100000:3.0:1746129820.195286:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054339584:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 3311us (3772us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129820.195292:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15404 00000100:00100000:0.0:1746129820.195915:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054018944:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129820.195930:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b857a00/0x48868a4e43954e30 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d6e expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.195940:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b857a00/0x48868a4e43954e30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d6e expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.195985:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b857a00, rc 0) 00000100:00100000:0.0:1746129820.196013:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054339712:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 3912us (4486us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129820.196022:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15405 00000100:00100000:2.0:1746129820.203611:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054340224:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8507us (9212us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.203622:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6889 00002000:00100000:2.0:1746129820.203631:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009bb2df80 x1830949054340224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.203640:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2df80 with x1830949054340224 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.203645:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb2df80 00000100:00100000:1.0:1746129820.203690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.203709:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054340480 00000100:00100000:3.0:1746129820.203716:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054340480 00000100:00100000:3.0:1746129820.203745:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11014 00000100:00100000:3.0:1746129820.203751:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31550:x1830949054340480:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129820.203764:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.203778:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69400/0x48868a4e43954e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d83 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.203869:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.203882:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.203889:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.203894:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.203904:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.203929:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.203938:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 24 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.203947:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054019072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.204013:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 300 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.204021:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 300 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.204028:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054019200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.204063:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.204071:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 17 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.204078:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054019328:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.204097:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00010000:00010000:1.0:1746129820.204969:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129820.207058:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.207175:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054019072:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.207186:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054019200:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129820.207435:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.207541:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054340736 00000100:00100000:1.0:1746129820.207547:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054340736 00010000:00010000:1.0:1746129820.207580:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 301 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.207600:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054340608 00000100:00100000:1.0:1746129820.207602:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054340608 00010000:00010000:1.0:1746129820.207612:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 25 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746129820.207742:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.207770:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054019328:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.207789:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129820.208092:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054340864 00000100:00100000:1.0:1746129820.208096:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054340864 00010000:00010000:1.0:1746129820.208109:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 18 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.208143:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7693 00000100:00100000:1.0:1746129820.208150:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:1962:x1830949054340736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.208160:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.208165:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 301 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208173:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 301 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208191:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fba00/0x48868a4e43954d7a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cfe expref: 301 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208201:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.208206:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208212:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208217:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.208250:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1962:x1830949054340736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 100us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.208256:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7693 00000100:00100000:1.0:1746129820.208269:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7694 00000100:00100000:1.0:1746129820.208272:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054340608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.208277:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.208281:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 25 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208287:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 25 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208296:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b857c00/0x48868a4e43954d9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d05 expref: 25 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208303:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.208305:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208309:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208313:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.208323:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054340608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.208327:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7694 00000100:00100000:1.0:1746129820.208333:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7695 00000100:00100000:1.0:1746129820.208336:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+18:1962:x1830949054340864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.208341:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.208343:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 18 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208350:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 18 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208361:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e43954d34 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cd4 expref: 18 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.208368:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.208370:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208376:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208381:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.208393:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.208402:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054340864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.208405:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7695 00010000:00010000:2.0:1746129820.209016:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.209023:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129820.209039:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129820.209160:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69400/0x48868a4e43954e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d83 expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.209180:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d83 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.209186:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.209188:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129820.209190:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa69600, rc 0) 00000100:00100000:2.0:1746129820.209221:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:31550:x1830949054340480:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 5470us (5532us total) trans 8589945013 rc 0/0 00000100:00100000:2.0:1746129820.209227:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11014 00000100:00100000:0.0:1746129820.211422:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.211501:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341120 00000100:00100000:2.0:1746129820.211507:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341120 00000100:00100000:2.0:1746129820.211539:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11015 00000100:00100000:2.0:1746129820.211545:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:31550:x1830949054341120:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129820.211563:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.211565:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129820.211585:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa69600/0x48868a4e43954e4c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d83 expref: 17 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.211596:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.211600:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129820.211609:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553000/0x48868a4e43954e5a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d8a expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.211676:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.211685:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.211692:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129820.211701:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129820.211781:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553000/0x48868a4e43954e5a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.211790:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 18 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.211796:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.211798:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129820.211799:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c553200, rc 0) 00000100:00100000:2.0:1746129820.212313:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+18:31550:x1830949054341120:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 767us (895us total) trans 8589945014 rc 0/0 00000100:00100000:2.0:1746129820.212319:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11015 00000100:00100000:0.0:1746129820.214061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.214148:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341248 00000100:00100000:2.0:1746129820.214154:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341248 00000100:00100000:2.0:1746129820.214182:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11016 00000100:00100000:2.0:1746129820.214188:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+18:31550:x1830949054341248:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129820.214203:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.214216:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553400/0x48868a4e43954e6f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d91 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.214258:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553400/0x48868a4e43954e6f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d91 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.214268:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553400/0x48868a4e43954e6f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d91 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.214282:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.214284:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129820.214286:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c553400, rc 0) 00000100:00100000:2.0:1746129820.214484:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:31550:x1830949054341248:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 295us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.214490:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11016 00000100:00100000:0.0:1746129820.216545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.216575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.216630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.216684:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341376 00000100:00100000:3.0:1746129820.216690:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341376 00000100:00100000:3.0:1746129820.216718:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341632 00000100:00100000:3.0:1746129820.216720:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341632 00000100:00100000:3.0:1746129820.216741:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341888 00000100:00100000:3.0:1746129820.216743:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341888 00000100:00100000:3.0:1746129820.216760:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15408 00000100:00100000:3.0:1746129820.216766:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054341376:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129820.216796:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.216809:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.216816:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.216818:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.216820:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.216845:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.216873:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 26 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.216884:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054019456:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.216936:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.216951:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15409 00000100:00100000:3.0:1746129820.216955:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054341632:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129820.216970:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.216979:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.216985:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.216989:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.216990:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.216992:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.217002:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.217008:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 13 pid: 8435 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.217015:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054019584:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.217034:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.217040:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 35 pid: 10930 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.217046:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054019712:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.217055:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.217099:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15410 00000100:00100000:2.0:1746129820.217105:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054341888:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129820.217117:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217125:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217131:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.217148:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.217157:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.217159:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.217161:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217173:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.217179:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.217186:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054019840:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.217206:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 14 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.217211:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 14 pid: 1140 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.217217:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054019968:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.217229:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217235:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 26 pid: 8435 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.217245:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054020096:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.217253:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d6f29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.217722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.217885:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341504 00000100:00100000:2.0:1746129820.217888:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341504 00000100:00100000:2.0:1746129820.217905:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15411 00000100:00100000:2.0:1746129820.217909:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054341504:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129820.217922:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217931:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217935:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.217936:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.217938:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217950:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 35 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.217956:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 35 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.217963:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054020224:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.217985:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.219340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.219373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.219593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.219633:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.219677:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054342272 00000100:00100000:0.0:1746129820.219681:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054342272 00002000:00100000:0.0:1746129820.219708:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095242d80 x1830949054342272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.219717:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949054342272 ext(2097152->3145727) 00002000:00010000:0.0:1746129820.219721:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242d80 00000100:00100000:0.0:1746129820.219736:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054342528 00000100:00100000:0.0:1746129820.219739:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054342528 00002000:00100000:0.0:1746129820.219750:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (843776->1048575) req@ffff880095240380 x1830949054342528/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.219756:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949054342528 ext(843776->1048575) 00010000:00010000:0.0:1746129820.219761:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.219770:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746129820.219776:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095240380 00000100:00100000:2.0:1746129820.219831:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054020224:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.219866:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.219882:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054341760 00000100:00100000:2.0:1746129820.219884:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054341760 00000100:00100000:2.0:1746129820.219899:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054342016 00000100:00100000:2.0:1746129820.219900:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054342016 00000100:00100000:2.0:1746129820.219913:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15412 00000100:00100000:2.0:1746129820.219918:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054341760:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129820.219939:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.219950:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.219957:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.219963:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.219968:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.219969:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.219971:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.219989:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.219999:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 23 pid: 4589 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.220009:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054020352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.220085:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054019456:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.220097:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.220302:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15413 00000100:00100000:1.0:1746129820.220318:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054342016:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129820.220334:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.220346:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.220353:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.220364:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 36 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.220368:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.220370:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.220371:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.220389:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 36 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.220396:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 36 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.220404:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054020480:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129820.220756:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1861 00000100:00100000:0.0:1746129820.220762:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054342528:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129820.220787:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1862 00000100:00100000:3.0:1746129820.220793:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054342272:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:2.0:1746129820.220879:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.220888:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.220895:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054020608:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.220954:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.220962:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 15 pid: 8435 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.220970:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054020736:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.220993:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.221005:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 19 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.221013:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054020864:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.221028:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a840e300 going to sleep for 11 seconds 00010000:00010000:2.0:1746129820.221730:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 28 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.221739:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 28 pid: 8437 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.221747:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054020992:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.221765:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.221789:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054020096:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129820.223936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.225162:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.225181:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.225226:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054020352:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.225246:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054019840:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.225253:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054019968:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.225278:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.225413:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054342656 00000100:00100000:1.0:1746129820.225419:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054342656 00002000:00100000:1.0:1746129820.225451:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880095243100 x1830949054342656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.225459:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243100 with x1830949054342656 ext(3145728->4194303) 00010000:00010000:1.0:1746129820.225466:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 38 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.225475:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 38 pid: 7976 timeout: 866 lvb_type: 1 00002000:00010000:1.0:1746129820.225480:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095243100 00000100:00100000:1.0:1746129820.225506:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054342784 00000100:00100000:1.0:1746129820.225509:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054342784 00002000:00100000:1.0:1746129820.225521:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1691647) req@ffff8800a00c7800 x1830949054342784/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.225527:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7800 with x1830949054342784 ext(1048576->1691647) 00010000:00010000:1.0:1746129820.225532:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 39 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.225543:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 39 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746129820.225548:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a00c7800 00000100:00100000:1.0:1746129820.225559:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1863 00000100:00100000:1.0:1746129820.225564:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054342656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129820.226585:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054020480:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.226594:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054020736:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.226602:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054020864:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.226614:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.229223:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1864 00000100:00100000:2.0:1746129820.229238:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054342784:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129820.231958:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054019584:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.231970:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054019712:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.231990:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.232022:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054342912 00000100:00100000:3.0:1746129820.232026:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054342912 00010000:00010000:3.0:1746129820.232051:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 16 pid: 8435 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.232088:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7696 00000100:00100000:3.0:1746129820.232095:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949054342912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.232105:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.232121:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 16 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.232131:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 16 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.232165:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919ec400/0x48868a4e43954e37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d75 expref: 16 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.232181:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.232216:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054342912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 122us (7034us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.232222:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7696 00000100:00100000:0.0:1746129820.232725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.234452:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.235635:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054342528:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14868us (15996us total) trans 21474841301 rc 0/0 00000100:00100000:0.0:1746129820.235647:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1861 00002000:00100000:0.0:1746129820.235656:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (843776->1048575) req@ffff880095240380 x1830949054342528/t21474841301(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.235665:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240380 with x1830949054342528 ext(843776->1048575) 00010000:00010000:0.0:1746129820.235673:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.235684:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746129820.235691:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095240380 00000100:00100000:1.0:1746129820.235836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.235928:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343168 00000100:00100000:3.0:1746129820.235935:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343168 00010000:00010000:3.0:1746129820.235957:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 16 pid: 1140 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.235974:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343040 00000100:00100000:3.0:1746129820.235976:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343040 00010000:00010000:3.0:1746129820.235985:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 42 pid: 10930 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.235997:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7697 00000100:00100000:3.0:1746129820.236002:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1963:x1830949054343168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.236014:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.236027:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 16 pid: 1140 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.236035:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 16 pid: 1140 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.236051:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009189e200/0x48868a4e43954d03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb8 expref: 16 pid: 1140 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.236062:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.236081:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1963:x1830949054343168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 79us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.236086:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7697 00000100:00100000:3.0:1746129820.236098:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7698 00000100:00100000:3.0:1746129820.236102:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1963:x1830949054343040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.236107:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.236118:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 42 pid: 10930 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.236125:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 42 pid: 10930 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.236145:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135d5dc00/0x48868a4e43954dff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d52 expref: 42 pid: 10930 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.236157:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.236158:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.236162:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236169:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236188:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.236204:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949054343040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.236209:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7698 00010000:00010000:3.0:1746129820.236225:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236231:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236245:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236252:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236258:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236267:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e1cc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129820.236270:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236277:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236287:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.236292:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e1cc00/0x48868a4e43954e7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.236326:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054341632:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 19370us (19750us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.236333:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15409 00000100:00100000:1.0:1746129820.236477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.236492:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343296 00000100:00100000:1.0:1746129820.236495:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343296 00010000:00010000:1.0:1746129820.236510:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 24 pid: 4589 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.236523:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343424 00000100:00100000:1.0:1746129820.236524:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343424 00010000:00010000:1.0:1746129820.236532:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 14 pid: 8435 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.236546:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7699 00000100:00100000:1.0:1746129820.236551:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054343296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.236557:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.236566:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 24 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.236574:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 24 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.236585:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff98000/0x48868a4e43954b9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355bbc expref: 24 pid: 4589 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.236598:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.236615:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054343296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 64us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.236620:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7699 00000100:00100000:1.0:1746129820.236629:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7700 00000100:00100000:1.0:1746129820.236633:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1964:x1830949054343424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.236639:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.236646:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 14 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.236654:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 14 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.236668:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919ece00/0x48868a4e43954e3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d7c expref: 14 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.236675:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.236687:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1964:x1830949054343424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.236691:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7700 00000100:00100000:1.0:1746129820.239551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.241151:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343552 00000100:00100000:0.0:1746129820.241160:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343552 00010000:00010000:0.0:1746129820.241188:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 29 pid: 8435 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.241946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.242017:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054020608:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129820.242615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.242631:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343680 00000100:00100000:2.0:1746129820.242635:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343680 00010000:00010000:2.0:1746129820.242651:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.242675:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7701 00000100:00100000:2.0:1746129820.242682:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054343552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.242694:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.242713:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 29 pid: 8435 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.242722:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 29 pid: 8435 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.242740:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6fa00/0x48868a4e43954c31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c33 expref: 29 pid: 8435 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.242759:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.242792:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054343552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 111us (3248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.242798:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7701 00000100:00100000:2.0:1746129820.242811:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7702 00000100:00100000:2.0:1746129820.242816:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1961:x1830949054343680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.242821:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.242829:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.242837:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.242862:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f9fa400/0x48868a4e43954cfc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cb1 expref: 15 pid: 4589 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.242870:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.242883:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054343680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.242888:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7702 00000100:00100000:2.0:1746129820.242933:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054020992:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.242954:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.243331:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343808 00000100:00100000:1.0:1746129820.243335:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343808 00010000:00010000:1.0:1746129820.243349:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 28 pid: 8437 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.243365:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7703 00000100:00100000:1.0:1746129820.243370:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054343808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.243376:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.243385:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 28 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.243392:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 28 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.243403:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0a00/0x48868a4e43954b58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355b8b expref: 28 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.243412:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.243414:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.243417:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.243424:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.243440:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.243455:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054343808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.243460:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7703 00000100:00100000:1.0:1746129820.243729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.243740:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054343936 00000100:00100000:1.0:1746129820.243743:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054343936 00010000:00010000:1.0:1746129820.243753:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.243766:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7704 00000100:00100000:1.0:1746129820.243771:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054343936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.243777:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.243783:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.243790:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.243805:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb6f000/0x48868a4e43954c54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c4f expref: 23 pid: 8435 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.243813:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.243814:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.243817:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.243822:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.243833:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.243861:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054343936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.243866:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7704 00000100:00100000:1.0:1746129820.243890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.243899:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054344064 00000100:00100000:1.0:1746129820.243901:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054344064 00010000:00010000:1.0:1746129820.243911:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 20 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.243924:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7705 00000100:00100000:1.0:1746129820.243929:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054344064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.243935:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.243943:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 20 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.243955:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 20 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.243965:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e1abe00/0x48868a4e43954d5e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355cf7 expref: 20 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.243973:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.243987:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054344064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.243991:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7705 00000100:00100000:1.0:1746129820.244231:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054342656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18666us (20301us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.244238:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1863 00002000:00100000:1.0:1746129820.244245:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880095243100 x1830949054342656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.244253:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243100 with x1830949054342656 ext(3145728->4194303) 00010000:00010000:1.0:1746129820.244258:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 39 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746129820.244267:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 39 pid: 7976 timeout: 866 lvb_type: 1 00002000:00010000:1.0:1746129820.244272:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095243100 00000100:00100000:1.0:1746129820.244323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.244334:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054344192 00000100:00100000:1.0:1746129820.244337:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054344192 00010000:00010000:1.0:1746129820.244347:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.244360:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7706 00000100:00100000:1.0:1746129820.244364:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054344192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.244369:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.244378:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.244385:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.244395:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b856c00/0x48868a4e43954dea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 843776->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d3d expref: 27 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.244402:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.244403:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.244405:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.244411:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.244422:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.244436:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054344192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.244444:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7706 00010000:00010000:3.0:1746129820.244556:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244564:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244580:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244586:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244592:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244598:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e1c600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129820.244601:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244607:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244616:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.244620:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e1c600/0x48868a4e43954e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.244655:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054341376:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 27890us (28116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.244661:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15408 00000100:00100000:3.0:1746129820.244956:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054342272:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24163us (25363us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.244962:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1862 00002000:00100000:3.0:1746129820.244967:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095242d80 x1830949054342272/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.244974:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242d80 with x1830949054342272 ext(2097152->3145727) 00010000:00010000:3.0:1746129820.244979:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.244986:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 866 lvb_type: 1 00002000:00010000:3.0:1746129820.244990:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095242d80 00010000:00010000:2.0:1746129820.245210:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245217:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245230:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245234:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245239:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245244:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c553000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129820.245246:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245251:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245259:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245263:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c553000/0x48868a4e43954e92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.245290:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054341760:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 25372us (25954us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.245296:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15412 00010000:00010000:2.0:1746129820.245312:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245318:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245328:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245332:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245338:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245342:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c552e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129820.245344:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245349:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245355:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.245361:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43954e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.245384:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054341888:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 28280us (28754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.245389:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15410 00000100:00100000:0.0:1746129820.249218:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.249547:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054344320 00000100:00100000:3.0:1746129820.249554:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054344320 00000100:00100000:3.0:1746129820.249585:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15414 00000100:00100000:3.0:1746129820.249591:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31548:x1830949054344320:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.249604:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.249620:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d98 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129820.249638:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d39c, atime: 0x6813d39b, ctime: 0x6813d39c, blocks: 0x15e5 00010000:00010000:3.0:1746129820.249653:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.249655:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.249662:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.249674:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.249682:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e1ce00, rc 0) 00000100:00100000:2.0:1746129820.249825:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054342784:12345-192.168.204.31@tcp:4:cat.0 Request processed in 20592us (24665us total) trans 17179874107 rc 0/0 00000100:00100000:2.0:1746129820.249834:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1864 00002000:00100000:2.0:1746129820.249841:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1691647) req@ffff8800a00c7800 x1830949054342784/t17179874107(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.249864:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7800 with x1830949054342784 ext(1048576->1691647) 00010000:00010000:2.0:1746129820.249871:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 37 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.249881:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 37 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746129820.249888:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a00c7800 00000100:00100000:3.0:1746129820.250084:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31548:x1830949054344320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 491us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.250092:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15414 00000100:00100000:0.0:1746129820.252608:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.252685:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054344448 00000100:00100000:2.0:1746129820.252691:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054344448 00010000:00010000:2.0:1746129820.252713:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.252734:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7707 00000100:00100000:2.0:1746129820.252740:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054344448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.252750:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.252765:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.252773:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.252791:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954dd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d28 expref: 37 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.252799:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.252801:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.252805:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.252811:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.252839:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129820.252995:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253003:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253019:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253025:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253031:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253036:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129820.253039:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253044:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253053:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.253058:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919ed000/0x48868a4e43954e99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.253094:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054342016:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 32780us (33719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.253100:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15413 00000100:00100000:2.0:1746129820.253907:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054344448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1165us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.253911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.253913:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7707 00000100:00100000:2.0:1746129820.253926:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054344576 00000100:00100000:2.0:1746129820.253929:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054344576 00010000:00010000:2.0:1746129820.253939:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 36 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.253973:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7708 00000100:00100000:2.0:1746129820.253978:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054344576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.253984:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.253992:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 36 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.254000:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 36 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.254010:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b857600/0x48868a4e43954e06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1691647) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d59 expref: 36 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.254018:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.254019:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.254022:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.254027:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.254045:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.254064:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054344576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.254069:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7708 00010000:00010000:3.0:1746129820.254227:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254234:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254246:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254252:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254258:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254263:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c552800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129820.254265:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254271:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254280:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.254285:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43954e8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.254323:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054341504:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 36413us (36601us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.254329:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15411 00000100:00100000:0.0:1746129820.257293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.257341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.257342:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345088 00000100:00100000:2.0:1746129820.257349:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345088 00000100:00100000:3.0:1746129820.257391:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054344832 00000100:00100000:3.0:1746129820.257394:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054344832 00002000:00100000:3.0:1746129820.257425:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a645ea00 x1830949054344832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.257434:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949054344832 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.257438:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645ea00 00000100:00100000:3.0:1746129820.257452:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6891 00000100:00100000:3.0:1746129820.257457:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054344832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.258347:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11017 00000100:00100000:2.0:1746129820.258352:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+19:31550:x1830949054345088:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:2.0:1746129820.258382:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.258402:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553400/0x48868a4e43954e6f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d91 expref: 19 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258415:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.258419:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129820.258438:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.258448:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258455:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 23 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258461:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 23 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258467:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258473:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 299 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258479:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.258506:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 299 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.258516:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 299 pid: 14313 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.258526:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021120:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.260174:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.260186:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 299 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.260196:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021248:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.260247:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 23 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.260254:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 23 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.260261:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021376:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.260284:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 23 pid: 14314 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.260290:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 23 pid: 14314 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.260301:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021504:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.260322:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.260328:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 299 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.260335:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021632:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.260351:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1942d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.264475:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.264543:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345216 00000100:00100000:1.0:1746129820.264551:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345216 00000100:00100000:2.0:1746129820.264573:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021120:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129820.264579:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 300 pid: 14313 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.264602:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7709 00000100:00100000:1.0:1746129820.264608:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949054345216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.264620:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.264625:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 300 pid: 14313 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.264646:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 300 pid: 14313 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.264666:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954a0f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355aea expref: 300 pid: 14313 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.264678:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.264682:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.264690:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.264725:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1961:x1830949054345216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.264734:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7709 00000100:00100000:2.0:1746129820.268772:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021248:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.268885:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054344832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11425us (11541us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.268895:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6891 00002000:00100000:3.0:1746129820.268904:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a645ea00 x1830949054344832/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.268912:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ea00 with x1830949054344832 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.268917:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645ea00 00000100:00100000:0.0:1746129820.269429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.269472:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345600 00000100:00100000:3.0:1746129820.269479:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345600 00000100:00100000:2.0:1746129820.269500:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.269508:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.269515:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054021632:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.269520:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4597 00000100:00100000:3.0:1746129820.269526:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:7658:x1830949054345600:12345-192.168.204.31@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746129820.269539:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129820.269699:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:7658:x1830949054345600:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 172us (271us total) trans 8589945015 rc 0/0 00000100:00100000:3.0:1746129820.269705:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4597 00000100:00100000:0.0:1746129820.270460:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.270488:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.270522:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.270715:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345344 00000100:00100000:1.0:1746129820.270719:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345344 00010000:00010000:1.0:1746129820.270738:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 299 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.270755:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345856 00000100:00100000:1.0:1746129820.270757:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345856 00010000:00010000:1.0:1746129820.270765:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 300 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746129820.270773:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345728 00000100:00100000:1.0:1746129820.270777:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7710 00000100:00100000:0.0:1746129820.270777:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345728 00000100:00100000:1.0:1746129820.270781:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949054345344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.270788:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129820.270790:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 25 pid: 14314 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.270792:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 300 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.270800:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 300 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746129820.270807:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7711 00000100:00100000:0.0:1746129820.270811:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949054345856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.270815:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f9fb000/0x48868a4e43954db9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d13 expref: 300 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.270817:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129820.270821:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 299 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.270825:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.270828:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.270835:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.270907:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7712 00000100:00100000:3.0:1746129820.270913:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054345728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.270919:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.270924:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 25 pid: 14314 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.271055:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 299 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.271067:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130a38e00/0x48868a4e43954880 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a11 expref: 299 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.271084:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129820.271087:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129820.271092:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129820.271097:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 25 pid: 14314 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.271110:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ff99800/0x48868a4e43954887 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355a1f expref: 25 pid: 14314 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746129820.271112:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1961:x1830949054345856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 300us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.271118:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7711 00010000:00010000:3.0:1746129820.271121:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.271124:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.271129:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.271161:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054345728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 248us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.271167:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7712 00000100:00100000:1.0:1746129820.271208:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1961:x1830949054345344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 425us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.271213:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7710 00000100:00100000:0.0:1746129820.284639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.284825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.284876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.284934:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054346112 00000100:00100000:2.0:1746129820.284941:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054346112 00010000:00010000:2.0:1746129820.284967:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 24 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.284989:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7713 00000100:00100000:2.0:1746129820.284994:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054346112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.285005:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.285010:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 24 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.285019:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 24 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.285035:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b43e600/0x48868a4e43954c3f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355c3a expref: 24 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.285050:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.285054:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.285060:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.285066:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.285080:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.285106:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054346112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.285111:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7713 00010000:00010000:2.0:1746129820.285144:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.285149:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:2.0:1746129820.285609:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3506, 88 off295264 00000004:00080000:2.0:1746129820.285615:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343766462ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285645:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3513, 88 off295792 00000004:00080000:2.0:1746129820.285648:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343800372ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285656:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3514, 88 off295880 00000004:00080000:2.0:1746129820.285658:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343810092ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285663:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3507, 88 off295352 00000004:00080000:2.0:1746129820.285665:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343817280ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285670:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3508, 88 off295440 00000004:00080000:2.0:1746129820.285672:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343824184ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285677:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3515, 88 off295968 00000004:00080000:2.0:1746129820.285679:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343830872ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285683:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3516, 88 off296056 00000004:00080000:2.0:1746129820.285686:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343837855ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285691:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3517, 88 off296144 00000004:00080000:2.0:1746129820.285692:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343844607ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285697:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3509, 88 off295528 00000004:00080000:2.0:1746129820.285699:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343851120ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285704:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3518, 88 off296232 00000004:00080000:2.0:1746129820.285705:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343857674ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285710:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3510, 88 off295616 00000004:00080000:2.0:1746129820.285712:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343864492ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285717:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3519, 88 off296320 00000004:00080000:2.0:1746129820.285719:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343871080ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.285724:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3511, 88 off295704 00000004:00080000:2.0:1746129820.285725:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343877502ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285730:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3512, 88 off295792 00000004:00080000:2.0:1746129820.285732:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343883764ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285737:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3513, 88 off295880 00000004:00080000:2.0:1746129820.285739:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343891097ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285744:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3514, 88 off295968 00000004:00080000:2.0:1746129820.285745:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766343897647ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.285750:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3520, 88 off296408 00000004:00080000:2.0:1746129820.285752:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766343904062ns, next at 716792379979ns, rc = 0 00000100:00100000:3.0:1746129820.287387:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054345984 00000100:00100000:3.0:1746129820.287396:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054345984 00000100:00100000:1.0:1746129820.288801:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054346368 00000100:00100000:1.0:1746129820.288808:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054346368 00000100:00100000:1.0:1746129820.288843:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11018 00000100:00100000:1.0:1746129820.288867:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31556:x1830949054346368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129820.288886:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.288902:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec600/0x48868a4e43954eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355da6 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.288986:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.288998:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.289008:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.289021:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.289026:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.289031:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129820.293692:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15415 00000100:00100000:2.0:1746129820.293706:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31548:x1830949054345984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.293720:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.293737:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355d9f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129820.293756:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d39c, atime: 0x6813d39c, ctime: 0x6813d39c, blocks: 0x1029 00010000:00010000:2.0:1746129820.293772:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.293774:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.293780:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 36 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.293792:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 36 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.293800:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87400, rc 0) 00000100:00100000:2.0:1746129820.293843:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31548:x1830949054345984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 141us (9018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.293861:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15415 00000100:00100000:2.0:1746129820.295991:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.296089:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054346496 00000100:00100000:0.0:1746129820.296096:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054346496 00000100:00100000:0.0:1746129820.296126:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11019 00000100:00100000:0.0:1746129820.296142:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31548:x1830949054346496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.296155:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.296169:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dad expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.296208:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129820.296215:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 298 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.296227:0:15044:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129820.296235:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 298 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.296244:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129820.296246:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129820.296249:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 298 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.296258:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379600, rc 0) 00000100:00100000:0.0:1746129820.296299:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:31548:x1830949054346496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 166us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.296304:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11019 00000001:00080000:1.0:1746129820.316460:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945004 is committed 00000001:00080000:1.0:1746129820.316473:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589944992 is committed 00000001:00080000:1.0:1746129820.316478:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945012 is committed 00000001:00080000:1.0:1746129820.316484:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945010 is committed 00000001:00080000:1.0:1746129820.316507:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945016 is committed 00000004:00080000:1.0:1746129820.316515:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2687 committed 00000004:00080000:1.0:1746129820.316522:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746129820.316528:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2685 committed 00000004:00080000:1.0:1746129820.316529:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746129820.316531:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746129820.316532:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2686 committed 00000004:00080000:1.0:1746129820.316534:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746129820.316535:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2685 committed 00000004:00080000:1.0:1746129820.316536:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746129820.316538:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2684 committed 00000004:00080000:1.0:1746129820.316540:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2683 committed 00000004:00080000:1.0:1746129820.316541:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2682 committed 00000004:00080000:1.0:1746129820.316543:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746129820.316544:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2679 committed 00000004:00080000:1.0:1746129820.316545:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2681 committed 00000004:00080000:1.0:1746129820.316547:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2680 committed 00000004:00080000:1.0:1746129820.316548:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2678 committed 00000001:00080000:1.0:1746129820.316579:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945015 is committed 00000100:00100000:1.0:1746129820.316694:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054021888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129820.316743:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129820.316804:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054022400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129820.316819:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129820.316835:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129820.316839:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054022016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129820.316877:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129820.316895:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054022528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129820.316906:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129820.316926:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021888 00000100:00100000:1.0:1746129820.316931:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021888 00000100:00100000:1.0:1746129820.316967:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022400 00000100:00100000:1.0:1746129820.316968:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022400 00000100:00100000:1.0:1746129820.316976:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022016 00000100:00100000:1.0:1746129820.316978:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022016 00000100:00100000:1.0:1746129820.316984:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022528 00000100:00100000:1.0:1746129820.316986:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022528 00000100:00100000:1.0:1746129820.316995:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15416 00000100:00100000:1.0:1746129820.317000:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3298:x1830949054021888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129820.317153:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:3298:x1830949054021888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (410us total) trans 21474841302 rc 0/0 00000100:00100000:1.0:1746129820.317159:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15416 00000100:00100000:1.0:1746129820.317171:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15417 00000100:00100000:1.0:1746129820.317175:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3298:x1830949054022400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129820.317231:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:3298:x1830949054022400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (411us total) trans 21474841303 rc 0/0 00000100:00100000:1.0:1746129820.317235:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15417 00000100:00100000:1.0:1746129820.317242:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15418 00000100:00100000:1.0:1746129820.317245:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3298:x1830949054022016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129820.317296:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:1.0:1746129820.317299:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00002000:00010000:1.0:1746129820.317301:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:1.0:1746129820.317302:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00002000:00010000:1.0:1746129820.317304:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:1.0:1746129820.317317:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:3298:x1830949054022016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (439us total) trans 21474841304 rc 0/0 00000100:00100000:1.0:1746129820.317324:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15418 00000100:00100000:1.0:1746129820.317332:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15419 00000100:00100000:1.0:1746129820.317336:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+80:3298:x1830949054022528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129820.317388:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129820.317389:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129820.317391:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129820.317393:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129820.317394:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129820.317409:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:3298:x1830949054022528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (503us total) trans 21474841305 rc 0/0 00000100:00100000:1.0:1746129820.317414:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15419 00000004:00080000:1.0:1746129820.317449:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468d880/2, rc 0, transno 21474841304 00000100:00100000:1.0:1746129820.317456:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054022016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129820.317462:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faa0380/2, rc 0, transno 21474841305 00000100:00100000:1.0:1746129820.317464:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054022528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129820.317469:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468fb80/2, rc 0, transno 21474841302 00000100:00100000:1.0:1746129820.317472:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054021888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129820.317476:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468ca80/2, rc 0, transno 21474841303 00000100:00100000:1.0:1746129820.317478:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054022400:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746129820.317566:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a645f480 reply state ffff88009b836400 transno 8589945016 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129820.317575:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746129820.317658:0:14315:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129820.317668:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31550:x1830949054345088:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 59314us (60381us total) trans 8589945016 rc 0/0 00000100:00100000:3.0:1746129820.317673:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11017 00000100:00100000:3.0:1746129820.317689:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054021760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.317706:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.317715:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.317725:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.317730:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.317739:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.317747:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129820.317750:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.317759:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.317765:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.317774:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.317786:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054021760 00000100:00100000:3.0:1746129820.317788:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054021760 00000100:00100000:3.0:1746129820.317800:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022272 00000100:00100000:3.0:1746129820.317802:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022272 00000100:00100000:3.0:1746129820.317809:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022784 00000100:00100000:3.0:1746129820.317810:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022784 00000100:00100000:3.0:1746129820.317816:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022144 00000100:00100000:3.0:1746129820.317817:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022144 00000100:00100000:3.0:1746129820.317823:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054022656 00000100:00100000:3.0:1746129820.317824:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054022656 00000100:00100000:3.0:1746129820.317830:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15420 00000100:00100000:3.0:1746129820.317833:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830949054021760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.317926:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3297:x1830949054021760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (219us total) trans 21474841306 rc 0/0 00000100:00100000:3.0:1746129820.317933:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15420 00000100:00100000:3.0:1746129820.317943:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15421 00000100:00100000:3.0:1746129820.317947:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830949054022272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.318005:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3297:x1830949054022272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (278us total) trans 21474841307 rc 0/0 00000100:00100000:3.0:1746129820.318009:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15421 00000100:00100000:3.0:1746129820.318016:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15422 00000100:00100000:3.0:1746129820.318020:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830949054022784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.318083:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3297:x1830949054022784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (343us total) trans 21474841308 rc 0/0 00000100:00100000:3.0:1746129820.318088:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15422 00000100:00100000:3.0:1746129820.318096:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15423 00000100:00100000:3.0:1746129820.318100:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830949054022144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.318174:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3297:x1830949054022144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (413us total) trans 21474841309 rc 0/0 00000100:00100000:3.0:1746129820.318178:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15423 00000100:00100000:3.0:1746129820.318187:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15424 00000100:00100000:3.0:1746129820.318190:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3297:x1830949054022656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.318255:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3297:x1830949054022656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (479us total) trans 21474841310 rc 0/0 00000100:00100000:3.0:1746129820.318259:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15424 00010000:00010000:3.0:1746129820.318349:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.318357:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.318364:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.318369:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b08e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.318372:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.318378:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.318391:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.318393:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129820.318397:0:3282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.318405:0:3282:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.318412:0:3282:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.318430:0:3282:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.318438:0:3282:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3282:1830949054022912:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.318478:0:3282:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000004:00080000:3.0:1746129820.318520:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468ea00/2, rc 0, transno 21474841309 00000100:00100000:3.0:1746129820.318524:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129820.318529:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faa0700/2, rc 0, transno 21474841310 00000100:00100000:3.0:1746129820.318531:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129820.318536:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468f100/2, rc 0, transno 21474841306 00000100:00100000:3.0:1746129820.318538:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054021760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129820.318542:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009468e680/2, rc 0, transno 21474841307 00000100:00100000:3.0:1746129820.318544:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009468e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129820.318548:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009faa2d80/2, rc 0, transno 21474841308 00000100:00100000:3.0:1746129820.318550:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054022784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.319152:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023296:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319175:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.319189:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319201:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.319212:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129820.319216:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319229:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.319238:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319249:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.319267:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023296 00000100:00100000:2.0:1746129820.319271:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023296 00000100:00100000:2.0:1746129820.319284:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023808 00000100:00100000:2.0:1746129820.319285:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023808 00000100:00100000:2.0:1746129820.319290:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023424 00000100:00100000:2.0:1746129820.319291:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023424 00000100:00100000:2.0:1746129820.319296:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023936 00000100:00100000:2.0:1746129820.319298:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023936 00000100:00100000:2.0:1746129820.319304:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15425 00000100:00100000:2.0:1746129820.319309:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3296:x1830949054023296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129820.319402:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129820.319404:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00002000:00010000:2.0:1746129820.319406:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129820 -> 1746129820 00002000:00010000:2.0:1746129820.319408:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00002000:00010000:2.0:1746129820.319409:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129820.319428:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3296:x1830949054023296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (252us total) trans 17179874108 rc 0/0 00000100:00100000:2.0:1746129820.319432:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15425 00000100:00100000:2.0:1746129820.319443:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15426 00000100:00100000:2.0:1746129820.319447:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3296:x1830949054023808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319513:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3296:x1830949054023808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (310us total) trans 17179874109 rc 0/0 00000100:00100000:2.0:1746129820.319517:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15426 00000100:00100000:2.0:1746129820.319525:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15427 00000100:00100000:2.0:1746129820.319528:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3296:x1830949054023424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319584:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3296:x1830949054023424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (354us total) trans 17179874110 rc 0/0 00000100:00100000:2.0:1746129820.319588:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15427 00000100:00100000:2.0:1746129820.319595:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15428 00000100:00100000:2.0:1746129820.319598:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3296:x1830949054023936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.319653:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3296:x1830949054023936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (402us total) trans 17179874111 rc 0/0 00000100:00100000:2.0:1746129820.319657:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15428 00000004:00080000:2.0:1746129820.319685:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba86300/2, rc 0, transno 17179874110 00000100:00100000:2.0:1746129820.319688:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.319693:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b024700/2, rc 0, transno 17179874111 00000100:00100000:2.0:1746129820.319695:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023936:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.319700:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85f80/2, rc 0, transno 17179874108 00000100:00100000:2.0:1746129820.319702:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023296:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.319707:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b025f80/2, rc 0, transno 17179874109 00000100:00100000:2.0:1746129820.319709:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054023808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.319869:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.319893:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.319907:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.319918:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.319928:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129820.319931:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.319941:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.319950:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.319962:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.319976:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023040 00000100:00100000:0.0:1746129820.319979:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023040 00000100:00100000:0.0:1746129820.319992:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023552 00000100:00100000:0.0:1746129820.319994:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023552 00000100:00100000:0.0:1746129820.320000:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023168 00000100:00100000:0.0:1746129820.320002:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023168 00000100:00100000:0.0:1746129820.320008:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054023680 00000100:00100000:0.0:1746129820.320009:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054023680 00000100:00100000:0.0:1746129820.320017:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15429 00000100:00100000:0.0:1746129820.320021:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949054023040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.320107:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3298:x1830949054023040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (212us total) trans 17179874112 rc 0/0 00000100:00100000:0.0:1746129820.320111:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15429 00000100:00100000:0.0:1746129820.320121:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15430 00000100:00100000:0.0:1746129820.320124:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949054023552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.320204:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3298:x1830949054023552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (284us total) trans 17179874113 rc 0/0 00000100:00100000:0.0:1746129820.320209:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15430 00000100:00100000:0.0:1746129820.320217:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15431 00000100:00100000:0.0:1746129820.320221:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949054023168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.320294:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3298:x1830949054023168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (351us total) trans 17179874114 rc 0/0 00000100:00100000:0.0:1746129820.320299:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15431 00000100:00100000:0.0:1746129820.320307:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15432 00000100:00100000:0.0:1746129820.320310:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3298:x1830949054023680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.320375:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3298:x1830949054023680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (412us total) trans 17179874115 rc 0/0 00000100:00100000:0.0:1746129820.320380:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15432 00000004:00080000:0.0:1746129820.320400:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85c00/2, rc 0, transno 17179874114 00000100:00100000:0.0:1746129820.320404:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023168:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129820.320409:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87b80/2, rc 0, transno 17179874115 00000100:00100000:0.0:1746129820.320411:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129820.320416:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87100/2, rc 0, transno 17179874112 00000100:00100000:0.0:1746129820.320418:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129820.320423:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba86680/2, rc 0, transno 17179874113 00000100:00100000:0.0:1746129820.320426:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054023552:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746129820.321491:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321505:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321514:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129820.321526:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129820.321655:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321662:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321667:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321672:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e1ca00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129820.321676:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321681:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321690:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.321693:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129820.321696:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321700:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1ca00/0x48868a4e43954ed1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321714:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321719:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.321723:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129820.321883:0:3282:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3282:1830949054022912:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129820.321898:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.321903:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b08e00/0x48868a4e43954ea7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129820.322087:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.322284:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.322381:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054346752 00000100:00100000:0.0:1746129820.322387:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054346752 00000100:00100000:0.0:1746129820.322415:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4598 00000100:00100000:0.0:1746129820.322421:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31548:x1830949054346752:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129820.322496:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31548:x1830949054346752:12345-192.168.204.31@tcp:49:cat.0 Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.322501:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4598 00010000:00010000:1.0:1746129820.323029:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129820.323034:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323041:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323049:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129820.323052:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129820.323054:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323058:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed000/0x48868a4e43954eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323067:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323071:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323075:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323078:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ed200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129820.323080:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323084:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323090:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e8c7c00) 00010000:00010000:1.0:1746129820.323092:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129820.323094:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323099:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ed200/0x48868a4e43954ebc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.323141:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec600/0x48868a4e43954eae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355da6 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.323148:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919ec600/0x48868a4e43954eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355da6 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.323155:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919ec600, rc 0) 00000100:00100000:1.0:1746129820.323174:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31556:x1830949054346368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 34311us (38544us total) trans 8589945017 rc 301/301 00000100:00100000:1.0:1746129820.323180:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11018 00000100:00100000:1.0:1746129820.323914:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054346624 00000100:00100000:1.0:1746129820.323918:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054346624 00000100:00100000:1.0:1746129820.323941:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11020 00000100:00100000:1.0:1746129820.323946:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31550:x1830949054346624:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129820.323958:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.323968:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355db4 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.324000:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.324009:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.324025:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.324027:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129820.324030:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e1c200, rc 0) 00000100:00100000:1.0:1746129820.324307:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31550:x1830949054346624:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 359us (2021us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.324313:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11020 00000100:00100000:0.0:1746129820.329114:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.329161:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.329200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.329431:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054346880 00000100:00100000:2.0:1746129820.329439:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054346880 00000100:00100000:2.0:1746129820.329471:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054347136 00000100:00100000:2.0:1746129820.329473:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054347136 00000100:00100000:2.0:1746129820.329487:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054347264 00000100:00100000:2.0:1746129820.329488:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054347264 00000100:00100000:2.0:1746129820.329502:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11021 00000100:00100000:2.0:1746129820.329508:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31556:x1830949054346880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.329529:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.329544:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43954ee6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dbb expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.329607:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86200/0x48868a4e43954eed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329618:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86200/0x48868a4e43954eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329627:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86200/0x48868a4e43954eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129820.329647:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129820.329651:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129820.329662:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86200/0x48868a4e43954eed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329682:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43954ee6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dbb expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.329695:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86200/0x48868a4e43954eed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dbb expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.329702:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.329705:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129820.329708:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86200, rc 0) 00000100:00100000:2.0:1746129820.329743:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31556:x1830949054346880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 235us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.329749:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11021 00000100:00100000:2.0:1746129820.329763:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11022 00000100:00100000:2.0:1746129820.329768:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31555:x1830949054347136:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.329774:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.329780:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87c00/0x48868a4e43954ef4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dc2 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.329839:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329866:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329874:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329884:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329890:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329894:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329968:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.329976:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.329983:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.330005:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.330015:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 8 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.330025:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.330076:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.330092:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11023 00000100:00100000:2.0:1746129820.330098:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31550:x1830949054347264:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129820.330105:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.330111:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0x48868a4e43954f10 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dc9 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.330153:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129820.330160:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129820.330166:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129820.330177:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129820.330179:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129820.330187:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129820.330201:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d0000/0x48868a4e43954f10 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.330211:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.330217:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.330219:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129820.330221:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d1600, rc 0) 00000100:00100000:2.0:1746129820.330236:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31550:x1830949054347264:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 139us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.330241:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11023 00000100:00100000:0.0:1746129820.330905:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.332995:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054347520 00000100:00100000:2.0:1746129820.333004:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054347520 00002000:00100000:2.0:1746129820.333041:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094769880 x1830949054347520/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.333050:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949054347520 ext(3145728->4194303) 00002000:00010000:2.0:1746129820.333054:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:2.0:1746129820.333085:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6892 00000100:00100000:2.0:1746129820.333092:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054347520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129820.334050:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.334117:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024064:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.334148:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129820.334205:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054347648 00000100:00100000:0.0:1746129820.334209:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054347648 00000100:00100000:0.0:1746129820.334243:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15433 00000100:00100000:0.0:1746129820.334248:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054347648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.334258:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.334271:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dd0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129820.334288:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d39c, atime: 0x6813d39c, ctime: 0x6813d39c, blocks: 0x7e7 00010000:00010000:0.0:1746129820.334300:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.334302:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.334309:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.334321:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.334334:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379200, rc 0) 00000100:00100000:0.0:1746129820.334368:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054347648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.334373:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15433 00000100:00100000:0.0:1746129820.334967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.334993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335071:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.335148:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054347904 00000100:00100000:0.0:1746129820.335151:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054347904 00000100:00100000:0.0:1746129820.335166:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348032 00000100:00100000:0.0:1746129820.335167:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348032 00000100:00100000:0.0:1746129820.335174:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348288 00000100:00100000:0.0:1746129820.335175:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348288 00000100:00100000:0.0:1746129820.335180:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348160 00000100:00100000:0.0:1746129820.335181:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348160 00000100:00100000:0.0:1746129820.335187:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348416 00000100:00100000:0.0:1746129820.335188:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348416 00000100:00100000:0.0:1746129820.335193:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348544 00000100:00100000:0.0:1746129820.335194:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348544 00000100:00100000:0.0:1746129820.335199:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348800 00000100:00100000:0.0:1746129820.335201:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348800 00000100:00100000:0.0:1746129820.335207:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054349056 00000100:00100000:0.0:1746129820.335208:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054349056 00000100:00100000:0.0:1746129820.335213:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348672 00000100:00100000:0.0:1746129820.335215:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348672 00000100:00100000:0.0:1746129820.335220:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054348928 00000100:00100000:0.0:1746129820.335221:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054348928 00000100:00100000:0.0:1746129820.335226:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054349184 00000100:00100000:0.0:1746129820.335227:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054349184 00000100:00100000:0.0:1746129820.335237:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15434 00000100:00100000:0.0:1746129820.335242:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054347904:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129820.335249:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335255:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dd7 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335265:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335266:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335270:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335278:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335284:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f800, rc 0) 00000100:00100000:0.0:1746129820.335302:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054347904:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 59us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335306:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15434 00000100:00100000:0.0:1746129820.335315:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15435 00000100:00100000:0.0:1746129820.335320:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054348032:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129820.335326:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335334:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dde expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129820.335346:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d39c, atime: 0x6813d39c, ctime: 0x6813d39c, blocks: 0x821 00010000:00010000:0.0:1746129820.335352:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335353:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335357:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335365:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335371:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43fc00, rc 0) 00000100:00100000:0.0:1746129820.335384:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054348032:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 64us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335388:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15435 00000100:00100000:0.0:1746129820.335395:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15436 00000100:00100000:0.0:1746129820.335399:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054348288:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129820.335404:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335410:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dec expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129820.335420:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d39b, atime: 0x6813d39b, ctime: 0x6813d39b, blocks: 0x821 00010000:00010000:0.0:1746129820.335425:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335426:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335430:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335439:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335445:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43f600, rc 0) 00000100:00100000:0.0:1746129820.335455:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054348288:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 56us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335460:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15436 00000100:00100000:0.0:1746129820.335467:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15437 00000100:00100000:0.0:1746129820.335471:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054348160:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129820.335475:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335480:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355de5 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129820.335489:0:3623:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d39c, atime: 0x6813d39c, ctime: 0x6813d39c, blocks: 0x821 00010000:00010000:0.0:1746129820.335496:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335497:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335500:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335508:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335514:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43e400, rc 0) 00000100:00100000:0.0:1746129820.335526:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054348160:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 55us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335531:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15437 00000100:00100000:0.0:1746129820.335539:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15438 00000100:00100000:0.0:1746129820.335543:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054348416:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129820.335548:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335553:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355df3 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335561:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335562:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335566:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335572:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335578:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b43e800, rc 0) 00000100:00100000:0.0:1746129820.335590:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054348416:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 46us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335594:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15438 00000100:00100000:0.0:1746129820.335602:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15439 00000100:00100000:0.0:1746129820.335606:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054348544:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129820.335611:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335616:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355dfa expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335623:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335625:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335628:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335635:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 14 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335641:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136378e00, rc 0) 00000100:00100000:0.0:1746129820.335653:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054348544:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 46us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335657:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15439 00000100:00100000:0.0:1746129820.335665:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15440 00000100:00100000:0.0:1746129820.335668:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054348800:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.335673:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335677:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e08 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335685:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335686:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335689:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335696:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335702:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379c00, rc 0) 00000100:00100000:0.0:1746129820.335714:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054348800:12345-192.168.204.31@tcp:101:cat.0 Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335721:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15440 00000100:00100000:0.0:1746129820.335728:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15441 00000100:00100000:0.0:1746129820.335732:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054349056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.335736:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335740:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e16 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335747:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335749:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335752:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 25 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335759:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 25 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335765:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379000, rc 0) 00000100:00100000:0.0:1746129820.335775:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054349056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 43us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335779:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15441 00000100:00100000:0.0:1746129820.335786:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15442 00000100:00100000:0.0:1746129820.335790:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054348672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.335794:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335799:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e01 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335806:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335807:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335810:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335817:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335824:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136378800, rc 0) 00000100:00100000:0.0:1746129820.335832:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054348672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 42us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335837:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15442 00000100:00100000:0.0:1746129820.335844:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15443 00000100:00100000:0.0:1746129820.335870:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054348928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.335875:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335879:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e0f expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335886:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335887:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335891:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 25 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335898:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 25 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335904:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136378200, rc 0) 00000100:00100000:0.0:1746129820.335913:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054348928:12345-192.168.204.31@tcp:101:cat.0 Request processed in 44us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335919:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15443 00000100:00100000:0.0:1746129820.335927:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15444 00000100:00100000:0.0:1746129820.335931:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054349184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.335935:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.335939:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e1d expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.335946:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335947:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129820.335950:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335957:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 22 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129820.335963:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136378c00, rc 0) 00000100:00100000:0.0:1746129820.335971:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054349184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 40us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.335976:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15444 00000100:00100000:1.0:1746129820.336083:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054347776 00000100:00100000:1.0:1746129820.336087:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054347776 00010000:00010000:1.0:1746129820.336103:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 9 pid: 14315 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.336118:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7714 00000100:00100000:1.0:1746129820.336123:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054347776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.336142:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.336147:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 9 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.336156:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 9 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.336169:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c553200/0x48868a4e43954e61 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d8a expref: 9 pid: 14315 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.336179:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.336183:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.336192:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.336197:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.336211:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.336222:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054347776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.336227:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7714 00010000:00010000:3.0:1746129820.336371:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336377:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129820.336390:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129820.336464:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336470:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336475:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336480:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800932d1400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.336483:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336489:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336495:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.336498:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129820.336500:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336504:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1400/0x48868a4e43954f09 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336515:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336520:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336524:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336528:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa86800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.336530:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336537:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336543:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129820.336544:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.336547:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336550:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e43954efb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336558:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336562:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336566:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336569:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa86c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.336571:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336575:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336580:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8a00) 00010000:00010000:3.0:1746129820.336581:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.336583:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336587:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86c00/0x48868a4e43954f02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.336618:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87c00/0x48868a4e43954ef4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc2 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.336624:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87c00/0x48868a4e43954ef4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc2 expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.336630:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87c00, rc 0) 00000100:00100000:3.0:1746129820.336662:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31555:x1830949054347136:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6893us (7500us total) trans 8589945018 rc 301/301 00000100:00100000:3.0:1746129820.336668:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11022 00000100:00100000:3.0:1746129820.347490:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054347520:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14390us (16577us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.347501:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6892 00002000:00100000:3.0:1746129820.347511:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094769880 x1830949054347520/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.347520:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769880 with x1830949054347520 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.347525:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769880 00000100:00100000:0.0:1746129820.349773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.349811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.349838:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054349440 00000100:00100000:3.0:1746129820.349864:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054349440 00002000:00100000:3.0:1746129820.349903:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009206f480 x1830949054349440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129820.349903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129820.349911:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f480 with x1830949054349440 ext(0->1048575) 00002000:00010000:3.0:1746129820.349916:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f480 00000100:00100000:3.0:1746129820.349928:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054349696 00000100:00100000:3.0:1746129820.349930:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054349696 00000100:00100000:0.0:1746129820.349939:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350080 00002000:00100000:3.0:1746129820.349941:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009206c000 x1830949054349696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129820.349943:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350080 00002000:00100000:3.0:1746129820.349947:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206c000 with x1830949054349696 ext(1048576->2097151) 00002000:00010000:3.0:1746129820.349950:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206c000 00002000:00100000:0.0:1746129820.349960:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009206f800 x1830949054350080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129820.349962:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6893 00000100:00100000:3.0:1746129820.349968:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054349440:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:0.0:1746129820.349973:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f800 with x1830949054350080 ext(1048576->2097151) 00002000:00010000:0.0:1746129820.349977:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f800 00000100:00100000:0.0:1746129820.349991:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6894 00000100:00100000:0.0:1746129820.349997:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054349696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.351009:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6895 00000100:00100000:3.0:1746129820.351015:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054350080:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129820.354054:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.356062:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350208 00000100:00100000:0.0:1746129820.356072:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350208 00002000:00100000:0.0:1746129820.356110:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009faa3480 x1830949054350208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.356119:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3480 with x1830949054350208 ext(1048576->2097151) 00002000:00010000:0.0:1746129820.356124:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa3480 00000100:00100000:0.0:1746129820.356172:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6896 00000100:00100000:0.0:1746129820.356179:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054350208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.357459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.357482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.357495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.357505:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.357524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.357578:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350336 00000100:00100000:2.0:1746129820.357583:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350336 00000100:00100000:2.0:1746129820.357608:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350720 00000100:00100000:2.0:1746129820.357609:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350720 00000100:00100000:2.0:1746129820.357618:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350848 00000100:00100000:2.0:1746129820.357621:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350848 00000100:00100000:2.0:1746129820.357628:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350976 00000100:00100000:2.0:1746129820.357629:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350976 00000100:00100000:2.0:1746129820.357640:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15445 00000100:00100000:2.0:1746129820.357646:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054350336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.357657:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.357671:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e24 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.357687:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357689:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357696:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 29 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357709:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 29 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357718:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bab9e00, rc 0) 00000100:00100000:2.0:1746129820.357742:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054350336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.357747:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15445 00000100:00100000:2.0:1746129820.357763:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15446 00000100:00100000:2.0:1746129820.357767:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054350720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.357772:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.357781:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e32 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.357791:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357793:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357797:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 38 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357805:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 38 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357811:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86400, rc 0) 00000100:00100000:2.0:1746129820.357825:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054350720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.357828:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15446 00000100:00100000:2.0:1746129820.357836:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15447 00000100:00100000:2.0:1746129820.357840:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054350848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.357861:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.357867:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e39 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.357876:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357877:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357881:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 38 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357889:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 38 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357895:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86000, rc 0) 00000100:00100000:2.0:1746129820.357908:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054350848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 67us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.357916:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15447 00000100:00100000:2.0:1746129820.357925:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15448 00000100:00100000:2.0:1746129820.357929:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054350976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.357934:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.357939:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e40 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.357946:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357947:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.357951:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 29 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357958:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 29 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.357965:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87200, rc 0) 00000100:00100000:2.0:1746129820.357976:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054350976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 47us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.357980:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15448 00000100:00100000:2.0:1746129820.358000:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054350592 00000100:00100000:2.0:1746129820.358003:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054350592 00000100:00100000:2.0:1746129820.358022:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11024 00000100:00100000:2.0:1746129820.358026:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31555:x1830949054350592:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.358038:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.358040:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129820.358054:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86200/0x48868a4e43954eed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dbb expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358067:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.358070:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129820.358077:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0d800/0x48868a4e43954f95 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e2b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358111:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.358120:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358126:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358141:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358146:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.358169:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 7 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358179:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 7 pid: 16808 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.358190:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.358239:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358246:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 7 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.358252:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024320:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.358272:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.358279:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 281 pid: 15044 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.358286:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b027480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024448:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.358301:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.362126:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054349696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12120us (12305us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129820.362155:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6894 00002000:00100000:0.0:1746129820.362165:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009206c000 x1830949054349696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.362174:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206c000 with x1830949054349696 ext(1048576->2097151) 00002000:00010000:0.0:1746129820.362179:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206c000 00000100:00100000:0.0:1746129820.368442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.368472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.368502:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.368586:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.368596:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b024380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024320:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.368602:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b027480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024448:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.368623:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129820.368796:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054349440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18826us (19027us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.368805:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6893 00002000:00100000:3.0:1746129820.368813:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009206f480 x1830949054349440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.368822:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f480 with x1830949054349440 ext(0->1048575) 00002000:00010000:3.0:1746129820.368827:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f480 00000100:00100000:1.0:1746129820.368923:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351232 00000100:00100000:1.0:1746129820.368929:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351232 00010000:00010000:1.0:1746129820.368952:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 8 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.368970:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351104 00000100:00100000:1.0:1746129820.368971:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351104 00010000:00010000:1.0:1746129820.368979:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 9 pid: 16808 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.368989:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351360 00000100:00100000:1.0:1746129820.368991:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351360 00010000:00010000:1.0:1746129820.368998:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 282 pid: 15044 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.369016:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7715 00000100:00100000:1.0:1746129820.369022:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054351232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.369033:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129820.369034:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7716 00010000:00010000:1.0:1746129820.369039:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 9 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746129820.369041:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054351104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.369047:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 9 pid: 1851 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.369049:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129820.369053:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 9 pid: 16808 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.369064:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e1c200/0x48868a4e43954edf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355db4 expref: 9 pid: 1851 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.369095:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7717 00000100:00100000:2.0:1746129820.369101:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1961:x1830949054351360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.369112:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.369116:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 282 pid: 15044 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.369180:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 8 pid: 16808 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.369192:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.369197:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.369204:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129820.369208:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129820.369292:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 282 pid: 15044 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.369305:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136379600/0x48868a4e43954eca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dad expref: 282 pid: 15044 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.369319:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.369321:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.369326:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.369330:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129820.369368:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800932d1600/0x48868a4e43954f17 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dc9 expref: 8 pid: 16808 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.369380:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129820.369384:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129820.369390:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129820.369396:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:0.0:1746129820.369411:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.369556:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054351232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 532us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.369562:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7715 00000100:00100000:2.0:1746129820.369614:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:1961:x1830949054351360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 512us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.369625:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7717 00010000:00010000:2.0:1746129820.369646:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.369651:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:3.0:1746129820.370020:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.370086:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054351104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1043us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.370091:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7716 00000100:00100000:2.0:1746129820.370191:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351488 00000100:00100000:2.0:1746129820.370196:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351488 00000100:00100000:2.0:1746129820.370218:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11025 00000100:00100000:2.0:1746129820.370223:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31548:x1830949054351488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.370237:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.370247:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e47 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.370285:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.370292:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 282 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.370305:0:15044:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.370315:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 282 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.370324:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.370327:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129820.370329:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 282 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.370335:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b09c00, rc 0) 00000100:00100000:2.0:1746129820.370354:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31548:x1830949054351488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 131us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.370358:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11025 00000100:00100000:1.0:1746129820.370443:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054350208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14264us (16395us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.370450:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6896 00002000:00100000:1.0:1746129820.370456:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009faa3480 x1830949054350208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.370463:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3480 with x1830949054350208 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.370467:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa3480 00000100:00100000:3.0:1746129820.370825:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054350080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19809us (20921us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.370831:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6895 00002000:00100000:3.0:1746129820.370836:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009206f800 x1830949054350080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.370844:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f800 with x1830949054350080 ext(1048576->2097151) 00002000:00010000:3.0:1746129820.370865:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f800 00000040:00080000:2.0:1746129820.371092:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3515, 88 off296056 00000004:00080000:2.0:1746129820.371098:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429249562ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371361:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3521, 88 off296496 00000004:00080000:2.0:1746129820.371365:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429517454ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371505:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3522, 88 off296584 00000004:00080000:2.0:1746129820.371509:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429660732ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371517:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3516, 88 off296144 00000004:00080000:2.0:1746129820.371521:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429672942ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371529:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3517, 88 off296232 00000004:00080000:2.0:1746129820.371531:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429683642ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371538:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3523, 88 off296672 00000004:00080000:2.0:1746129820.371540:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429692540ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371546:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3524, 88 off296760 00000004:00080000:2.0:1746129820.371548:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429699847ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371553:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3525, 88 off296848 00000004:00080000:2.0:1746129820.371556:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429708162ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371562:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3518, 88 off296320 00000004:00080000:2.0:1746129820.371564:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429716342ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371571:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3526, 88 off296936 00000004:00080000:2.0:1746129820.371574:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429726140ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371582:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3519, 88 off296408 00000004:00080000:2.0:1746129820.371584:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429736169ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371591:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3527, 88 off297024 00000004:00080000:2.0:1746129820.371594:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429745719ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129820.371599:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3520, 88 off296496 00000004:00080000:2.0:1746129820.371600:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429752499ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371605:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3521, 88 off296584 00000004:00080000:2.0:1746129820.371607:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429759285ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371612:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3522, 88 off296672 00000004:00080000:2.0:1746129820.371614:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429766507ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371620:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3523, 88 off296760 00000004:00080000:2.0:1746129820.371622:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766429773854ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129820.371627:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3528, 88 off297112 00000004:00080000:2.0:1746129820.371630:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766429782010ns, next at 716792379979ns, rc = 0 00000100:00100000:0.0:1746129820.380731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.380760:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351616 00000100:00100000:0.0:1746129820.380768:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351616 00000100:00100000:0.0:1746129820.380805:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11026 00000100:00100000:0.0:1746129820.380817:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31556:x1830949054351616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129820.380834:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.380867:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e4e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.380930:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.380941:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.380951:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129820.380954:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129820.380957:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.380962:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0000, rc 0) 00000100:00100000:0.0:1746129820.380998:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31556:x1830949054351616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 186us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.381003:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11026 00010000:00010000:1.0:1746129820.399397:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399410:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.399413:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129820.399417:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399426:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399432:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399439:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399444:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399449:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.399479:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.399489:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024576:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129820.399571:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 281 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.399582:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024704:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129820.399599:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092480 going to sleep for 11 seconds 00000001:00080000:1.0:1746129820.399613:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945017 is committed 00000001:00080000:1.0:1746129820.399620:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945019 is committed 00000004:00080000:1.0:1746129820.399623:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746129820.399629:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2695 committed 00000004:00080000:1.0:1746129820.400156:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746129820.400159:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746129820.400160:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746129820.400161:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2694 committed 00000004:00080000:1.0:1746129820.400163:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746129820.400164:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2693 committed 00000004:00080000:1.0:1746129820.400165:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746129820.400167:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2692 committed 00000004:00080000:1.0:1746129820.400168:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2691 committed 00000004:00080000:1.0:1746129820.400171:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2690 committed 00000004:00080000:1.0:1746129820.400173:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746129820.400174:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746129820.400176:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2689 committed 00000004:00080000:1.0:1746129820.400178:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2688 committed 00000004:00080000:1.0:1746129820.400179:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2687 committed 00000100:00100000:2.0:1746129820.400222:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129820.400233:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054024832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.400265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.400271:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054025344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.400281:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054024960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129820.400289:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.400294:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.400307:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.400316:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.400328:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.400328:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054024832 00000100:00100000:0.0:1746129820.400333:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054024832 00000100:00100000:2.0:1746129820.400338:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129820.400341:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025216:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.400353:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.400357:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025344 00000100:00100000:0.0:1746129820.400359:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025344 00000100:00100000:2.0:1746129820.400362:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025728:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129820.400369:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025088 00000100:00100000:0.0:1746129820.400370:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025088 00000100:00100000:2.0:1746129820.400374:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.400817:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025600 00000100:00100000:0.0:1746129820.400820:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025600 00000100:00100000:2.0:1746129820.400831:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.400834:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025216 00000100:00100000:0.0:1746129820.400836:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025216 00000100:00100000:0.0:1746129820.400843:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025728 00000100:00100000:0.0:1746129820.400845:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025728 00000100:00100000:2.0:1746129820.400862:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.400869:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026112 00000100:00100000:0.0:1746129820.400871:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026112 00000100:00100000:2.0:1746129820.400875:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.400881:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15449 00000100:00100000:2.0:1746129820.400887:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.400887:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3299:x1830949054024832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.400894:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746129820.400898:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.400907:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.400913:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.400922:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.400937:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026624 00000100:00100000:2.0:1746129820.400940:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026624 00000100:00100000:2.0:1746129820.400951:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026240 00000100:00100000:2.0:1746129820.400952:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026240 00000100:00100000:2.0:1746129820.400957:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026752 00000100:00100000:2.0:1746129820.400958:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026752 00000100:00100000:2.0:1746129820.400965:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15450 00000100:00100000:2.0:1746129820.400969:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+91:3298:x1830949054025344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129820.401021:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129820.401024:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00002000:00010000:0.0:1746129820.401026:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129820 -> 1746129820 00002000:00010000:0.0:1746129820.401027:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00002000:00010000:0.0:1746129820.401029:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746129820.401048:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+93:3298:x1830949054025344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (758us total) trans 21474841312 rc 0/0 00000100:00100000:0.0:1746129820.401051:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3299:x1830949054024832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (786us total) trans 21474841311 rc 0/0 00000100:00100000:2.0:1746129820.401054:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15450 00000100:00100000:0.0:1746129820.401056:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15449 00000100:00100000:0.0:1746129820.401066:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15451 00000100:00100000:2.0:1746129820.401068:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15452 00000100:00100000:0.0:1746129820.401070:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+91:3296:x1830949054025088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.401072:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+91:3296:x1830949054025600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129820.401092:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15453 00000100:00100000:0.0:1746129820.401096:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+91:3296:x1830949054025216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.401128:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15454 00000100:00100000:2.0:1746129820.401145:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+92:3296:x1830949054025728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129820.401166:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15455 00000100:00100000:0.0:1746129820.401170:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3296:x1830949054026112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129820.401207:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15456 00000100:00100000:3.0:1746129820.401214:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15457 00000100:00100000:1.0:1746129820.401214:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3296:x1830949054026624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129820.401222:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3296:x1830949054026240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129820.401258:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129820.401260:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00002000:00010000:0.0:1746129820.401262:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129820 -> 1746129820 00002000:00010000:0.0:1746129820.401264:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00002000:00010000:0.0:1746129820.401265:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129820.401286:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+75:3296:x1830949054026112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (438us total) trans 17179874116 rc 0/0 00000100:00100000:1.0:1746129820.401290:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3296:x1830949054026624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (401us total) trans 17179874117 rc 0/0 00000100:00100000:0.0:1746129820.401292:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15455 00000100:00100000:1.0:1746129820.401294:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15456 00000100:00100000:0.0:1746129820.401300:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15458 00000100:00100000:0.0:1746129820.401304:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3296:x1830949054026752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129820.401318:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+73:3296:x1830949054026240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (408us total) trans 17179874118 rc 0/0 00000100:00100000:3.0:1746129820.401324:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15457 00000100:00100000:3.0:1746129820.401340:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054025856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.401357:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.401359:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129820.401369:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054025472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129820.401372:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3296:x1830949054026752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (448us total) trans 17179874119 rc 0/0 00000100:00100000:3.0:1746129820.401374:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054026368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.401376:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15458 00000100:00100000:0.0:1746129820.401384:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054024960 00000100:00100000:2.0:1746129820.401385:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.401386:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054024960 00000004:00080000:2.0:1746129820.401558:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbef480/2, rc 0, transno 21474841311 00000100:00100000:2.0:1746129820.401565:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054024832:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.401572:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054025984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129820.401584:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.401613:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025856 00000100:00100000:3.0:1746129820.401614:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025472 00000100:00100000:0.0:1746129820.401615:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025856 00000100:00100000:3.0:1746129820.401618:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025472 00000100:00100000:2.0:1746129820.401619:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054026496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.401622:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054025984 00000100:00100000:0.0:1746129820.401624:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054025984 00000100:00100000:0.0:1746129820.401631:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15459 00000100:00100000:2.0:1746129820.401632:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129820.401635:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15460 00000100:00100000:0.0:1746129820.401635:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3299:x1830949054024960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129820.401639:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+74:3298:x1830949054025856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.401645:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026496 00000100:00100000:0.0:1746129820.401646:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026496 00000100:00100000:0.0:1746129820.401655:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15461 00000100:00100000:0.0:1746129820.401659:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+95:3299:x1830949054025472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129820.401674:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129820.401677:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129820.401678:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129820.401680:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129820.401682:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129820.401698:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949054025600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 625us (1368us total) trans 21474841313 rc 0/0 00000100:00100000:2.0:1746129820.401702:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15452 00002000:00010000:3.0:1746129820.401707:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129820.401710:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00000100:00100000:2.0:1746129820.401711:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15462 00002000:00010000:3.0:1746129820.401712:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129820 -> 1746129820 00002000:00010000:3.0:1746129820.401713:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00000100:00100000:2.0:1746129820.401714:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949054025984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129820.401715:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129820.401729:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+95:3299:x1830949054025472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (343us total) trans 21474841315 rc 0/0 00000100:00100000:0.0:1746129820.401735:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15461 00000100:00100000:3.0:1746129820.401738:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949054025856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (377us total) trans 17179874120 rc 0/0 00000100:00100000:3.0:1746129820.401743:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15460 00000100:00100000:0.0:1746129820.401746:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15463 00000100:00100000:0.0:1746129820.401749:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3299:x1830949054026496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129820.401757:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746129820.401773:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129820.401775:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00000004:00080000:3.0:1746129820.401777:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbed880/2, rc 0, transno 21474841312 00002000:00010000:2.0:1746129820.401777:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129820 -> 1746129820 00002000:00010000:2.0:1746129820.401779:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00000100:00100000:3.0:1746129820.401780:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054025344:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129820.401780:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129820.401788:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054026880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129820.401797:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3299:x1830949054025984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (212us total) trans 17179874121 rc 0/0 00000100:00100000:2.0:1746129820.401801:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15462 00000100:00100000:3.0:1746129820.401804:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129820.401807:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3299:x1830949054026496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (174us total) trans 17179874122 rc 0/0 00000100:00100000:2.0:1746129820.401809:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026368 00000100:00100000:0.0:1746129820.401811:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15463 00000100:00100000:2.0:1746129820.401812:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026368 00000004:00080000:3.0:1746129820.401815:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093288700/2, rc 0, transno 17179874120 00000100:00100000:0.0:1746129820.401817:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054026880 00000100:00100000:3.0:1746129820.401818:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054025856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.401819:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054026880 00000100:00100000:2.0:1746129820.401820:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15464 00000100:00100000:2.0:1746129820.401823:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3298:x1830949054026368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129820.401826:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15465 00000100:00100000:0.0:1746129820.401829:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+95:3298:x1830949054026880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129820.401918:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+96:3298:x1830949054026880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (112us total) trans 21474841316 rc 0/0 00000100:00100000:0.0:1746129820.401922:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15465 00000100:00100000:2.0:1746129820.402042:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+96:3296:x1830949054025728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 897us (1666us total) trans 21474841317 rc 0/0 00000100:00100000:2.0:1746129820.402047:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15454 00000100:00100000:2.0:1746129820.402081:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949054025216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 984us (1727us total) trans 21474841314 rc 0/0 00000100:00100000:2.0:1746129820.402086:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15453 00002000:00010000:0.0:1746129820.402126:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129820.402140:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129819 -> 1746129819 00002000:00010000:0.0:1746129820.402142:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:0.0:1746129820.402143:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129819 -> 1746129819 00002000:00010000:0.0:1746129820.402145:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129820.402155:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3298:x1830949054026368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 330us (396us total) trans 17179874123 rc 0/0 00000100:00100000:0.0:1746129820.402159:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+95:3299:x1830949054024960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 524us (802us total) trans 21474841318 rc 0/0 00000100:00100000:2.0:1746129820.402162:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15464 00000100:00100000:0.0:1746129820.402164:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15459 00000004:00080000:2.0:1746129820.402179:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328b800/2, rc 0, transno 17179874121 00000100:00100000:2.0:1746129820.402183:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054025984:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.402188:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2c380/2, rc 0, transno 17179874122 00000100:00100000:2.0:1746129820.402190:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054026496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.402195:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbeed80/2, rc 0, transno 21474841318 00000100:00100000:2.0:1746129820.402197:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054024960:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129820.402201:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbefb80/2, rc 0, transno 21474841315 00000100:00100000:2.0:1746129820.402203:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054025472:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129820.402213:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328b480/2, rc 0, transno 17179874118 00000100:00100000:2.0:1746129820.402215:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.402220:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2f800/2, rc 0, transno 17179874119 00000100:00100000:2.0:1746129820.402222:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026752:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.402226:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093288e00/2, rc 0, transno 17179874116 00000100:00100000:2.0:1746129820.402228:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026112:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.402232:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009bb2e300/2, rc 0, transno 17179874117 00000100:00100000:2.0:1746129820.402234:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054026624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129820.402238:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbef100/2, rc 0, transno 21474841314 00000100:00100000:2.0:1746129820.402240:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025216:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129820.402243:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645fb80/2, rc 0, transno 21474841317 00000100:00100000:2.0:1746129820.402245:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025728:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129820.402249:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a645c700/2, rc 0, transno 21474841313 00000100:00100000:2.0:1746129820.402251:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025600:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129820.402301:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:2.0:1746129820.402304:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129820 -> 1746129820 00002000:00010000:2.0:1746129820.402305:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129819 -> 1746129819 00002000:00010000:2.0:1746129820.402307:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129820 -> 1746129820 00002000:00010000:2.0:1746129820.402308:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:2.0:1746129820.402339:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3296:x1830949054025088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1269us (2031us total) trans 21474841319 rc 0/0 00000100:00100000:2.0:1746129820.402344:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15451 00000004:00080000:0.0:1746129820.402474:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fbef800/2, rc 0, transno 21474841319 00000100:00100000:0.0:1746129820.402478:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054025088:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129820.402484:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7100/2, rc 0, transno 21474841316 00000100:00100000:3.0:1746129820.402488:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054026880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129820.402494:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093289c00/2, rc 0, transno 17179874123 00000100:00100000:3.0:1746129820.402497:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054026368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129820.410417:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024576:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129820.410908:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.410933:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054024704:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129820.410949:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129820.410969:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0d800/0x48868a4e43954f95 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 9 pid: 14315 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746129820.410969:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351744 00000100:00100000:0.0:1746129820.410973:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351744 00010000:00010000:1.0:1746129820.410988:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129820.410999:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054351872 00000100:00100000:0.0:1746129820.411001:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054351872 00000100:00100000:0.0:1746129820.411012:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4599 00010000:00010000:1.0:1746129820.411014:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f0cc00, rc 0) 00000100:00100000:0.0:1746129820.411018:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31548:x1830949054351744:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:1.0:1746129820.411096:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31555:x1830949054350592:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 53067us (53638us total) trans 8589945019 rc 0/0 00000100:00100000:1.0:1746129820.411102:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11024 00000100:00100000:1.0:1746129820.411126:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4600 00000100:00100000:1.0:1746129820.411146:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c561850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31556:x1830949054351872:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129820.411358:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31548:x1830949054351744:12345-192.168.204.31@tcp:49:cat.0 Request processed in 338us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.411360:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c561850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31556:x1830949054351872:12345-192.168.204.31@tcp:49:cat.0 Request processed in 227us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.411364:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4599 00000100:00100000:1.0:1746129820.411367:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4600 00000100:00100000:2.0:1746129820.414463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.414507:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054352000 00000100:00100000:1.0:1746129820.414513:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054352000 00000100:00100000:1.0:1746129820.414545:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4601 00000100:00100000:1.0:1746129820.414551:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31555:x1830949054352000:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:1.0:1746129820.414887:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31555:x1830949054352000:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 334us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.414893:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4601 00000100:00100000:0.0:1746129820.418095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.418164:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054352256 00000100:00100000:3.0:1746129820.418170:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054352256 00002000:00100000:3.0:1746129820.418203:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a645e680 x1830949054352256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.418212:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949054352256 ext(4194304->4931583) 00002000:00010000:3.0:1746129820.418217:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645e680 00000100:00100000:3.0:1746129820.418246:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6897 00000100:00100000:3.0:1746129820.418253:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054352256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.418293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.418351:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054352384 00000100:00100000:2.0:1746129820.418355:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054352384 00000100:00100000:2.0:1746129820.418376:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15466 00000100:00100000:2.0:1746129820.418381:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31555:x1830949054352384:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.418389:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.418403:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e55 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.418427:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.418435:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.418441:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.418451:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.418452:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.418456:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3297280->3543039] (req 3297280->3543039) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.418480:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.418491:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 13 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.418500:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054027008:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.418961:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.418969:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.418977:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054027136:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.419167:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.419176:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 30 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.419188:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054027264:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.419210:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.421459:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.421600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.421808:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054352640 00000100:00100000:1.0:1746129820.421814:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054352640 00000100:00100000:3.0:1746129820.421952:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054027008:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.421959:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054027136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129820.422006:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11027 00000100:00100000:0.0:1746129820.422014:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31559:x1830949054352640:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129820.422027:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129820.422039:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e43954fb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e5c expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.422282:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054352896 00000100:00100000:1.0:1746129820.422285:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054352896 00002000:00100000:1.0:1746129820.422307:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880093289f80 x1830949054352896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.422316:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949054352896 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.422319:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:1.0:1746129820.422329:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6898 00000100:00100000:1.0:1746129820.422334:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054352896:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:0.0:1746129820.422397:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422407:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422416:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422425:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422432:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422436:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422514:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422519:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422524:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129820.422530:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:3.0:1746129820.422747:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054027264:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.422768:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3297280->3543039] (req 3297280->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.422781:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094b08e00, rc 0) 00000100:00100000:3.0:1746129820.422813:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31555:x1830949054352384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4431us (4520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.422822:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15466 00010000:00010000:0.0:1746129820.422985:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422992:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.422996:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423001:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80de800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129820.423004:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423009:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423017:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129820.423020:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129820.423023:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423027:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de800/0x48868a4e43954fcd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423038:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423042:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423046:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423049:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80df800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129820.423050:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423054:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423058:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129820.423060:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129820.423062:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423066:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80df800/0x48868a4e43954fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423071:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423074:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423079:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423082:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a80de000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129820.423084:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423087:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423091:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244e00) 00010000:00010000:0.0:1746129820.423093:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129820.423094:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423098:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80de000/0x48868a4e43954fc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129820.423125:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e43954fb8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e5c expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.423143:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a80dfc00/0x48868a4e43954fb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e5c expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.423150:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a80dfc00, rc 0) 00000100:00100000:0.0:1746129820.423182:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31559:x1830949054352640:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1169us (1726us total) trans 8589945020 rc 301/301 00000100:00100000:0.0:1746129820.423190:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11027 00000100:00100000:0.0:1746129820.425737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.425776:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.425885:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054353024 00000100:00100000:1.0:1746129820.425891:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054353024 00010000:00010000:1.0:1746129820.425921:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.425922:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054353152 00000100:00100000:2.0:1746129820.425927:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054353152 00010000:00010000:2.0:1746129820.425943:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746129820.425952:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7718 00000100:00100000:1.0:1746129820.425958:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054353024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.425968:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129820.425979:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7719 00010000:00010000:1.0:1746129820.425981:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.425984:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054353152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.425990:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.425992:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.426005:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b43e800/0x48868a4e43954f41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355df3 expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.426010:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.426018:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.426303:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054352256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8048us (8213us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129820.426311:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6897 00002000:00100000:3.0:1746129820.426319:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a645e680 x1830949054352256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.426328:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e680 with x1830949054352256 ext(4194304->4931583) 00010000:00010000:3.0:1746129820.426333:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.426343:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.426348:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a645e680 00010000:00010000:1.0:1746129820.426416:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.426433:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054353024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 476us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129820.426439:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7718 00010000:00010000:2.0:1746129820.426570:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136379000/0x48868a4e43954f56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e16 expref: 26 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.426593:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.426614:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054353152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 629us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.426620:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7719 00000100:00100000:1.0:1746129820.427419:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054352896:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 5083us (5817us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.427426:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6898 00002000:00100000:1.0:1746129820.427433:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880093289f80 x1830949054352896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.427440:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949054352896 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.427443:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:0.0:1746129820.432923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.432953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.433035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.433106:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054353408 00000100:00100000:1.0:1746129820.433113:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054353408 00000100:00100000:3.0:1746129820.433150:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054353664 00000100:00100000:3.0:1746129820.433154:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054353664 00002000:00100000:1.0:1746129820.433159:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094769f80 x1830949054353408/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.433168:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769f80 with x1830949054353408 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.433172:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769f80 00000100:00100000:3.0:1746129820.433177:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15467 00000100:00100000:3.0:1746129820.433183:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054353664:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129820.433184:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6899 00000100:00100000:1.0:1746129820.433188:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054353408:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:3.0:1746129820.433194:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.433206:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800932d1e00/0x48868a4e43954fdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e63 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.433220:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.433227:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800932d1e00/0x48868a4e43954fdb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e63 expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.433239:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800932d1e00/0x48868a4e43954fdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e63 expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.433248:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800932d1e00, rc 0) 00000100:00100000:3.0:1746129820.433279:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054353664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 97us (244us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129820.433283:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15467 00000100:00100000:2.0:1746129820.433466:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054353536 00000100:00100000:2.0:1746129820.433470:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054353536 00010000:00010000:2.0:1746129820.433487:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.433505:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7720 00000100:00100000:2.0:1746129820.433510:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054353536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.433522:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.433541:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.433553:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.433567:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e1ce00/0x48868a4e43954ea0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d98 expref: 29 pid: 8436 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.433578:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.433579:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.433585:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.433595:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.433619:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.433628:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054027392:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129820.433675:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.437918:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.437973:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054353792 00000100:00100000:2.0:1746129820.437980:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054353792 00000100:00100000:2.0:1746129820.438027:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15468 00000100:00100000:2.0:1746129820.438034:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31548:x1830949054353792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.438047:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.438061:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e6a expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.438089:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.438096:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.438098:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.438101:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4927488->5242879] (req 4927488->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 30 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.438127:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.438147:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 24 pid: 20441 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.438158:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054027520:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.438229:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.438787:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054027392:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129820.438799:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129820.438835:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054353536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5324us (5881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129820.438843:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7720 00000100:00100000:2.0:1746129820.439424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.439539:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054354048 00000100:00100000:3.0:1746129820.439543:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054354048 00002000:00100000:3.0:1746129820.439564:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3297280->3301375) req@ffff88009328ad80 x1830949054354048/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.439572:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949054354048 ext(3297280->3301375) 00010000:00010000:3.0:1746129820.439579:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.439588:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.439594:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328ad80 00000100:00100000:3.0:1746129820.439622:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1865 00000100:00100000:3.0:1746129820.439628:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054354048:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.439806:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054354048:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 177us (381us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.439813:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1865 00002000:00100000:3.0:1746129820.439819:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3297280->3301375) req@ffff88009328ad80 x1830949054354048/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.439826:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328ad80 with x1830949054354048 ext(3297280->3301375) 00010000:00010000:3.0:1746129820.439830:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.439839:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.439844:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009328ad80 00000100:00100000:1.0:1746129820.440584:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054353408:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7393us (7667us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.440591:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6899 00002000:00100000:1.0:1746129820.440596:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094769f80 x1830949054353408/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.440602:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769f80 with x1830949054353408 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.440606:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769f80 00000100:00100000:2.0:1746129820.441107:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054027520:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.441143:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4927488->5242879] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.441155:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff99a00, rc 0) 00000100:00100000:2.0:1746129820.441182:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31548:x1830949054353792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3149us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.441188:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15468 00000100:00100000:2.0:1746129820.443409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.443485:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054354304 00000100:00100000:1.0:1746129820.443491:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054354304 00002000:00100000:1.0:1746129820.443520:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3538944->3543039) req@ffff880093289880 x1830949054354304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.443529:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289880 with x1830949054354304 ext(3538944->3543039) 00010000:00010000:1.0:1746129820.443535:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.443547:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746129820.443554:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093289880 00000100:00100000:1.0:1746129820.443575:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1866 00000100:00100000:1.0:1746129820.443581:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054354304:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129820.443697:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054354304:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 116us (293us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129820.443703:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1866 00002000:00100000:1.0:1746129820.443707:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3538944->3543039) req@ffff880093289880 x1830949054354304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.443714:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289880 with x1830949054354304 ext(3538944->3543039) 00010000:00010000:1.0:1746129820.443718:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.443727:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 25 pid: 20441 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746129820.443733:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093289880 00000100:00100000:0.0:1746129820.447775:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.448077:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054354560 00000100:00100000:1.0:1746129820.448085:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054354560 00002000:00100000:1.0:1746129820.448117:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009476aa00 x1830949054354560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.448127:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949054354560 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.448142:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:1.0:1746129820.448170:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6900 00000100:00100000:1.0:1746129820.448177:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054354560:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129820.448944:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.449207:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054354688 00000100:00100000:2.0:1746129820.449212:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054354688 00000100:00100000:2.0:1746129820.449236:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15469 00000100:00100000:2.0:1746129820.449241:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31559:x1830949054354688:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.449251:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.449265:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e71 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.449285:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 39 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.449292:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 21 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.449298:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.449303:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.449305:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.449308:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3678208->3973119] (req 3678208->3973119) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.449316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129820.449333:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129820.449343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129820.449343:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 13 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.449353:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054027648:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.449354:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355200 00000100:00100000:3.0:1746129820.449357:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355200 00002000:00100000:3.0:1746129820.449373:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3297280->3543039) req@ffff88009284ea00 x1830949054355200/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129820.449378:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355072 00002000:00100000:3.0:1746129820.449380:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ea00 with x1830949054355200 ext(3297280->3543039) 00000100:00100000:1.0:1746129820.449382:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355072 00010000:00010000:3.0:1746129820.449385:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.449394:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.449403:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4602 00002000:00010000:3.0:1746129820.449405:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284ea00 00010000:00010000:2.0:1746129820.449408:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 21 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129820.449408:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31555:x1830949054355072:12345-192.168.204.31@tcp:35:multiop.0 00010000:00010000:2.0:1746129820.449415:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 21 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.449420:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1867 00000100:00100000:2.0:1746129820.449423:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054027776:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.449426:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054355200:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:2.0:1746129820.449446:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 39 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.449453:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 39 pid: 1140 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.449459:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054027904:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.449475:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.449579:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31555:x1830949054355072:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 170us (263us total) trans 8589945021 rc 0/0 00000100:00100000:1.0:1746129820.449585:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4602 00000100:00100000:2.0:1746129820.453768:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093289500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054027648:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.453778:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054027776:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129820.454156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.454194:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355328 00000100:00100000:2.0:1746129820.454199:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355328 00000100:00100000:0.0:1746129820.454204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.454219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129820.454225:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 22 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.454232:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355456 00000100:00100000:3.0:1746129820.454236:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355456 00000100:00100000:2.0:1746129820.454249:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355584 00010000:00010000:3.0:1746129820.454251:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.454252:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355584 00000100:00100000:0.0:1746129820.454253:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7721 00000100:00100000:0.0:1746129820.454260:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054355328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.454261:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 40 pid: 1140 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.454271:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7722 00010000:00010000:0.0:1746129820.454271:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129820.454274:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7723 00000100:00100000:3.0:1746129820.454276:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054355456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129820.454278:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054355584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.454282:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.454284:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129820.454287:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 22 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.454289:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.454290:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 40 pid: 1140 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746129820.454296:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 22 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746129820.454568:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 40 pid: 1140 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.454588:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.454622:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054355584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 343us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.454627:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7723 00010000:00010000:3.0:1746129820.454707:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.454721:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136378e00/0x48868a4e43954f48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dfa expref: 14 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746129820.454728:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136378c00/0x48868a4e43954f6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e1d expref: 22 pid: 3623 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.454735:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.454737:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.454742:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.454749:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129820.454859:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129820.454876:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054355328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 616us (1186us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129820.454877:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129820.454881:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7721 00000100:00100000:3.0:1746129820.454893:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054028032:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.454933:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68e40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129820.454953:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87400/0x48868a4e43954ec3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355d9f expref: 39 pid: 1140 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.454961:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054027904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.455068:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.455077:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ff98400, rc 0) 00000100:00100000:3.0:1746129820.455095:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31559:x1830949054354688:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5854us (6153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.455100:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15469 00000100:00100000:1.0:1746129820.455214:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054354560:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7037us (7445us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.455222:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6900 00002000:00100000:1.0:1746129820.455228:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009476aa00 x1830949054354560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.455237:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476aa00 with x1830949054354560 ext(1048576->2097151) 00002000:00010000:1.0:1746129820.455241:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476aa00 00000100:00100000:3.0:1746129820.458344:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054028032:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129820.458364:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.458404:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054355456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4127us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.458413:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7722 00000100:00100000:3.0:1746129820.459181:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054355200:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9753us (9834us total) trans 21474841320 rc 0/0 00000100:00100000:3.0:1746129820.459190:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1867 00002000:00100000:3.0:1746129820.459198:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3297280->3543039) req@ffff88009284ea00 x1830949054355200/t21474841320(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.459212:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ea00 with x1830949054355200 ext(3297280->3543039) 00010000:00010000:3.0:1746129820.459225:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.459237:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.459242:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009284ea00 00000100:00100000:0.0:1746129820.460681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.460744:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355840 00000100:00100000:3.0:1746129820.460751:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355840 00002000:00100000:3.0:1746129820.460782:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3678208->3682303) req@ffff88009476a680 x1830949054355840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.460790:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a680 with x1830949054355840 ext(3678208->3682303) 00002000:00010000:3.0:1746129820.460794:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a680 00000100:00100000:3.0:1746129820.461409:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6901 00000100:00100000:3.0:1746129820.461417:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054355840:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.461549:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054355840:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 132us (872us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.461556:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6901 00002000:00100000:3.0:1746129820.461561:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3678208->3682303) req@ffff88009476a680 x1830949054355840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.461568:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a680 with x1830949054355840 ext(3678208->3682303) 00002000:00010000:3.0:1746129820.461571:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a680 00000100:00100000:0.0:1746129820.462736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.462838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.462901:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054355968 00000100:00100000:3.0:1746129820.462906:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054355968 00010000:00010000:3.0:1746129820.462928:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.462958:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7724 00000100:00100000:3.0:1746129820.462964:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054355968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.462974:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129820.462985:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129820 -> 1746129821 00002000:00010000:3.0:1746129820.462988:0:16449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129820 -> 1746129821 00010000:00010000:3.0:1746129820.462992:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.463002:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.463019:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094b08e00/0x48868a4e43954fb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3297280->3543039) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e55 expref: 27 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.463034:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.463036:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.463042:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.463049:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.463074:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.463084:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054028160:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.463147:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.463491:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054356096 00000100:00100000:2.0:1746129820.463495:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054356096 00000100:00100000:2.0:1746129820.463527:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15470 00000100:00100000:2.0:1746129820.463533:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054356096:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.463542:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.463551:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e78 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.463563:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.463564:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.463569:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.463579:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.463586:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136379e00, rc 0) 00000100:00100000:2.0:1746129820.463619:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054356096:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.463625:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15470 00000100:00100000:0.0:1746129820.464194:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.464783:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054356224 00000100:00100000:2.0:1746129820.464787:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054356224 00000100:00100000:2.0:1746129820.464814:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15471 00000100:00100000:2.0:1746129820.464819:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054356224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.464829:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.464838:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136378400/0x48868a4e43954ff7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e7f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.464894:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054028288:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129820.464952:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.466441:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054028160:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129820.466443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129820.466457:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.466482:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054355968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3517us (3749us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.466489:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7724 00002000:00010000:2.0:1746129820.466552:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129820 -> 1746129821 00002000:00010000:2.0:1746129820.466555:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129820 -> 1746129821 00002000:00010000:2.0:1746129820.466557:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129820 -> 1746129821 00000100:00100000:2.0:1746129820.466576:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054028288:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129820.466588:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054356480 00010000:00010000:2.0:1746129820.466592:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136378400/0x48868a4e43954ff7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e7f expref: 22 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129820.466592:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054356480 00010000:00010000:2.0:1746129820.466601:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136378400/0x48868a4e43954ff7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e7f expref: 22 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.466612:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136378400, rc 0) 00002000:00100000:1.0:1746129820.466616:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3969024->3973119) req@ffff880094768a80 x1830949054356480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.466623:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949054356480 ext(3969024->3973119) 00002000:00010000:1.0:1746129820.466627:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:2.0:1746129820.466629:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054356224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1810us (2437us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129820.466634:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15471 00000100:00100000:1.0:1746129820.466637:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6902 00000100:00100000:1.0:1746129820.466641:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054356480:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129820.466762:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054356480:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 119us (318us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129820.466767:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6902 00002000:00100000:1.0:1746129820.466772:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3969024->3973119) req@ffff880094768a80 x1830949054356480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.466779:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768a80 with x1830949054356480 ext(3969024->3973119) 00002000:00010000:1.0:1746129820.466782:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094768a80 00000100:00100000:0.0:1746129820.467448:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.467870:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054356736 00000100:00100000:1.0:1746129820.467875:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054356736 00002000:00100000:1.0:1746129820.467893:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff88009476b800 x1830949054356736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.467899:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949054356736 ext(4927488->4931583) 00002000:00010000:1.0:1746129820.467902:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476b800 00000100:00100000:1.0:1746129820.467966:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6903 00000100:00100000:1.0:1746129820.467972:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054356736:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129820.468064:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054356736:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 92us (616us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129820.468070:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6903 00002000:00100000:1.0:1746129820.468074:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff88009476b800 x1830949054356736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.468080:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b800 with x1830949054356736 ext(4927488->4931583) 00002000:00010000:1.0:1746129820.468082:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009476b800 00000100:00100000:0.0:1746129820.468911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.468962:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054356992 00000100:00100000:1.0:1746129820.468967:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054356992 00000100:00100000:1.0:1746129820.469003:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4603 00000100:00100000:1.0:1746129820.469010:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31559:x1830949054356992:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129820.469185:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31559:x1830949054356992:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 175us (274us total) trans 8589945022 rc 0/0 00000100:00100000:1.0:1746129820.469190:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4603 00000100:00100000:0.0:1746129820.470439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.470482:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054357248 00000100:00100000:3.0:1746129820.470486:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054357248 00002000:00100000:3.0:1746129820.470507:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8801305bd880 x1830949054357248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.470514:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd880 with x1830949054357248 ext(2097152->3145727) 00002000:00010000:3.0:1746129820.470518:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bd880 00000100:00100000:3.0:1746129820.470540:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6904 00000100:00100000:3.0:1746129820.470546:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054357248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.471443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.471516:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054357504 00000100:00100000:1.0:1746129820.471521:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054357504 00000100:00100000:1.0:1746129820.471555:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4604 00000100:00100000:1.0:1746129820.471561:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31548:x1830949054357504:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129820.472077:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31548:x1830949054357504:12345-192.168.204.31@tcp:35:cat.0 Request processed in 514us (634us total) trans 8589945023 rc 0/0 00000100:00100000:1.0:1746129820.472084:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4604 00000100:00100000:3.0:1746129820.477544:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054357248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6990us (7099us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.477553:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6904 00002000:00100000:3.0:1746129820.477562:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8801305bd880 x1830949054357248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.477569:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bd880 with x1830949054357248 ext(2097152->3145727) 00002000:00010000:3.0:1746129820.477573:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bd880 00000100:00100000:0.0:1746129820.481604:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.481836:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054357632 00000100:00100000:2.0:1746129820.481844:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054357632 00000100:00100000:2.0:1746129820.481905:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15472 00000100:00100000:2.0:1746129820.481911:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31556:x1830949054357632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.481926:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.481941:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e86 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.481966:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.481978:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.481980:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129820.481983:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.482007:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.482019:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 37 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.482030:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054028416:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.482115:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd57000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.483593:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054028416:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.483611:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.483622:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136378000, rc 0) 00000100:00100000:2.0:1746129820.483654:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31556:x1830949054357632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1742us (2063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.483660:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15472 00000100:00100000:0.0:1746129820.484028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.484113:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054357760 00000100:00100000:3.0:1746129820.484119:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054357760 00002000:00100000:3.0:1746129820.484157:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3678208->3973119) req@ffff8801305bed80 x1830949054357760/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.484166:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bed80 with x1830949054357760 ext(3678208->3973119) 00010000:00010000:3.0:1746129820.484175:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 38 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.484185:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 38 pid: 7976 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.484191:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305bed80 00000100:00100000:3.0:1746129820.484295:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1868 00000100:00100000:3.0:1746129820.484301:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054357760:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129820.494223:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054357760:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9915us (10188us total) trans 17179874124 rc 0/0 00000100:00100000:3.0:1746129820.494233:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1868 00002000:00100000:3.0:1746129820.494242:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3678208->3973119) req@ffff8801305bed80 x1830949054357760/t17179874124(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.494250:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bed80 with x1830949054357760 ext(3678208->3973119) 00010000:00010000:3.0:1746129820.494259:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 40 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.494272:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 40 pid: 7976 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.494282:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305bed80 00000100:00100000:0.0:1746129820.499379:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.499495:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054357888 00000100:00100000:3.0:1746129820.499503:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054357888 00010000:00010000:3.0:1746129820.499528:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 40 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.499550:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7725 00000100:00100000:3.0:1746129820.499557:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949054357888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.499566:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.499582:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 40 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.499592:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 40 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.499610:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ff98400/0x48868a4e43954fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->3973119) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e71 expref: 40 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.499633:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.499635:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.499640:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.499647:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.499679:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.499690:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054028544:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.499747:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.502409:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054028544:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129820.502426:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.502456:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054357888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2899us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.502463:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7725 00000100:00100000:0.0:1746129820.507758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.507777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.507797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.507812:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054358272 00000100:00100000:3.0:1746129820.507820:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054358272 00002000:00100000:3.0:1746129820.507867:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8801305bc700 x1830949054358272/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.507876:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bc700 with x1830949054358272 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.507880:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bc700 00000100:00100000:3.0:1746129820.507894:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054358400 00000100:00100000:3.0:1746129820.507896:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054358400 00002000:00100000:3.0:1746129820.507907:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8801305bc380 x1830949054358400/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.507913:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bc380 with x1830949054358400 ext(2097152->3145727) 00002000:00010000:3.0:1746129820.507916:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bc380 00000100:00100000:3.0:1746129820.507929:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054358528 00000100:00100000:3.0:1746129820.507931:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054358528 00002000:00100000:3.0:1746129820.507940:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8801305be680 x1830949054358528/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129820.507941:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6905 00002000:00100000:3.0:1746129820.507945:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305be680 with x1830949054358528 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.507948:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305be680 00000100:00100000:2.0:1746129820.507949:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054358272:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.507956:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6906 00000100:00100000:3.0:1746129820.507960:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054358400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.508402:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6907 00000100:00100000:3.0:1746129820.508804:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054358528:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.522336:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054358528:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13921us (14530us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.522347:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6907 00002000:00100000:3.0:1746129820.522355:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8801305be680 x1830949054358528/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.522365:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305be680 with x1830949054358528 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.522371:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305be680 00000100:00100000:2.0:1746129820.528094:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054358400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20123us (20306us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.528106:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6906 00002000:00100000:2.0:1746129820.528115:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8801305bc380 x1830949054358400/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.528124:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bc380 with x1830949054358400 ext(2097152->3145727) 00002000:00010000:2.0:1746129820.528138:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bc380 00000100:00100000:2.0:1746129820.528343:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054358272:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20394us (20589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.528349:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6905 00002000:00100000:2.0:1746129820.528353:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8801305bc700 x1830949054358272/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.528360:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bc700 with x1830949054358272 ext(3145728->4194303) 00002000:00010000:2.0:1746129820.528363:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bc700 00000100:00100000:0.0:1746129820.538415:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.538940:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054358912 00000100:00100000:2.0:1746129820.538948:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054358912 00002000:00100000:2.0:1746129820.538985:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8801305bea00 x1830949054358912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.538994:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bea00 with x1830949054358912 ext(4194304->4931583) 00002000:00010000:2.0:1746129820.538999:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bea00 00000100:00100000:2.0:1746129820.539014:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6908 00000100:00100000:2.0:1746129820.539021:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054358912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.548350:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054358912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9324us (9935us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129820.548359:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6908 00002000:00100000:3.0:1746129820.548368:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8801305bea00 x1830949054358912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.548376:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bea00 with x1830949054358912 ext(4194304->4931583) 00002000:00010000:3.0:1746129820.548381:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bea00 00000100:00100000:2.0:1746129820.554839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.554885:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054359168 00000100:00100000:1.0:1746129820.554892:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054359168 00000100:00100000:1.0:1746129820.554934:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4605 00000100:00100000:1.0:1746129820.554941:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31556:x1830949054359168:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129820.555102:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31556:x1830949054359168:12345-192.168.204.31@tcp:35:cat.0 Request processed in 161us (267us total) trans 8589945024 rc 0/0 00000100:00100000:1.0:1746129820.555108:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4605 00000001:00080000:3.0:1746129820.566309:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841318 is committed 00000001:00080000:3.0:1746129820.566325:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841301 is committed 00000001:00080000:3.0:1746129820.566345:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841248 is committed 00000001:00080000:3.0:1746129820.566399:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841295 is committed 00000001:00080000:3.0:1746129820.566413:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841282 is committed 00000001:00080000:3.0:1746129820.566446:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841319 is committed 00000001:00080000:3.0:1746129820.566452:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841299 is committed 00000001:00080000:3.0:1746129820.566465:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841283 is committed 00000001:00080000:3.0:1746129820.566478:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841320 is committed 00000100:00100000:0.0:1746129820.591684:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.592083:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054359424 00000100:00100000:2.0:1746129820.592092:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054359424 00000100:00100000:2.0:1746129820.592195:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11028 00000100:00100000:2.0:1746129820.592201:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31566:x1830949054359424:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.592220:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.592234:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43955005 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e8d expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.592402:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592413:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592422:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592433:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592438:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592443:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592525:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592531:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.592536:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:2.0:1746129820.592543:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129820.593021:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593028:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593033:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593038:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013261ba00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.593041:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593046:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593055:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.593057:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129820.593061:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593065:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013261ba00/0x48868a4e4395501a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593080:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593085:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593089:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593092:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4d6ec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.593094:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593098:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593104:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129820.593105:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.593107:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593111:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6ec00/0x48868a4e4395500c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593118:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593122:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593137:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593140:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b69ac00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.593142:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593145:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593151:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8200) 00010000:00010000:2.0:1746129820.593153:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.593155:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593159:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b69ac00/0x48868a4e43955013 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129820.593190:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43955005 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e8d expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.593197:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4d6f800/0x48868a4e43955005 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e8d expref: 287 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.593204:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4d6f800, rc 0) 00000100:00100000:2.0:1746129820.593240:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31566:x1830949054359424:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1039us (1564us total) trans 8589945025 rc 301/301 00000100:00100000:2.0:1746129820.593246:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11028 00000100:00100000:2.0:1746129820.598740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.599173:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054359680 00000100:00100000:3.0:1746129820.599181:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054359680 00000100:00100000:3.0:1746129820.599213:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11029 00000100:00100000:3.0:1746129820.599219:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31568:x1830949054359680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.599238:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.599255:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e43955028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e94 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.599334:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599345:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599353:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599363:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599368:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599372:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599455:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599461:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599466:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:3.0:1746129820.599473:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129820.599529:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599535:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599540:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599545:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.599548:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599553:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599562:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.599564:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129820.599568:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599572:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e4395503d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599592:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599597:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599601:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599604:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.599606:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599610:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599615:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129820.599616:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.599619:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599622:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395502f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599629:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599633:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599638:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599641:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.599644:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599648:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599653:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2e00) 00010000:00010000:3.0:1746129820.599654:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.599656:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599660:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2000/0x48868a4e43955036 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129820.599861:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e43955028 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e94 expref: 288 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.599869:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3c00/0x48868a4e43955028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e94 expref: 288 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.599875:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3c00, rc 0) 00000100:00100000:3.0:1746129820.599929:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31568:x1830949054359680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 709us (1196us total) trans 8589945026 rc 301/301 00000100:00100000:3.0:1746129820.599936:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11029 00000100:00100000:2.0:1746129820.603699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.603742:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054359808 00000100:00100000:2.0:1746129820.603749:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054359808 00000100:00100000:2.0:1746129820.603779:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11030 00000100:00100000:2.0:1746129820.603785:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31568:x1830949054359808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.603803:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.603818:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f800/0x48868a4e4395504b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355e9b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.604032:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.604043:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.604052:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129820.604076:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129820.604080:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129820.604106:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.604133:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f800/0x48868a4e4395504b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 289 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.604147:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 288 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.604153:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.604155:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129820.604158:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f600, rc 0) 00000100:00100000:2.0:1746129820.604250:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31568:x1830949054359808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 464us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.604256:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11030 00000100:00100000:0.0:1746129820.608529:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.608877:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054359936 00000100:00100000:3.0:1746129820.608885:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054359936 00000100:00100000:3.0:1746129820.608919:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15473 00000100:00100000:3.0:1746129820.608925:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1964:x1830949054359936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.608939:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.608952:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ea2 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.608972:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.608974:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.608981:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.608995:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.609004:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2000, rc 0) 00000100:00100000:3.0:1746129820.609040:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949054359936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 115us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.609045:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15473 00000100:00100000:0.0:1746129820.627619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.627974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.627998:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054360192 00000100:00100000:2.0:1746129820.628007:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054360192 00002000:00100000:2.0:1746129820.628042:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8801305bf800 x1830949054360192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.628051:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bf800 with x1830949054360192 ext(0->1048575) 00002000:00010000:2.0:1746129820.628055:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bf800 00000100:00100000:0.0:1746129820.628061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.628376:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054360704 00000100:00100000:2.0:1746129820.628376:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054360448 00000100:00100000:3.0:1746129820.628380:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054360704 00000100:00100000:2.0:1746129820.628380:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054360448 00002000:00100000:2.0:1746129820.628395:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8801305bfb80 x1830949054360448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.628397:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8801305bc000 x1830949054360704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.628404:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bc000 with x1830949054360704 ext(1048576->2097151) 00002000:00010000:3.0:1746129820.628407:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bc000 00002000:00100000:2.0:1746129820.628408:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bfb80 with x1830949054360448 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.628411:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bfb80 00000100:00100000:3.0:1746129820.628419:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6909 00000100:00100000:2.0:1746129820.628424:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6910 00000100:00100000:3.0:1746129820.628425:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054360192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.628429:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949054360704:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.628869:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6911 00000100:00100000:2.0:1746129820.628874:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949054360448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.629030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.629052:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054360960 00000100:00100000:0.0:1746129820.629055:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054360960 00002000:00100000:0.0:1746129820.629068:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a0094000 x1830949054360960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.629075:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094000 with x1830949054360960 ext(1048576->2097151) 00002000:00010000:0.0:1746129820.629078:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0094000 00000100:00100000:0.0:1746129820.629087:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6912 00000100:00100000:0.0:1746129820.629090:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054360960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.639392:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1963:x1830949054360448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10509us (11410us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129820.639403:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6911 00002000:00100000:0.0:1746129820.639412:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8801305bfb80 x1830949054360448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.639421:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bfb80 with x1830949054360448 ext(1048576->2097151) 00002000:00010000:0.0:1746129820.639426:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bfb80 00000100:00100000:3.0:1746129820.645359:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054360192:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16923us (17734us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.645371:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6909 00002000:00100000:3.0:1746129820.645381:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8801305bf800 x1830949054360192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.645392:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bf800 with x1830949054360192 ext(0->1048575) 00002000:00010000:3.0:1746129820.645397:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801305bf800 00000100:00100000:0.0:1746129820.651445:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949054360704:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23005us (23374us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129820.651456:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6910 00002000:00100000:0.0:1746129820.651468:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8801305bc000 x1830949054360704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.651476:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bc000 with x1830949054360704 ext(1048576->2097151) 00002000:00010000:0.0:1746129820.651481:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801305bc000 00000100:00100000:2.0:1746129820.658857:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054360960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29742us (29803us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.658872:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6912 00002000:00100000:2.0:1746129820.658888:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a0094000 x1830949054360960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.658896:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094000 with x1830949054360960 ext(1048576->2097151) 00002000:00010000:2.0:1746129820.658902:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0094000 00000100:00100000:0.0:1746129820.677434:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.677517:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054361216 00000100:00100000:2.0:1746129820.677524:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054361216 00000100:00100000:2.0:1746129820.678099:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11031 00000100:00100000:2.0:1746129820.678107:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31573:x1830949054361216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.678134:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.678149:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66400/0x48868a4e43955060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ea9 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.678222:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678236:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678244:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678255:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678260:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678264:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678340:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678347:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678353:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129820.678360:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129820.678411:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678417:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678421:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678429:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b66a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.678432:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678438:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678448:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.678450:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129820.678453:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678462:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66a00/0x48868a4e43955075 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678473:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678477:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678480:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678484:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b66200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.678486:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678490:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678496:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129820.678498:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.678500:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678504:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66200/0x48868a4e43955067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678509:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678513:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678517:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678520:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b67c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.678522:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678526:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678531:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5054e00) 00010000:00010000:2.0:1746129820.678533:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.678535:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678538:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b67c00/0x48868a4e4395506e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129820.678567:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66400/0x48868a4e43955060 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea9 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.678574:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66400/0x48868a4e43955060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea9 expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.678582:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66400, rc 0) 00000100:00100000:2.0:1746129820.678633:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31573:x1830949054361216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 527us (1204us total) trans 8589945027 rc 301/301 00000100:00100000:2.0:1746129820.678640:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11031 00000100:00100000:1.0:1746129820.682536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.682557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.682570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.682603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.682645:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054361472 00000100:00100000:3.0:1746129820.682651:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054361728 00000100:00100000:2.0:1746129820.682653:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054361472 00000100:00100000:3.0:1746129820.682654:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054361728 00002000:00100000:3.0:1746129820.682686:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faa0e00 x1830949054361728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.682686:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faa1180 x1830949054361472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.682695:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0e00 with x1830949054361728 ext(3145728->4194303) 00002000:00100000:2.0:1746129820.682695:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1180 with x1830949054361472 ext(2097152->3145727) 00002000:00010000:3.0:1746129820.682699:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0e00 00002000:00010000:2.0:1746129820.682699:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1180 00000100:00100000:2.0:1746129820.682718:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054361984 00000100:00100000:2.0:1746129820.682720:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054361984 00002000:00100000:2.0:1746129820.682731:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009faa1880 x1830949054361984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.682737:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1880 with x1830949054361984 ext(2097152->3145727) 00002000:00010000:2.0:1746129820.682740:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa1880 00000100:00100000:2.0:1746129820.682747:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054362240 00000100:00100000:2.0:1746129820.682749:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054362240 00002000:00100000:2.0:1746129820.682758:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faa2680 x1830949054362240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.682763:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2680 with x1830949054362240 ext(3145728->4194303) 00002000:00010000:2.0:1746129820.682765:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa2680 00000100:00100000:2.0:1746129820.682775:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6913 00000100:00100000:2.0:1746129820.682781:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054361728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.682797:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6914 00000100:00100000:0.0:1746129820.682803:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054361472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.682826:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6915 00000100:00100000:0.0:1746129820.682831:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1963:x1830949054361984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.682902:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6916 00000100:00100000:2.0:1746129820.682908:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1964:x1830949054362240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.683761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.683796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.683811:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054362368 00000100:00100000:3.0:1746129820.683815:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054362368 00000100:00100000:3.0:1746129820.683832:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054362624 00000100:00100000:3.0:1746129820.683834:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054362624 00000100:00100000:3.0:1746129820.683845:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11032 00000100:00100000:3.0:1746129820.683865:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31573:x1830949054362368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.683878:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.683892:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3000/0x48868a4e43955083 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355eb0 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.683948:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.683958:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.683967:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129820.683990:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129820.683994:0:14315:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129820.684006:0:14315:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684025:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3000/0x48868a4e43955083 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.684036:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.684044:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.684046:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129820.684049:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2600, rc 0) 00000100:00100000:3.0:1746129820.684084:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31573:x1830949054362368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 218us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.684089:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11032 00000100:00100000:3.0:1746129820.684110:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11033 00000100:00100000:3.0:1746129820.684115:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31571:x1830949054362624:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129820.684120:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.684135:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43955091 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355eb7 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.684185:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684192:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684200:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684210:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684215:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684219:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684287:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684293:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684297:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129820.684303:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129820.684358:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684364:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684368:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684373:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.684375:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684380:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684387:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.684389:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129820.684391:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684395:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2800/0x48868a4e439550a6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684403:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684407:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684411:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684415:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff3a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.684417:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684421:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684426:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129820.684427:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.684429:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684432:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43955098 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684438:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684442:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684446:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684449:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4ff2c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.684451:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684455:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684460:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2300) 00010000:00010000:3.0:1746129820.684462:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.684464:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684468:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2c00/0x48868a4e4395509f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129820.684489:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43955091 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb7 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.684495:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff3200/0x48868a4e43955091 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb7 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.684502:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3200, rc 0) 00000100:00100000:3.0:1746129820.684525:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31571:x1830949054362624:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 409us (729us total) trans 8589945028 rc 301/301 00000100:00100000:3.0:1746129820.684530:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11033 00000100:00100000:2.0:1746129820.694473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.694603:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054362880 00000100:00100000:3.0:1746129820.694614:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054362880 00002000:00100000:3.0:1746129820.694676:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009206ce00 x1830949054362880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.694689:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206ce00 with x1830949054362880 ext(0->1048575) 00002000:00010000:3.0:1746129820.694696:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206ce00 00000100:00100000:3.0:1746129820.694725:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6917 00000100:00100000:3.0:1746129820.694732:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054362880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129820.699579:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1963:x1830949054361984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16736us (16996us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.699589:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6915 00002000:00100000:1.0:1746129820.699599:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009faa1880 x1830949054361984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.699607:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1880 with x1830949054361984 ext(2097152->3145727) 00002000:00010000:1.0:1746129820.699613:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa1880 00000100:00100000:2.0:1746129820.699690:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949054362240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16781us (17085us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.699696:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6916 00002000:00100000:2.0:1746129820.699701:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faa2680 x1830949054362240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.699706:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2680 with x1830949054362240 ext(3145728->4194303) 00002000:00010000:2.0:1746129820.699709:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa2680 00000001:00080000:0.0:1746129820.705788:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874122 is committed 00000001:00080000:0.0:1746129820.705835:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874056 is committed 00000001:00080000:0.0:1746129820.705867:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874046 is committed 00000001:00080000:0.0:1746129820.705910:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874077 is committed 00000001:00080000:0.0:1746129820.705923:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874058 is committed 00000001:00080000:0.0:1746129820.705935:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874123 is committed 00000001:00080000:0.0:1746129820.705952:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874107 is committed 00000001:00080000:0.0:1746129820.705964:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874092 is committed 00000001:00080000:0.0:1746129820.705973:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874079 is committed 00000001:00080000:0.0:1746129820.706011:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874124 is committed 00000001:00080000:0.0:1746129820.706021:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874106 is committed 00000100:00100000:2.0:1746129820.709987:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054361728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27197us (27420us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.709998:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6913 00002000:00100000:2.0:1746129820.710007:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faa0e00 x1830949054361728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.710016:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0e00 with x1830949054361728 ext(3145728->4194303) 00002000:00010000:2.0:1746129820.710020:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0e00 00000100:00100000:3.0:1746129820.710038:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054361472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27234us (27505us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.710044:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6914 00002000:00100000:3.0:1746129820.710048:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009faa1180 x1830949054361472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.710054:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1180 with x1830949054361472 ext(2097152->3145727) 00002000:00010000:3.0:1746129820.710056:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1180 00000100:00100000:0.0:1746129820.715062:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054362880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20322us (20590us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129820.715073:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6917 00002000:00100000:0.0:1746129820.715082:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009206ce00 x1830949054362880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129820.715090:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206ce00 with x1830949054362880 ext(0->1048575) 00002000:00010000:0.0:1746129820.715095:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206ce00 00000100:00100000:0.0:1746129820.733484:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.733662:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054363136 00000100:00100000:2.0:1746129820.733670:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054363136 00002000:00100000:2.0:1746129820.733706:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4927487) req@ffff8800a0097800 x1830949054363136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.733715:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097800 with x1830949054363136 ext(4194304->4927487) 00002000:00010000:2.0:1746129820.733720:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097800 00000100:00100000:2.0:1746129820.733753:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6918 00000100:00100000:2.0:1746129820.733759:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054363136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129820.749003:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054363136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15235us (15516us total) trans 0 rc 733184/733184 00000100:00100000:3.0:1746129820.749015:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6918 00002000:00100000:3.0:1746129820.749026:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4927487) req@ffff8800a0097800 x1830949054363136/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.749035:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097800 with x1830949054363136 ext(4194304->4927487) 00002000:00010000:3.0:1746129820.749041:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097800 00000100:00100000:0.0:1746129820.752987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.753043:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054363392 00000100:00100000:1.0:1746129820.753050:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054363392 00000100:00100000:1.0:1746129820.753097:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4606 00000100:00100000:1.0:1746129820.753105:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31573:x1830949054363392:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129820.754805:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31573:x1830949054363392:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1695us (1829us total) trans 8589945029 rc 0/0 00000100:00100000:1.0:1746129820.754815:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4606 00000100:00100000:0.0:1746129820.759646:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.759702:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054363776 00000100:00100000:2.0:1746129820.759709:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054363776 00000100:00100000:2.0:1746129820.759760:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15474 00000100:00100000:2.0:1746129820.759768:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31571:x1830949054363776:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129820.759783:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.759797:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ebe expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.759821:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.759829:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.759835:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.759837:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.759840:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2183168->2863103] (req 2183168->2863103) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.759895:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129820.759905:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746129820.759920:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054028672:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129820.760006:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.760013:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 12 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.760020:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054028800:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.760038:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.764622:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.764747:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054363648 00000100:00100000:1.0:1746129820.764755:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054363648 00000100:00100000:2.0:1746129820.765090:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4607 00000100:00100000:2.0:1746129820.765099:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31568:x1830949054363648:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129820.765584:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054028672:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.765967:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31568:x1830949054363648:12345-192.168.204.31@tcp:35:cat.0 Request processed in 868us (1352us total) trans 8589945030 rc 0/0 00000100:00100000:3.0:1746129820.765971:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054028800:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129820.765974:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4607 00010000:00010000:3.0:1746129820.765995:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2183168->2863103] (req 2183168->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.766009:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f96f800, rc 0) 00000100:00100000:3.0:1746129820.766225:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31571:x1830949054363776:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6457us (6585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.766231:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15474 00000100:00100000:0.0:1746129820.768967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.769088:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054363904 00000100:00100000:3.0:1746129820.769096:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054363904 00010000:00010000:3.0:1746129820.769142:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.769180:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7726 00000100:00100000:3.0:1746129820.769188:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054363904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.769200:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.769221:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.769232:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.769252:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136379e00/0x48868a4e43954ff0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e78 expref: 10 pid: 7976 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.769280:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.769320:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054363904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 133us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.769326:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7726 00000100:00100000:2.0:1746129820.770016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.770159:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054364032 00000100:00100000:1.0:1746129820.770163:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054364032 00010000:00010000:1.0:1746129820.770179:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 13 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746129820.770199:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7727 00000100:00100000:1.0:1746129820.770203:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054364032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129820.770210:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129820.770220:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 13 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.770228:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 13 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.770241:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ff99a00/0x48868a4e43954fe2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e6a expref: 13 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746129820.770256:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.770257:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129820.770264:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.770270:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.770296:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129820.770305:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054028928:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129820.770349:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.774493:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054028928:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129820.774512:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129820.774666:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.774701:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054364032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4495us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.774709:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7727 00000100:00100000:3.0:1746129820.775246:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054364288 00000100:00100000:3.0:1746129820.775253:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054364288 00002000:00100000:3.0:1746129820.775285:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2183168->2187263) req@ffff88009faa3100 x1830949054364288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.775294:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3100 with x1830949054364288 ext(2183168->2187263) 00002000:00010000:3.0:1746129820.775298:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa3100 00000100:00100000:3.0:1746129820.776532:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6919 00000100:00100000:3.0:1746129820.776541:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054364288:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.777199:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054364288:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 659us (2533us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.777206:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6919 00002000:00100000:3.0:1746129820.777213:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2183168->2187263) req@ffff88009faa3100 x1830949054364288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.777222:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3100 with x1830949054364288 ext(2183168->2187263) 00002000:00010000:3.0:1746129820.777225:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa3100 00000100:00100000:0.0:1746129820.789602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.789711:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054364544 00000100:00100000:3.0:1746129820.789719:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054364544 00002000:00100000:3.0:1746129820.789759:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2859008->2863103) req@ffff8800a0095880 x1830949054364544/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.789775:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095880 with x1830949054364544 ext(2859008->2863103) 00002000:00010000:3.0:1746129820.789779:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0095880 00000100:00100000:3.0:1746129820.789800:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6920 00000100:00100000:3.0:1746129820.789806:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054364544:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.790086:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054364544:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 279us (490us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.790092:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6920 00002000:00100000:3.0:1746129820.790098:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2859008->2863103) req@ffff8800a0095880 x1830949054364544/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.790104:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095880 with x1830949054364544 ext(2859008->2863103) 00002000:00010000:3.0:1746129820.790106:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0095880 00000100:00100000:0.0:1746129820.793603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.797535:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054364800 00000100:00100000:2.0:1746129820.797546:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054364800 00000100:00100000:2.0:1746129820.797609:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4608 00000100:00100000:2.0:1746129820.797617:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31571:x1830949054364800:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129820.799361:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31571:x1830949054364800:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1738us (5759us total) trans 8589945031 rc 0/0 00000100:00100000:2.0:1746129820.799369:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4608 00000100:00100000:0.0:1746129820.799866:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.799926:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054364928 00000100:00100000:3.0:1746129820.799932:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054364928 00000100:00100000:3.0:1746129820.799959:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15475 00000100:00100000:3.0:1746129820.799965:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31566:x1830949054364928:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129820.799976:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.799991:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ec5 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.800011:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 7 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.800018:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.800028:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.800030:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.800032:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3600384->4194303] (req 3600384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.800053:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.800062:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.800072:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054029056:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.800147:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 7 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.800154:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 7 pid: 20441 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.800161:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054029184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.800175:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.804098:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054029056:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.804108:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054029184:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.804142:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3600384->4194303] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.804161:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66e00, rc 0) 00000100:00100000:3.0:1746129820.804206:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31566:x1830949054364928:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4240us (4340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.804214:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15475 00000100:00100000:0.0:1746129820.806541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.807787:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054365056 00000100:00100000:2.0:1746129820.807796:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054365056 00010000:00010000:2.0:1746129820.807827:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 8 pid: 20441 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746129820.807879:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7728 00000100:00100000:2.0:1746129820.807892:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054365056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.807903:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.807922:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 8 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.807932:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 8 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.807951:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136378000/0x48868a4e43954ffe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e86 expref: 8 pid: 20441 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.807973:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.808017:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1962:x1830949054365056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 125us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.808023:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7728 00000100:00100000:0.0:1746129820.812585:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.812679:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054365184 00000100:00100000:3.0:1746129820.812687:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054365184 00010000:00010000:3.0:1746129820.812715:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746129820.812751:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7729 00000100:00100000:3.0:1746129820.812758:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054365184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.812769:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.812786:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.812798:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.812817:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff2000/0x48868a4e43955059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ea2 expref: 21 pid: 20441 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746129820.812832:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.812834:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.812840:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.812873:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.812899:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.812910:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054029312:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.812997:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.817554:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054029312:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129820.817574:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.817609:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054365184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4850us (5030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.817618:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7729 00000100:00100000:0.0:1746129820.818307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.818387:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054365440 00000100:00100000:3.0:1746129820.818393:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054365440 00002000:00100000:3.0:1746129820.818424:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3600384->3604479) req@ffff8800a0097100 x1830949054365440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.818433:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097100 with x1830949054365440 ext(3600384->3604479) 00002000:00010000:3.0:1746129820.818437:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0097100 00000100:00100000:3.0:1746129820.818464:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6921 00000100:00100000:3.0:1746129820.818470:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054365440:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.819567:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054365440:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1093us (1257us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.819577:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6921 00002000:00100000:3.0:1746129820.819584:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3600384->3604479) req@ffff8800a0097100 x1830949054365440/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.819592:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097100 with x1830949054365440 ext(3600384->3604479) 00002000:00010000:3.0:1746129820.819595:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0097100 00000100:00100000:0.0:1746129820.825308:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.825507:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054365568 00000100:00100000:3.0:1746129820.825515:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054365568 00000100:00100000:3.0:1746129820.825548:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15476 00000100:00100000:3.0:1746129820.825555:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:31566:x1830949054365568:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129820.825570:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.825583:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ecc expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.825606:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.825613:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.825614:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.825617:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4591615] (req 4194304->4591615) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.825640:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.825650:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 8 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.825665:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054029440:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.827690:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.831941:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054029440:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.831968:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4591615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.831983:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67a00, rc 0) 00000100:00100000:3.0:1746129820.832039:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31566:x1830949054365568:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6483us (6738us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.832046:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15476 00000100:00100000:0.0:1746129820.833272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.834189:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054365696 00000100:00100000:3.0:1746129820.834196:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054365696 00002000:00100000:3.0:1746129820.834230:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2183168->2863103) req@ffff8800a0095500 x1830949054365696/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.834238:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095500 with x1830949054365696 ext(2183168->2863103) 00010000:00010000:3.0:1746129820.834245:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 9 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.834256:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 9 pid: 7976 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.834262:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0095500 00000100:00100000:3.0:1746129820.834288:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1869 00000100:00100000:3.0:1746129820.834295:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054365696:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129820.843079:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054365696:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8775us (9799us total) trans 21474841321 rc 0/0 00000100:00100000:3.0:1746129820.843090:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1869 00002000:00100000:3.0:1746129820.843100:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2183168->2863103) req@ffff8800a0095500 x1830949054365696/t21474841321(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.843108:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095500 with x1830949054365696 ext(2183168->2863103) 00010000:00010000:3.0:1746129820.843117:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 11 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.843141:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 11 pid: 7976 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746129820.843147:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0095500 00000100:00100000:0.0:1746129820.845340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.845472:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054365824 00000100:00100000:3.0:1746129820.845479:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054365824 00010000:00010000:3.0:1746129820.845504:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 11 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.845540:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7730 00000100:00100000:3.0:1746129820.845546:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054365824:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.845556:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.845573:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 11 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.845582:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 11 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.845601:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f96f800/0x48868a4e439550b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2863103) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ebe expref: 11 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.845625:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.845627:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.845634:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.845641:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.845668:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.845679:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054029568:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.845759:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129820.849552:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054029568:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129820.849572:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129820.849624:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054365824:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4077us (4288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.849634:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7730 00000100:00100000:0.0:1746129820.851193:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.851307:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054366080 00000100:00100000:3.0:1746129820.851313:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054366080 00002000:00100000:3.0:1746129820.851347:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4587520->4591615) req@ffff8800a0097b80 x1830949054366080/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.851361:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097b80 with x1830949054366080 ext(4587520->4591615) 00002000:00010000:3.0:1746129820.851366:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097b80 00000100:00100000:3.0:1746129820.851390:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6922 00000100:00100000:3.0:1746129820.851397:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054366080:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129820.851729:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054366080:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 331us (539us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129820.851735:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6922 00002000:00100000:3.0:1746129820.851740:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4587520->4591615) req@ffff8800a0097b80 x1830949054366080/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/4536 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.851746:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097b80 with x1830949054366080 ext(4587520->4591615) 00002000:00010000:3.0:1746129820.851749:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097b80 00000100:00100000:0.0:1746129820.854296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.854388:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054366336 00000100:00100000:2.0:1746129820.854395:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054366336 00000100:00100000:2.0:1746129820.854435:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4609 00000100:00100000:2.0:1746129820.854441:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31566:x1830949054366336:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129820.854609:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31566:x1830949054366336:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 168us (319us total) trans 8589945032 rc 0/0 00000100:00100000:2.0:1746129820.854615:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4609 00000100:00100000:0.0:1746129820.879375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.879476:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054366592 00000100:00100000:3.0:1746129820.879483:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054366592 00000100:00100000:3.0:1746129820.879530:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11034 00000100:00100000:3.0:1746129820.879537:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31580:x1830949054366592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.879553:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.879566:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130676e00/0x48868a4e439550c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ed3 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.879649:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879660:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879669:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879680:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879685:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879689:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879791:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879799:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879805:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129820.879812:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129820.879903:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879909:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879915:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879919:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130676c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.879922:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879927:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879937:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.879939:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129820.879942:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879946:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130676c00/0x48868a4e439550de lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879965:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879970:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879973:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879976:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130676200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.879979:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879983:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879989:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129820.879990:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.879993:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.879997:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130676200/0x48868a4e439550d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880003:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880007:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880011:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880015:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130676800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.880017:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880021:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880025:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5054e00) 00010000:00010000:3.0:1746129820.880027:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.880029:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880061:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130676800/0x48868a4e439550d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.880093:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130676e00/0x48868a4e439550c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ed3 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.880100:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130676e00/0x48868a4e439550c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ed3 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.880107:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130676e00, rc 0) 00000100:00100000:3.0:1746129820.880161:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31580:x1830949054366592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 623us (793us total) trans 8589945033 rc 301/301 00000100:00100000:3.0:1746129820.880168:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11034 00000100:00100000:0.0:1746129820.882581:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.882617:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.882639:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054366720 00000100:00100000:3.0:1746129820.882645:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054366720 00000100:00100000:3.0:1746129820.882682:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054366848 00000100:00100000:3.0:1746129820.882684:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054366848 00000100:00100000:1.0:1746129820.882690:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15477 00000100:00100000:1.0:1746129820.882700:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054366720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129820.882712:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.882724:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa00a00/0x48868a4e439550ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355eda expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.882743:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15478 00000100:00100000:3.0:1746129820.882749:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054366848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.882756:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129820.882764:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054029696:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129820.882765:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67c00/0x48868a4e439550f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ee1 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.882790:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054029824:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129820.882878:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.882881:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00002000:00010000:1.0:1746129820.884225:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129819 -> 1746129821 00000100:00100000:3.0:1746129820.884230:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054029824:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129820.884240:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054029696:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129820.884248:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67c00/0x48868a4e439550f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ee1 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.884258:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00a00/0x48868a4e439550ec lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eda expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.884259:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67c00/0x48868a4e439550f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ee1 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.884267:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67c00, rc 0) 00010000:00010000:1.0:1746129820.884288:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00a00/0x48868a4e439550ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eda expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129820.884305:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054366848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1556us (1686us total) trans 0 rc 301/301 00010000:00010000:1.0:1746129820.884309:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00a00, rc 0) 00000100:00100000:3.0:1746129820.884311:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15478 00000100:00100000:1.0:1746129820.884329:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054366720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1632us (1753us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129820.884334:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15477 00000100:00100000:2.0:1746129820.892187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.892238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.892297:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054366976 00000100:00100000:3.0:1746129820.892306:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054366976 00000100:00100000:1.0:1746129820.892310:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054367104 00000100:00100000:1.0:1746129820.892314:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054367104 00000100:00100000:1.0:1746129820.892344:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15479 00000100:00100000:3.0:1746129820.892351:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15480 00000100:00100000:1.0:1746129820.892351:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1962:x1830949054367104:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129820.892356:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054366976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.892366:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.892366:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.892379:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5216400/0x48868a4e439550fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ee8 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.892379:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955101 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355eef expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.892418:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054030080:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129820.892418:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054029952:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129820.892738:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.892743:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129820.893843:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054029952:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129820.893888:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955101 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eef expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129820.893897:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955101 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eef expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129820.893905:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054030080:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129820.893912:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01600, rc 0) 00010000:00010000:3.0:1746129820.893920:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216400/0x48868a4e439550fa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ee8 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.893930:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216400/0x48868a4e439550fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ee8 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129820.893940:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216400, rc 0) 00000100:00100000:1.0:1746129820.893944:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1962:x1830949054367104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1594us (1705us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129820.893950:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15479 00000100:00100000:3.0:1746129820.893958:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054366976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1601us (1778us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129820.893963:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15480 00000100:00100000:0.0:1746129820.895595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.895668:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054367232 00000100:00100000:3.0:1746129820.895673:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054367232 00000100:00100000:3.0:1746129820.895708:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15481 00000100:00100000:3.0:1746129820.895715:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31580:x1830949054367232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.895725:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.895736:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ef6 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.896615:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.896623:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.896625:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.896628:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.896651:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.896661:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 12 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.896671:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054030208:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.896755:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.898653:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.898756:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054030208:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.898776:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.898789:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217600, rc 0) 00000100:00100000:3.0:1746129820.898834:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31580:x1830949054367232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3119us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.898841:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15481 00000100:00100000:2.0:1746129820.898977:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054367360 00000100:00100000:2.0:1746129820.898983:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054367360 00002000:00100000:2.0:1746129820.899049:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4591615) req@ffff880091fa5180 x1830949054367360/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.899057:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5180 with x1830949054367360 ext(4194304->4591615) 00010000:00010000:2.0:1746129820.899063:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 13 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.899072:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 13 pid: 7976 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746129820.899078:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa5180 00000100:00100000:2.0:1746129820.899104:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1870 00000100:00100000:2.0:1746129820.899110:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054367360:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129820.909932:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054367360:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 10812us (11274us total) trans 21474841322 rc 0/0 00000100:00100000:2.0:1746129820.910202:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1870 00002000:00100000:2.0:1746129820.910212:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4591615) req@ffff880091fa5180 x1830949054367360/t21474841322(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.910220:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5180 with x1830949054367360 ext(4194304->4591615) 00010000:00010000:2.0:1746129820.910229:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 15 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.910243:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 15 pid: 7976 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746129820.910248:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa5180 00000100:00100000:0.0:1746129820.912992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.913058:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054367488 00000100:00100000:3.0:1746129820.913066:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054367488 00010000:00010000:3.0:1746129820.913093:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 15 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.913139:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7731 00000100:00100000:3.0:1746129820.913146:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054367488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129820.913156:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129820.913174:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 15 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.913184:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 15 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.913203:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67a00/0x48868a4e439550c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ecc expref: 15 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746129820.913232:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.913234:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.913240:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.913247:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.913273:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129820.913283:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054030336:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129820.913358:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.914807:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054030336:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129820.914823:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.914886:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054367488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1739us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.914894:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7731 00000100:00100000:0.0:1746129820.918754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.919183:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054367744 00000100:00100000:2.0:1746129820.919191:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054367744 00002000:00100000:2.0:1746129820.919228:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880091fa5880 x1830949054367744/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.919237:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5880 with x1830949054367744 ext(2097152->3145727) 00002000:00010000:2.0:1746129820.919241:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5880 00000100:00100000:2.0:1746129820.919269:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6923 00000100:00100000:2.0:1746129820.919275:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054367744:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129820.922771:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.923605:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054368000 00000100:00100000:3.0:1746129820.923612:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054368000 00000100:00100000:3.0:1746129820.923647:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11035 00000100:00100000:3.0:1746129820.923655:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31582:x1830949054368000:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129820.923673:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.923687:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216600/0x48868a4e4395510f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355efd expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.923771:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923782:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923790:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923800:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923805:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923810:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923910:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923917:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923922:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129820.923932:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129820.923992:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.923997:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924002:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924006:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5217800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.924009:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924015:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924024:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129820.924027:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129820.924031:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924035:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217800/0x48868a4e43955124 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924064:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924069:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924073:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924080:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5217e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.924082:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924087:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924093:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129820.924095:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.924097:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924101:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217e00/0x48868a4e43955116 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924108:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924117:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924131:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924135:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5216c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129820.924138:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924143:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924148:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bfcaa00) 00010000:00010000:3.0:1746129820.924150:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129820.924152:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924156:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216c00/0x48868a4e4395511d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129820.924185:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216600/0x48868a4e4395510f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355efd expref: 18 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.924192:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5216600/0x48868a4e4395510f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355efd expref: 18 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.924199:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216600, rc 0) 00000100:00100000:3.0:1746129820.924242:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31582:x1830949054368000:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 588us (1477us total) trans 8589945034 rc 301/301 00000100:00100000:3.0:1746129820.924248:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11035 00000100:00100000:2.0:1746129820.930837:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054367744:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11553us (12082us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.930911:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6923 00002000:00100000:2.0:1746129820.930922:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880091fa5880 x1830949054367744/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.930930:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5880 with x1830949054367744 ext(2097152->3145727) 00002000:00010000:2.0:1746129820.930939:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa5880 00000100:00100000:0.0:1746129820.936983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129820.937047:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054368128 00000100:00100000:3.0:1746129820.937055:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054368128 00000100:00100000:3.0:1746129820.937102:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15482 00000100:00100000:3.0:1746129820.937110:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31580:x1830949054368128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129820.937148:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.937799:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f04 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.937825:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.937832:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.937834:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129820.937838:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.937957:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.937967:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 19 pid: 7976 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746129820.937977:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054030464:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.938051:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.942156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.942224:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054368256 00000100:00100000:2.0:1746129820.942231:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054368256 00002000:00100000:2.0:1746129820.942268:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3600384->4194303) req@ffff880091fa5c00 x1830949054368256/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.942277:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5c00 with x1830949054368256 ext(3600384->4194303) 00010000:00010000:2.0:1746129820.942285:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 20 pid: 7976 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746129820.942297:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 20 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129820.942303:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091fa5c00 00000100:00100000:2.0:1746129820.942323:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1871 00000100:00100000:2.0:1746129820.942330:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054368256:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129820.942827:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054030464:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129820.942873:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 8 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.942886:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217c00, rc 0) 00000100:00100000:3.0:1746129820.943219:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31580:x1830949054368128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6109us (6242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129820.943226:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15482 00000100:00100000:3.0:1746129820.962097:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054368256:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 19753us (19934us total) trans 17179874125 rc 0/0 00000100:00100000:3.0:1746129820.962111:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1871 00002000:00100000:3.0:1746129820.962131:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3600384->4194303) req@ffff880091fa5c00 x1830949054368256/t17179874125(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:561/0 lens 488/448 e 0 to 0 dl 1746129831 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.962141:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa5c00 with x1830949054368256 ext(3600384->4194303) 00010000:00010000:3.0:1746129820.962159:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129820.962178:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129820.962186:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091fa5c00 00000100:00100000:0.0:1746129820.965503:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.966059:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054368384 00000100:00100000:2.0:1746129820.966071:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054368384 00010000:00010000:2.0:1746129820.966108:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129820.966148:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7732 00000100:00100000:2.0:1746129820.966157:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054368384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129820.966168:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129820.966191:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129820.966202:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129820.966224:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b66e00/0x48868a4e439550bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3600384->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ec5 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129820.966253:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.966255:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129820.966261:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 7 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.966268:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 7 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.966298:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 7 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129820.966308:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054030592:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129820.966401:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129820.968907:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054030592:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129820.968926:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129820.968973:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054368384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2816us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129820.968982:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7732 00000100:00100000:0.0:1746129820.974086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.974163:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.974249:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054368640 00000100:00100000:0.0:1746129820.974249:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.974259:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054368640 00002000:00100000:1.0:1746129820.974305:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880091fa6a00 x1830949054368640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.974315:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6a00 with x1830949054368640 ext(2097152->3145727) 00002000:00010000:1.0:1746129820.974320:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6a00 00000100:00100000:1.0:1746129820.974338:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054368896 00000100:00100000:1.0:1746129820.974340:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054368896 00002000:00100000:1.0:1746129820.974350:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880091fa7100 x1830949054368896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.974362:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7100 with x1830949054368896 ext(3145728->4194303) 00002000:00010000:1.0:1746129820.974365:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa7100 00000100:00100000:1.0:1746129820.974373:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054369152 00000100:00100000:1.0:1746129820.974375:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054369152 00002000:00100000:1.0:1746129820.974386:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880091fa4000 x1830949054369152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.974392:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4000 with x1830949054369152 ext(3145728->4194303) 00002000:00010000:1.0:1746129820.974394:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa4000 00000100:00100000:1.0:1746129820.974411:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6924 00000100:00100000:1.0:1746129820.974417:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054368640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.974547:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6925 00000100:00100000:2.0:1746129820.974558:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054368896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.974700:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6926 00000100:00100000:2.0:1746129820.974707:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054369152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129820.987832:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.987983:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054369408 00000100:00100000:1.0:1746129820.987991:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054369408 00000100:00100000:1.0:1746129820.988037:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11036 00000100:00100000:1.0:1746129820.988044:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31584:x1830949054369408:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129820.988062:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129820.988074:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69000/0x48868a4e43955139 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f0b expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.988169:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988179:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988188:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988201:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988205:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988210:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988295:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988303:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988308:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129820.988315:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129820.988382:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988388:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988392:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988397:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094b8c600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129820.988400:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988406:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988417:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129820.988420:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129820.988422:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988426:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b8c600/0x48868a4e4395514e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988912:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988918:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988922:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988926:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129820.988929:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988933:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988940:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129820.988942:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129820.988944:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988949:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988956:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988961:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988965:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988969:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129820.988971:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988975:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988981:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b900) 00010000:00010000:1.0:1746129820.988983:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129820.988985:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.988989:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e43955147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129820.989019:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69000/0x48868a4e43955139 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f0b expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.989025:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69000/0x48868a4e43955139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f0b expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129820.989031:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c69000, rc 0) 00000100:00100000:1.0:1746129820.989073:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31584:x1830949054369408:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1029us (1249us total) trans 8589945035 rc 301/301 00000100:00100000:1.0:1746129820.989080:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11036 00000100:00100000:3.0:1746129820.991189:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054368896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16626us (17020us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129820.991199:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6925 00002000:00100000:3.0:1746129820.991207:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880091fa7100 x1830949054368896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129820.991216:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7100 with x1830949054368896 ext(3145728->4194303) 00002000:00010000:3.0:1746129820.991221:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa7100 00000100:00100000:2.0:1746129820.993758:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054369152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19044us (19503us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129820.993767:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6926 00002000:00100000:2.0:1746129820.993777:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880091fa4000 x1830949054369152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129820.993786:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4000 with x1830949054369152 ext(3145728->4194303) 00002000:00010000:2.0:1746129820.993792:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa4000 00000100:00100000:1.0:1746129820.994649:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054368640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20229us (20577us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129820.994656:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6924 00002000:00100000:1.0:1746129820.994662:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880091fa6a00 x1830949054368640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.994669:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6a00 with x1830949054368640 ext(2097152->3145727) 00002000:00010000:1.0:1746129820.994672:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6a00 00000100:00100000:0.0:1746129820.997610:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129820.998219:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129820.998302:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054369792 00000100:00100000:2.0:1746129820.998310:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054369792 00000100:00100000:2.0:1746129820.998361:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11037 00000100:00100000:2.0:1746129820.998368:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31587:x1830949054369792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129820.998387:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129820.998403:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012eab5600/0x48868a4e4395515c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f19 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.998499:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998512:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998521:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998533:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998538:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998542:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998640:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998648:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998655:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129820.998662:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129820.998734:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998739:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998744:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998751:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009519ec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.998754:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998760:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998770:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129820.998772:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129820.998776:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998781:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009519ec00/0x48868a4e43955171 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998798:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998803:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998806:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998809:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a238a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.998811:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998816:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998822:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129820.998824:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.998827:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998831:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a238a00/0x48868a4e43955163 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998836:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998841:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998845:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998879:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52eb200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129820.998881:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998885:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998890:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8e00) 00010000:00010000:2.0:1746129820.998892:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129820.998894:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998898:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52eb200/0x48868a4e4395516a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129820.998934:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012eab5600/0x48868a4e4395515c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f19 expref: 293 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.998940:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012eab5600/0x48868a4e4395515c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f19 expref: 293 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129820.998949:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012eab5600, rc 0) 00000100:00100000:2.0:1746129820.998993:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31587:x1830949054369792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 625us (774us total) trans 8589945036 rc 301/301 00000100:00100000:2.0:1746129820.999000:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11037 00000100:00100000:3.0:1746129820.999172:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054369536 00000100:00100000:3.0:1746129820.999177:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054369536 00000100:00100000:3.0:1746129820.999201:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15483 00000100:00100000:3.0:1746129820.999206:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31584:x1830949054369536:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129820.999214:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129820.999224:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f12 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.999245:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 7 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.999252:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.999254:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129820.999257:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2957312->3112959] (req 2957312->3112959) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 22 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.999285:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 7 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129820.999296:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 7 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129820.999307:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054030720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129820.999368:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129820.999823:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129820.999932:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054370048 00000100:00100000:1.0:1746129820.999936:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054370048 00002000:00100000:1.0:1746129820.999963:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880091fa7480 x1830949054370048/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/0 e 0 to 0 dl 1746129831 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129820.999971:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7480 with x1830949054370048 ext(4194304->4931583) 00002000:00010000:1.0:1746129820.999975:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa7480 00000100:00100000:1.0:1746129821.000002:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6927 00000100:00100000:1.0:1746129821.000007:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054370048:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.004093:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.004641:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.005685:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054370176 00000100:00100000:1.0:1746129821.005693:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054370176 00000100:00100000:1.0:1746129821.006558:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054370304 00000100:00100000:1.0:1746129821.006563:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054370304 00000100:00100000:3.0:1746129821.006602:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15484 00000100:00100000:3.0:1746129821.006611:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054370176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.006628:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.006642:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f20 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.006661:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.006663:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.006671:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.006685:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.006693:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d7c00, rc 0) 00000100:00100000:3.0:1746129821.007028:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054370176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 418us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.007034:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15484 00000100:00100000:3.0:1746129821.007047:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15485 00000100:00100000:3.0:1746129821.007052:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054370304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.007058:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.007065:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e4395518d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f27 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.007075:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.007082:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e4395518d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f27 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.007088:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8d7000/0x48868a4e4395518d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f27 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.007110:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8d7000, rc 0) 00000100:00100000:3.0:1746129821.007134:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054370304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 82us (2494us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.007139:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15485 00000100:00100000:2.0:1746129821.007461:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054030720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.007482:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2957312->3112959] (req 2957312->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 22 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.007489:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbb6600, rc 0) 00000100:00100000:2.0:1746129821.007505:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31584:x1830949054369536:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8300us (9904us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.007510:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15483 00000100:00100000:0.0:1746129821.009116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.009420:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054370432 00000100:00100000:2.0:1746129821.009426:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054370432 00010000:00010000:2.0:1746129821.009450:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 8 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.009481:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7733 00000100:00100000:2.0:1746129821.009487:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054370432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.009499:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.009517:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 8 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.009527:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 8 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.009545:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43955132 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f04 expref: 8 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.009781:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.009784:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.009791:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.009797:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.009823:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.009833:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054030848:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.010366:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.011046:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054370048:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11036us (11221us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129821.011055:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6927 00002000:00100000:1.0:1746129821.011062:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880091fa7480 x1830949054370048/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:561/0 lens 488/440 e 0 to 0 dl 1746129831 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.011070:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7480 with x1830949054370048 ext(4194304->4931583) 00002000:00010000:1.0:1746129821.011074:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa7480 00000100:00100000:0.0:1746129821.012080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.012182:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054030848:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.012195:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.012227:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949054370432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2740us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.012235:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7733 00000100:00100000:1.0:1746129821.012530:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054370688 00000100:00100000:1.0:1746129821.012536:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054370688 00002000:00100000:1.0:1746129821.012564:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2957312->2961407) req@ffff88008ec9ea00 x1830949054370688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.012572:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9ea00 with x1830949054370688 ext(2957312->2961407) 00002000:00010000:1.0:1746129821.012576:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9ea00 00000100:00100000:1.0:1746129821.012605:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6928 00000100:00100000:1.0:1746129821.012611:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054370688:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129821.012746:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054370688:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 134us (667us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129821.012752:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6928 00002000:00100000:1.0:1746129821.012756:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2957312->2961407) req@ffff88008ec9ea00 x1830949054370688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.012767:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9ea00 with x1830949054370688 ext(2957312->2961407) 00002000:00010000:1.0:1746129821.012769:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9ea00 00000100:00100000:0.0:1746129821.019716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.020525:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054370944 00000100:00100000:3.0:1746129821.020534:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054370944 00002000:00100000:3.0:1746129821.020568:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3108864->3112959) req@ffff88008ec9f800 x1830949054370944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.020576:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f800 with x1830949054370944 ext(3108864->3112959) 00002000:00010000:3.0:1746129821.020581:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9f800 00000100:00100000:3.0:1746129821.020612:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6929 00000100:00100000:3.0:1746129821.020619:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054370944:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129821.020772:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054370944:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 153us (1064us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129821.020777:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6929 00002000:00100000:3.0:1746129821.020782:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3108864->3112959) req@ffff88008ec9f800 x1830949054370944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.020788:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f800 with x1830949054370944 ext(3108864->3112959) 00002000:00010000:3.0:1746129821.020791:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9f800 00000100:00100000:0.0:1746129821.023735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.023793:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054371072 00000100:00100000:1.0:1746129821.023800:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054371072 00000100:00100000:1.0:1746129821.023877:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15486 00000100:00100000:1.0:1746129821.023884:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1963:x1830949054371072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.023898:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.023912:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e43955194 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f2e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.023959:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054030976:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.024030:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.026049:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.026290:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054371328 00000100:00100000:2.0:1746129821.026296:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054371328 00000100:00100000:2.0:1746129821.026331:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4610 00000100:00100000:2.0:1746129821.026339:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31584:x1830949054371328:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129821.026474:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054030976:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.026496:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e43955194 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f2e expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.026507:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e43955194 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f2e expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.026532:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68400, rc 0) 00000100:00100000:1.0:1746129821.026566:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1963:x1830949054371072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2683us (2837us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.026572:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15486 00000100:00100000:2.0:1746129821.027293:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31584:x1830949054371328:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 953us (1247us total) trans 8589945037 rc 0/0 00000100:00100000:2.0:1746129821.027299:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4610 00000100:00100000:0.0:1746129821.027541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.027711:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054371584 00000100:00100000:3.0:1746129821.027715:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054371584 00002000:00100000:3.0:1746129821.027740:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008ec9c380 x1830949054371584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.027748:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9c380 with x1830949054371584 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.027753:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9c380 00000100:00100000:3.0:1746129821.027780:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6930 00000100:00100000:3.0:1746129821.027786:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054371584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.029301:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.029368:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.029500:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.029613:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054371840 00000100:00100000:1.0:1746129821.029618:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054371840 00002000:00100000:1.0:1746129821.029641:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008ec9e680 x1830949054371840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.029649:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9e680 with x1830949054371840 ext(3145728->4194303) 00002000:00010000:1.0:1746129821.029652:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9e680 00000100:00100000:1.0:1746129821.029662:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054372224 00000100:00100000:1.0:1746129821.029664:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054372224 00002000:00100000:1.0:1746129821.029675:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3301376->4194303) req@ffff88008ec9fb80 x1830949054372224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.029681:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9fb80 with x1830949054372224 ext(3301376->4194303) 00002000:00010000:1.0:1746129821.029684:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9fb80 00000100:00100000:1.0:1746129821.029691:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054372096 00000100:00100000:1.0:1746129821.029692:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054372096 00002000:00100000:1.0:1746129821.029700:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3301375) req@ffff88008ec9dc00 x1830949054372096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 504/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.029706:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9dc00 with x1830949054372096 ext(2097152->3301375) 00002000:00010000:1.0:1746129821.029708:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9dc00 00000100:00100000:1.0:1746129821.029723:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6931 00000100:00100000:1.0:1746129821.029729:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054371840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129821.029735:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6932 00000100:00100000:3.0:1746129821.029743:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054372224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129821.029807:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6933 00000100:00100000:1.0:1746129821.029812:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054372096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.037030:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.037322:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054372480 00000100:00100000:1.0:1746129821.037330:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054372480 00000100:00100000:1.0:1746129821.037377:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15487 00000100:00100000:1.0:1746129821.037385:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949054372480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.037401:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.037416:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e4395519b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f35 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.037619:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054031104:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.037877:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.042973:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054031104:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.043002:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e4395519b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f35 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.043014:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c68c00/0x48868a4e4395519b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f35 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.043044:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68c00, rc 0) 00000100:00100000:3.0:1746129821.043061:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054372224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13317us (13689us total) trans 0 rc 892928/892928 00000100:00100000:1.0:1746129821.043066:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1964:x1830949054372480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5682us (6042us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.043070:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6932 00000100:00100000:1.0:1746129821.043072:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15487 00002000:00100000:3.0:1746129821.043078:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3301376->4194303) req@ffff88008ec9fb80 x1830949054372224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.043092:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9fb80 with x1830949054372224 ext(3301376->4194303) 00002000:00010000:3.0:1746129821.043096:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9fb80 00000100:00100000:0.0:1746129821.043429:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054372096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13616us (13927us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129821.043436:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6933 00002000:00100000:0.0:1746129821.043441:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3301375) req@ffff88008ec9dc00 x1830949054372096/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 504/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129821.043447:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9dc00 with x1830949054372096 ext(2097152->3301375) 00002000:00010000:0.0:1746129821.043450:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9dc00 00000100:00100000:3.0:1746129821.045286:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054371584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17495us (17741us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.045293:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6930 00002000:00100000:3.0:1746129821.045301:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88008ec9c380 x1830949054371584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.045307:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9c380 with x1830949054371584 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.045311:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9c380 00000100:00100000:1.0:1746129821.045470:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054371840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15740us (16171us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129821.045476:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6931 00002000:00100000:1.0:1746129821.045481:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008ec9e680 x1830949054371840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.045487:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9e680 with x1830949054371840 ext(3145728->4194303) 00002000:00010000:1.0:1746129821.045490:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9e680 00000100:00100000:0.0:1746129821.049049:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.050232:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054372736 00000100:00100000:2.0:1746129821.050241:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054372736 00000100:00080000:0.0:1746129821.050365:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129821.051180:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4611 00000100:00100000:2.0:1746129821.051191:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31580:x1830949054372736:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129821.051553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.051982:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31580:x1830949054372736:12345-192.168.204.31@tcp:35:cat.0 Request processed in 792us (2939us total) trans 8589945038 rc 0/0 00000100:00100000:2.0:1746129821.051990:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4611 00000100:00100000:1.0:1746129821.052103:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054372992 00000100:00100000:1.0:1746129821.052108:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054372992 00002000:00100000:1.0:1746129821.052141:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa3800 x1830949054372992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.052150:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3800 with x1830949054372992 ext(4194304->4931583) 00002000:00010000:1.0:1746129821.052154:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa3800 00000100:00100000:1.0:1746129821.052167:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6934 00000100:00100000:1.0:1746129821.052172:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054372992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.056462:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.056537:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054373120 00000100:00100000:2.0:1746129821.056545:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054373120 00000100:00100000:2.0:1746129821.056585:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15488 00000100:00100000:2.0:1746129821.056591:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31582:x1830949054373120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129821.056606:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.056619:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f3c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.056644:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.056651:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.056657:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.056663:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.056665:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.056668:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1454080->2097151] (req 1454080->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.056692:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.056702:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 12 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.056712:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.056773:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 16 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.056780:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 16 pid: 7975 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.056787:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.056809:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.056816:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 6 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.056832:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031488:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.056862:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.062880:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.062910:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.062943:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054373376 00000100:00100000:3.0:1746129821.062950:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054373376 00010000:00010000:3.0:1746129821.062979:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 13 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746129821.062989:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054373248 00000100:00100000:1.0:1746129821.062993:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054373248 00000100:00100000:3.0:1746129821.063000:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7734 00000100:00100000:3.0:1746129821.063006:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054373376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129821.063007:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 17 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.063017:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129821.063029:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7735 00000100:00100000:1.0:1746129821.063034:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054373248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.063040:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 13 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.063040:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129821.063048:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 17 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.063050:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 13 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.063058:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 17 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.063080:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.063132:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054373376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 125us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.063138:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7734 00010000:00010000:1.0:1746129821.063312:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129821.063331:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054373248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 296us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129821.063337:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7735 00010000:00010000:2.0:1746129821.063439:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136378200/0x48868a4e43954f64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e0f expref: 12 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.063466:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.063478:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87200/0x48868a4e43954f8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e40 expref: 16 pid: 7975 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.063486:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031360:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.063494:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031488:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.063516:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1454080->2097151] (req 1454080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.063527:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009519e600, rc 0) 00000100:00100000:2.0:1746129821.063546:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31582:x1830949054373120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6956us (7093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.063552:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15488 00000100:00100000:0.0:1746129821.066142:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.066749:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054373504 00000100:00100000:1.0:1746129821.066756:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054373504 00010000:00010000:1.0:1746129821.066783:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746129821.066819:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7736 00000100:00100000:1.0:1746129821.066826:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054373504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129821.066837:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129821.067222:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.067240:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.067259:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f600/0x48868a4e43954f33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dec expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.067287:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.067289:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.067295:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.067303:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.067332:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.067343:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054031616:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.067924:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054372992:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15750us (16369us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129821.067933:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6934 00002000:00100000:2.0:1746129821.067942:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa3800 x1830949054372992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129821.067942:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c16c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746129821.067955:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3800 with x1830949054372992 ext(4194304->4931583) 00002000:00010000:2.0:1746129821.067959:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa3800 00000100:00100000:2.0:1746129821.072368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.072713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.072791:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054373888 00000100:00100000:2.0:1746129821.072798:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054373888 00000100:00100000:3.0:1746129821.072940:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054373760 00000100:00100000:3.0:1746129821.072944:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054373760 00002000:00100000:3.0:1746129821.072977:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1454080->1458175) req@ffff88009206f100 x1830949054373760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129821.072984:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054031616:192.168.204.31@tcp:105: 00002000:00100000:3.0:1746129821.072987:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f100 with x1830949054373760 ext(1454080->1458175) 00002000:00010000:3.0:1746129821.072992:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f100 00000100:00100000:3.0:1746129821.073010:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6935 00000100:00100000:3.0:1746129821.073017:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054373760:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:1.0:1746129821.073023:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.073157:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15489 00000100:00100000:2.0:1746129821.073180:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054373888:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.073188:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129821.073189:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054373760:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 171us (829us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129821.073195:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6935 00002000:00100000:3.0:1746129821.073201:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1454080->1458175) req@ffff88009206f100 x1830949054373760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.073207:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206f100 with x1830949054373760 ext(1454080->1458175) 00002000:00010000:3.0:1746129821.073210:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206f100 00010000:00010000:2.0:1746129821.073212:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e439551a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f43 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.073263:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031744:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.073639:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.074442:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054373504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7613us (8303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129821.074450:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7736 00002000:00010000:2.0:1746129821.076919:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129819 -> 1746129821 00002000:00010000:2.0:1746129821.076927:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129819 -> 1746129821 00002000:00010000:2.0:1746129821.076928:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129819 -> 1746129821 00000100:00100000:2.0:1746129821.076949:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031744:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.076973:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e439551a9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f43 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.076986:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1e000/0x48868a4e439551a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f43 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.077011:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1e000, rc 0) 00000100:00100000:2.0:1746129821.077058:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054373888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3894us (4344us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.077065:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15489 00000100:00100000:0.0:1746129821.078768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.079316:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054374016 00000100:00100000:2.0:1746129821.079323:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054374016 00000100:00100000:2.0:1746129821.079366:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15490 00000100:00100000:2.0:1746129821.079372:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054374016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.079385:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.079398:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e439551b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f4a expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.079442:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031872:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.079518:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.085415:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.085575:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054374144 00000100:00100000:3.0:1746129821.085581:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054374144 00000100:00100000:2.0:1746129821.085922:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054031872:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.085949:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e439551b0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f4a expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.085962:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e439551b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f4a expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129821.086502:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15491 00000100:00100000:3.0:1746129821.086511:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31582:x1830949054374144:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129821.086526:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.086540:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f51 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.086565:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.086572:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.086578:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.086579:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.086582:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->2334719] (req 2097152->2334719) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.086605:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.086614:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746129821.086624:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054032000:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.086801:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:2.0:1746129821.087137:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054374016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7763us (8372us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.087144:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15490 00010000:00010000:3.0:1746129821.087975:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.087986:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.087995:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054032128:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.088034:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.092337:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054032000:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.092350:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054032128:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.092512:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->2334719] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.092600:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6e400, rc 0) 00000100:00100000:3.0:1746129821.092750:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31582:x1830949054374144:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6238us (7340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.092758:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15491 00000100:00100000:0.0:1746129821.096839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.097352:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054374400 00000100:00100000:2.0:1746129821.097360:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054374400 00000100:00100000:2.0:1746129821.097409:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4612 00000100:00100000:2.0:1746129821.097417:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c563850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31587:x1830949054374400:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129821.097698:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c563850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31587:x1830949054374400:12345-192.168.204.31@tcp:35:cat.0 Request processed in 281us (864us total) trans 8589945039 rc 0/0 00000100:00100000:2.0:1746129821.097704:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4612 00000100:00100000:0.0:1746129821.098984:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.099036:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054374528 00000100:00100000:1.0:1746129821.099042:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054374528 00000100:00100000:0.0:1746129821.099052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129821.099066:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746129821.099087:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054374656 00000100:00100000:1.0:1746129821.099089:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054374656 00010000:00010000:1.0:1746129821.099099:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746129821.099135:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7737 00000100:00100000:1.0:1746129821.099142:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054374528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129821.099152:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129821.099168:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.099185:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.099204:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8d7c00/0x48868a4e43955186 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f20 expref: 14 pid: 8436 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746129821.099219:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.099242:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7738 00000100:00100000:1.0:1746129821.099243:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054374528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129821.099248:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7737 00000100:00100000:0.0:1746129821.099250:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054374656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129821.099257:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129821.099267:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746129821.099276:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746129821.099288:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217600/0x48868a4e43955108 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ef6 expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746129821.099301:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.099302:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.099308:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.099315:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.099339:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129821.099351:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054032256:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129821.099411:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.101275:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054032256:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.101290:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.101319:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054374656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2071us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.101328:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7738 00000100:00100000:0.0:1746129821.102737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.102806:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054374912 00000100:00100000:3.0:1746129821.102813:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054374912 00002000:00100000:3.0:1746129821.102886:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2330624->2334719) req@ffff88008f90ad80 x1830949054374912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.102895:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90ad80 with x1830949054374912 ext(2330624->2334719) 00002000:00010000:3.0:1746129821.102900:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f90ad80 00000100:00100000:3.0:1746129821.102927:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6936 00000100:00100000:3.0:1746129821.102933:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054374912:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129821.103075:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054374912:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 141us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129821.103081:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6936 00002000:00100000:3.0:1746129821.103086:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2330624->2334719) req@ffff88008f90ad80 x1830949054374912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.103092:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90ad80 with x1830949054374912 ext(2330624->2334719) 00002000:00010000:3.0:1746129821.103095:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f90ad80 00000100:00100000:0.0:1746129821.108282:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.108439:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054375168 00000100:00100000:2.0:1746129821.108447:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054375168 00000100:00100000:2.0:1746129821.108532:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4613 00000100:00100000:2.0:1746129821.108540:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31582:x1830949054375168:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129821.110400:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31582:x1830949054375168:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 1853us (2117us total) trans 8589945040 rc 0/0 00000100:00100000:2.0:1746129821.110409:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4613 00000100:00100000:0.0:1746129821.185931:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.186019:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054375424 00000100:00100000:1.0:1746129821.186027:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054375424 00000100:00100000:1.0:1746129821.186084:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11038 00000100:00100000:1.0:1746129821.186091:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31594:x1830949054375424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.186111:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.186138:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e439551be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f58 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.186228:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186239:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186248:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186258:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186263:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186267:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186349:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186356:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.186361:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.186368:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.187815:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187824:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187829:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187834:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.187837:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187842:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187866:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.187869:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129821.187872:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187876:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69a00/0x48868a4e439551d3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187909:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187914:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187918:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187921:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.187923:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187927:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187934:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.187935:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.187938:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187941:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68e00/0x48868a4e439551c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187948:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187952:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187956:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187960:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.187962:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187966:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187972:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b000) 00010000:00010000:1.0:1746129821.187973:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.187975:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.187979:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69400/0x48868a4e439551cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.188020:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e439551be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f58 expref: 21 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.188026:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68600/0x48868a4e439551be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f58 expref: 21 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.188033:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68600, rc 0) 00000100:00100000:1.0:1746129821.188523:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31594:x1830949054375424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2430us (2596us total) trans 8589945041 rc 301/301 00000100:00100000:1.0:1746129821.188531:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11038 00000100:00100000:0.0:1746129821.192835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.192971:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054375552 00000100:00100000:3.0:1746129821.192978:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054375552 00000100:00100000:3.0:1746129821.193085:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15492 00000100:00100000:3.0:1746129821.193092:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054375552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.193108:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.193130:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba6fe00/0x48868a4e439551e1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f5f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.193244:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032384:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129821.194633:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.198376:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032384:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129821.198410:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba6fe00/0x48868a4e439551e1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f5f expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.198423:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba6fe00/0x48868a4e439551e1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f5f expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.198447:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6fe00, rc 0) 00000100:00100000:3.0:1746129821.198505:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054375552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5412us (5676us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.198513:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15492 00000100:00100000:0.0:1746129821.209176:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129821.209759:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129821.210181:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054375808 00000100:00100000:3.0:1746129821.210190:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054375808 00002000:00100000:3.0:1746129821.210235:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1454079) req@ffff88008f909c00 x1830949054375808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.210249:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909c00 with x1830949054375808 ext(1048576->1454079) 00002000:00010000:3.0:1746129821.210254:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f909c00 00000100:00100000:3.0:1746129821.210373:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6937 00000100:00100000:3.0:1746129821.210380:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054375808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129821.215687:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054375808:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5298us (6511us total) trans 0 rc 405504/405504 00000100:00100000:3.0:1746129821.215698:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6937 00002000:00100000:3.0:1746129821.215711:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1454079) req@ffff88008f909c00 x1830949054375808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 405504/405504 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.215720:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909c00 with x1830949054375808 ext(1048576->1454079) 00002000:00010000:3.0:1746129821.215729:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f909c00 00000100:00100000:0.0:1746129821.229050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.230079:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054376064 00000100:00100000:3.0:1746129821.230087:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054376064 00002000:00100000:3.0:1746129821.230139:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2334720->3145727) req@ffff88008f909500 x1830949054376064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.230148:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909500 with x1830949054376064 ext(2334720->3145727) 00002000:00010000:3.0:1746129821.230153:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f909500 00000100:00100000:3.0:1746129821.230185:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6938 00000100:00100000:3.0:1746129821.230192:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054376064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129821.237479:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054376064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7277us (8425us total) trans 0 rc 811008/811008 00000100:00100000:3.0:1746129821.237490:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6938 00002000:00100000:3.0:1746129821.237500:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2334720->3145727) req@ffff88008f909500 x1830949054376064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 811008/811008 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.237508:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f909500 with x1830949054376064 ext(2334720->3145727) 00002000:00010000:3.0:1746129821.237513:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f909500 00000100:00100000:0.0:1746129821.241459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.242186:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054376320 00000100:00100000:1.0:1746129821.242195:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054376320 00000100:00100000:1.0:1746129821.242244:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11039 00000100:00100000:1.0:1746129821.242252:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31596:x1830949054376320:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129821.242272:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.242287:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439551e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f66 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.242376:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242387:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242395:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242405:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242410:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242415:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242494:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242501:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242507:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.242514:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.242574:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242580:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242585:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242589:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.242592:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242597:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242606:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.242608:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129821.242611:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242615:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68000/0x48868a4e439551fd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242644:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242649:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242653:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242656:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.242659:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242663:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242668:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.242670:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.242671:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242675:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69200/0x48868a4e439551ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242681:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242686:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242690:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242693:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.242695:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242699:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242704:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b800) 00010000:00010000:1.0:1746129821.242706:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.242707:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242711:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69800/0x48868a4e439551f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.242738:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439551e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f66 expref: 22 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.242744:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68400/0x48868a4e439551e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f66 expref: 22 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.242751:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68400, rc 0) 00000100:00100000:1.0:1746129821.242790:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31596:x1830949054376320:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 538us (1337us total) trans 8589945042 rc 301/301 00000100:00100000:1.0:1746129821.242796:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11039 00000100:00100000:0.0:1746129821.247085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.247265:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054376448 00000100:00100000:3.0:1746129821.247272:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054376448 00000100:00100000:3.0:1746129821.247347:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15493 00000100:00100000:3.0:1746129821.247353:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31594:x1830949054376448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.247368:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.247380:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f6d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.247404:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.247411:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.247412:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.247415:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.247439:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.247448:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 21 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.247458:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032512:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.247553:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.250886:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032512:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129821.250889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.250946:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054376576 00000100:00100000:2.0:1746129821.250951:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054376576 00002000:00100000:2.0:1746129821.250986:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2957312->3112959) req@ffff88009f6ed180 x1830949054376576/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.250994:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ed180 with x1830949054376576 ext(2957312->3112959) 00010000:00010000:2.0:1746129821.251000:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.251015:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 22 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.251021:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6ed180 00000100:00100000:2.0:1746129821.251053:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1872 00000100:00100000:2.0:1746129821.251064:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054376576:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:3.0:1746129821.252355:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.252369:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6f600, rc 0) 00000100:00100000:3.0:1746129821.252400:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31594:x1830949054376448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5047us (5322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.252408:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15493 00000100:00100000:0.0:1746129821.253624:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.254640:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054376832 00000100:00100000:1.0:1746129821.254648:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054376832 00000100:00100000:1.0:1746129821.254695:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11040 00000100:00100000:1.0:1746129821.254704:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+294:31598:x1830949054376832:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129821.254720:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.254734:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43955212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f74 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.254962:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.254973:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129821.254975:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054376576:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3915us (4086us total) trans 17179874126 rc 0/0 00010000:00010000:1.0:1746129821.254982:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129821.254983:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1872 00002000:00100000:3.0:1746129821.254991:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2957312->3112959) req@ffff88009f6ed180 x1830949054376576/t17179874126(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746129821.254991:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.254996:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00002000:00100000:3.0:1746129821.255000:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ed180 with x1830949054376576 ext(2957312->3112959) 00010000:00010000:1.0:1746129821.255000:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.255007:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.255018:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.255024:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f6ed180 00010000:00010000:1.0:1746129821.255073:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255079:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255083:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.255089:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.255146:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255152:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255157:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255161:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c68800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.255164:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255168:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255176:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.255178:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129821.255180:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255184:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68800/0x48868a4e43955227 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255207:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255211:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255215:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255218:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.255220:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255225:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255230:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.255231:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.255233:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255236:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69c00/0x48868a4e43955219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255241:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255244:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255248:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255251:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091c69600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.255252:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255257:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255262:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b800) 00010000:00010000:1.0:1746129821.255263:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.255265:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255268:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c69600/0x48868a4e43955220 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.255295:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43955212 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f74 expref: 296 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.255302:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091c68c00/0x48868a4e43955212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f74 expref: 296 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.255308:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68c00, rc 0) 00000100:00100000:1.0:1746129821.255339:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31598:x1830949054376832:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 637us (1718us total) trans 8589945043 rc 301/301 00000100:00100000:1.0:1746129821.255345:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11040 00000100:00100000:0.0:1746129821.259364:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.259431:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054376960 00000100:00100000:2.0:1746129821.259438:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054376960 00010000:00010000:2.0:1746129821.259468:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.259489:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7739 00000100:00100000:2.0:1746129821.259495:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054376960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.259505:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.259522:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.259531:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.259546:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbb6600/0x48868a4e4395517f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2957312->3112959) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f12 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.259568:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.259571:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.259576:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.259582:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.259606:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.259619:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054032640:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.259677:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.261431:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054032640:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.261443:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.261475:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054376960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1979us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.261482:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7739 00000100:00100000:0.0:1746129821.272421:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.275810:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054377216 00000100:00100000:3.0:1746129821.275821:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054377216 00002000:00100000:3.0:1746129821.275879:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6ee680 x1830949054377216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.275893:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ee680 with x1830949054377216 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.275898:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ee680 00000100:00100000:3.0:1746129821.275926:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6939 00000100:00100000:3.0:1746129821.275934:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054377216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129821.277048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.277089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.277705:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054377472 00000100:00100000:2.0:1746129821.277711:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054377472 00002000:00100000:2.0:1746129821.277736:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faa2300 x1830949054377472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.277744:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2300 with x1830949054377472 ext(3145728->4194303) 00002000:00010000:2.0:1746129821.277749:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa2300 00000100:00100000:2.0:1746129821.277772:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054377728 00000100:00100000:2.0:1746129821.277774:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054377728 00002000:00100000:2.0:1746129821.277785:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faa2a00 x1830949054377728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.277796:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2a00 with x1830949054377728 ext(3145728->4194303) 00002000:00010000:2.0:1746129821.277799:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa2a00 00000100:00100000:2.0:1746129821.277810:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6940 00000100:00100000:2.0:1746129821.277816:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054377472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.277904:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6941 00000100:00100000:0.0:1746129821.277911:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054377728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129821.282018:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054377216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6077us (9597us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.282028:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6939 00002000:00100000:3.0:1746129821.282039:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6ee680 x1830949054377216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.282046:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ee680 with x1830949054377216 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.282051:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ee680 00000100:00100000:0.0:1746129821.302607:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.302761:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054377856 00000100:00100000:3.0:1746129821.302769:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054377856 00000100:00100000:3.0:1746129821.302809:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15494 00000100:00100000:3.0:1746129821.302815:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31596:x1830949054377856:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129821.302829:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.302903:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f7b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.302931:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.302938:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.302940:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.302943:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2256895] (req 2097152->2256895) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.302969:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.302978:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 11 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.302989:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032768:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.303069:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.303484:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054377472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25666us (26436us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129821.303492:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6940 00002000:00100000:2.0:1746129821.303500:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009faa2300 x1830949054377472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.303507:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2300 with x1830949054377472 ext(3145728->4194303) 00010000:00010000:2.0:1746129821.303512:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.303521:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.303526:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009faa2300 00000100:00100000:1.0:1746129821.304206:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054377728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 26293us (27114us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129821.304214:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6941 00002000:00100000:1.0:1746129821.304220:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009faa2a00 x1830949054377728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.304227:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa2a00 with x1830949054377728 ext(3145728->4194303) 00002000:00010000:1.0:1746129821.304231:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa2a00 00000100:00100000:3.0:1746129821.307031:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032768:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.307059:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2256895] (req 2097152->2256895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.307072:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7ca00, rc 0) 00000100:00100000:3.0:1746129821.307633:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31596:x1830949054377856:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4816us (5032us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.307641:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15494 00000100:00100000:0.0:1746129821.310707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.310747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.310793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.310810:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054378112 00000100:00100000:2.0:1746129821.310815:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054377984 00000100:00100000:3.0:1746129821.310817:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054378112 00000100:00100000:2.0:1746129821.310819:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054377984 00010000:00010000:2.0:1746129821.310842:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.310843:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054378240 00000100:00100000:3.0:1746129821.310862:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054378240 00000100:00100000:0.0:1746129821.310871:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15495 00000100:00100000:0.0:1746129821.310880:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31594:x1830949054378112:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129821.310890:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15496 00010000:00010000:0.0:1746129821.310893:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129821.310896:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31598:x1830949054378240:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129821.310905:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f82 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.310910:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.310918:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f89 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.310924:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.310926:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.310933:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.310938:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.310945:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129821.310946:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.310951:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129821.310955:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c69c00, rc 0) 00010000:00010000:3.0:1746129821.310957:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.310958:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.310960:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1458176->2080767] (req 1458176->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.310977:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7740 00010000:00010000:3.0:1746129821.310983:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129821.310984:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054377984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129821.310990:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31594:x1830949054378112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 112us (243us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129821.310993:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 11 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.310993:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129821.310995:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15495 00000100:00100000:3.0:1746129821.311003:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032896:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.311013:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.311022:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.311036:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba6f600/0x48868a4e4395520b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f6d expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.311049:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.311051:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.311055:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.311060:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.311061:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.311068:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 24 pid: 7975 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746129821.311077:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054033024:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.311077:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.311085:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054033152:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.311104:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129821.311106:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129821.311127:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 6 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746129821.311135:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054033280:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.311156:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.314636:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.314931:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054032896:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.314941:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054033024:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.315041:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054033152:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.315055:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.315102:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054377984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4118us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.315126:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7740 00000100:00100000:2.0:1746129821.315236:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054378496 00000100:00100000:2.0:1746129821.315241:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054378496 00010000:00010000:2.0:1746129821.315262:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 9 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.315294:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7741 00000100:00100000:2.0:1746129821.315300:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054378496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.315311:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.315331:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 9 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.315341:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 9 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.315358:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136378800/0x48868a4e43954f5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e01 expref: 9 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.315374:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.315462:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.315477:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.315496:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054378496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 196us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.315502:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7741 00000100:00100000:3.0:1746129821.315511:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054378368 00000100:00100000:3.0:1746129821.315515:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054378368 00010000:00010000:3.0:1746129821.315532:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 25 pid: 7975 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.315549:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054033280:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.315550:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7742 00000100:00100000:3.0:1746129821.315554:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054378368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.315560:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.315568:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 25 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.315576:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 25 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.315588:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86400/0x48868a4e43954f80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e32 expref: 25 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.315610:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.315629:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054378368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.315634:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7742 00000100:00100000:1.0:1746129821.315692:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054378752 00000100:00100000:1.0:1746129821.315696:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054378752 00002000:00100000:1.0:1746129821.315725:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ee300 x1830949054378752/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.315735:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ee300 with x1830949054378752 ext(3145728->4194303) 00002000:00010000:1.0:1746129821.315738:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ee300 00000100:00100000:1.0:1746129821.315758:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6942 00000100:00100000:1.0:1746129821.315763:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054378752:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129821.316556:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129821.316652:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1458176->2080767] (req 1458176->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.316667:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135cab800, rc 0) 00000100:00100000:2.0:1746129821.316690:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31598:x1830949054378240:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5794us (5897us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.316697:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15496 00000100:00100000:2.0:1746129821.316808:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054378880 00000100:00100000:2.0:1746129821.316811:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054378880 00010000:00010000:2.0:1746129821.316829:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.316871:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7743 00000100:00100000:2.0:1746129821.316876:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054378880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.316883:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.316891:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.316899:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.316911:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43fc00/0x48868a4e43954f2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dde expref: 7 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.316921:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.316922:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.316927:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.316939:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.316962:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.316972:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054033408:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.317011:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129821.317266:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129821.317290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.317619:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054379264 00000100:00100000:1.0:1746129821.317624:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054379264 00000100:00100000:1.0:1746129821.317658:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11041 00000100:00100000:1.0:1746129821.317664:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31601:x1830949054379264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.317676:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.317687:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6f600/0x48868a4e4395524a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f90 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.317758:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317768:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317778:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317788:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317794:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317799:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317906:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317914:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.317919:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.317926:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.318001:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318007:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318012:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318017:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921ec800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.318020:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318025:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318032:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.318034:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129821.318037:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318041:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ec800/0x48868a4e4395525f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318066:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318070:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318077:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318081:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921ed200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.318083:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318087:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318093:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.318095:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.318097:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318101:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed200/0x48868a4e43955251 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318108:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318126:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318131:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318135:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800921ed400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.318137:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318141:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318150:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b900) 00010000:00010000:1.0:1746129821.318152:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.318154:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318157:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800921ed400/0x48868a4e43955258 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.318185:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6f600/0x48868a4e4395524a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f90 expref: 297 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.318191:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba6f600/0x48868a4e4395524a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f90 expref: 297 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.318197:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba6f600, rc 0) 00000100:00100000:1.0:1746129821.318234:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31601:x1830949054379264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 570us (942us total) trans 8589945044 rc 301/301 00000100:00100000:1.0:1746129821.318239:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11041 00000100:00100000:0.0:1746129821.318245:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.318298:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054379392 00000100:00100000:0.0:1746129821.318301:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054379392 00002000:00100000:0.0:1746129821.318321:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2252800->2256895) req@ffff88009f6edf80 x1830949054379392/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129821.318329:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6edf80 with x1830949054379392 ext(2252800->2256895) 00002000:00010000:0.0:1746129821.318332:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6edf80 00000100:00100000:0.0:1746129821.318343:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6943 00000100:00100000:0.0:1746129821.318348:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054379392:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129821.318425:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054379392:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 77us (181us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129821.318493:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6943 00002000:00100000:0.0:1746129821.318499:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2252800->2256895) req@ffff88009f6edf80 x1830949054379392/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129821.318505:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6edf80 with x1830949054379392 ext(2252800->2256895) 00002000:00010000:0.0:1746129821.318508:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6edf80 00000100:00100000:1.0:1746129821.321378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.321406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.321440:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054379776 00000100:00100000:1.0:1746129821.321446:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054379776 00000100:00100000:1.0:1746129821.321487:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15497 00000100:00100000:1.0:1746129821.321493:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054379776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.321506:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.321522:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8c76c00/0x48868a4e4395526d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f97 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.321574:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054033408:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.321589:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.321629:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054378880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4746us (5069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.321638:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7743 00000100:00100000:3.0:1746129821.321665:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054379648 00000100:00100000:3.0:1746129821.321668:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054379648 00002000:00100000:3.0:1746129821.321690:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1458176->1462271) req@ffff88009faa0a80 x1830949054379648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.321698:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0a80 with x1830949054379648 ext(1458176->1462271) 00002000:00010000:3.0:1746129821.321703:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa0a80 00000100:00100000:3.0:1746129821.321714:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6944 00000100:00100000:3.0:1746129821.321718:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054379648:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129821.321920:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054379648:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 196us (548us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129821.321926:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6944 00002000:00100000:3.0:1746129821.321931:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1458176->1462271) req@ffff88009faa0a80 x1830949054379648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.321939:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0a80 with x1830949054379648 ext(1458176->1462271) 00002000:00010000:3.0:1746129821.321942:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa0a80 00000100:00100000:1.0:1746129821.321982:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054033536:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.322047:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.323483:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.323746:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.323800:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054379904 00000100:00100000:3.0:1746129821.323807:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054379904 00000100:00100000:2.0:1746129821.323821:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054380032 00000100:00100000:2.0:1746129821.323826:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054380032 00000100:00100000:2.0:1746129821.323920:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15498 00000100:00100000:3.0:1746129821.323928:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15499 00000100:00100000:2.0:1746129821.323929:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054379904:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129821.323935:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054380032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.323942:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.323942:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.323953:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x48868a4e4395527b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fa5 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.323953:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e43955274 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355f9e expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.323976:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x48868a4e4395527b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fa5 expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.323984:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7dc00/0x48868a4e4395527b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fa5 expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129821.323989:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054033664:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129821.323993:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a7dc00, rc 0) 00000100:00100000:3.0:1746129821.324199:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054380032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 265us (452us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.324214:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.324310:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15499 00000100:00100000:1.0:1746129821.325215:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054033536:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.325243:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8c76c00/0x48868a4e4395526d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f97 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.325254:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8c76c00/0x48868a4e4395526d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f97 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.325262:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8c76c00, rc 0) 00000100:00100000:1.0:1746129821.325304:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054379776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3810us (3895us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.325309:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15497 00000100:00100000:2.0:1746129821.327665:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054033664:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.327693:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e43955274 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f9e expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.327705:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e43955274 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f9e expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.327720:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c400, rc 0) 00000100:00100000:2.0:1746129821.327770:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054379904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3842us (4292us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.327778:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15498 00000100:00100000:0.0:1746129821.328744:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054378752:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12978us (13280us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129821.328752:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6942 00002000:00100000:0.0:1746129821.328759:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ee300 x1830949054378752/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129821.328767:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ee300 with x1830949054378752 ext(3145728->4194303) 00002000:00010000:0.0:1746129821.328771:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ee300 00000100:00100000:0.0:1746129821.329211:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.329367:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054380288 00000100:00100000:2.0:1746129821.329373:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054380288 00000100:00100000:2.0:1746129821.329414:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4614 00000100:00100000:2.0:1746129821.329421:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31596:x1830949054380288:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129821.329747:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31596:x1830949054380288:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 325us (535us total) trans 8589945045 rc 0/0 00000100:00100000:2.0:1746129821.329753:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4614 00000100:00100000:0.0:1746129821.332209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.332250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.332285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.332347:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054380544 00000100:00100000:3.0:1746129821.332355:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054380544 00000100:00100000:2.0:1746129821.332363:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054380416 00000100:00100000:2.0:1746129821.332367:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054380416 00000100:00100000:2.0:1746129821.332432:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054380672 00000100:00100000:2.0:1746129821.332435:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054380672 00000100:00100000:3.0:1746129821.332478:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15500 00000100:00100000:3.0:1746129821.332486:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054380416:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.332503:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129821.332503:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15501 00000100:00100000:1.0:1746129821.332510:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054380544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.332517:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.332520:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f26200/0x48868a4e43955282 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fac expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.332524:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d0aa800/0x48868a4e43955289 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fb3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.332565:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054033920:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.332565:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009faa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054033792:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.332613:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15502 00000100:00100000:2.0:1746129821.332619:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054380672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.332627:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129821.332635:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00010000:00010000:2.0:1746129821.332636:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08d600/0x48868a4e43955290 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fba expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.332653:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08d600/0x48868a4e43955290 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fba expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.332662:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08d600/0x48868a4e43955290 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fba expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.332672:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08d600, rc 0) 00000100:00100000:2.0:1746129821.332692:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054380672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 74us (407us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.332697:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15502 00000100:00100000:1.0:1746129821.333231:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.334936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.335374:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054380928 00000100:00100000:2.0:1746129821.335380:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054380928 00002000:00100000:2.0:1746129821.335411:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (2076672->2080767) req@ffff880094a4df80 x1830949054380928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.335420:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4df80 with x1830949054380928 ext(2076672->2080767) 00002000:00010000:2.0:1746129821.335424:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4df80 00000100:00100000:2.0:1746129821.335450:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6945 00000100:00100000:2.0:1746129821.335455:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054380928:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129821.335605:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054380928:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 150us (674us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129821.335611:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6945 00002000:00100000:2.0:1746129821.335615:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (2076672->2080767) req@ffff880094a4df80 x1830949054380928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.335622:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4df80 with x1830949054380928 ext(2076672->2080767) 00002000:00010000:2.0:1746129821.335624:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4df80 00000100:00100000:3.0:1746129821.336550:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054033920:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129821.336574:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f26200/0x48868a4e43955282 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fac expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.336586:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f26200/0x48868a4e43955282 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fac expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.336597:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f26200, rc 0) 00000100:00100000:1.0:1746129821.336598:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009faa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054033792:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.336614:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d0aa800/0x48868a4e43955289 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fb3 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129821.336618:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054380416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4134us (4367us total) trans 0 rc 301/301 00010000:00010000:1.0:1746129821.336622:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d0aa800/0x48868a4e43955289 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fb3 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129821.336624:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15500 00010000:00010000:1.0:1746129821.336629:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0aa800, rc 0) 00000100:00100000:1.0:1746129821.336648:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949054380544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4139us (4447us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.336653:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15501 00000100:00100000:0.0:1746129821.338226:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.338267:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.338312:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054381184 00000100:00100000:1.0:1746129821.338320:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054381184 00000100:00100000:1.0:1746129821.338359:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054381056 00000100:00100000:1.0:1746129821.338361:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054381056 00000100:00100000:3.0:1746129821.338364:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15503 00000100:00100000:3.0:1746129821.338374:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054381184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.338387:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.338404:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f27c00/0x48868a4e43955297 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fc8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.338429:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f27c00/0x48868a4e43955297 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fc8 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.338438:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f27c00/0x48868a4e43955297 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fc8 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.338447:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f27c00, rc 0) 00000100:00100000:3.0:1746129821.338476:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054381184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 105us (259us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.338481:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15503 00000100:00100000:3.0:1746129821.338494:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15504 00000100:00100000:3.0:1746129821.338498:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054381056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.338504:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.338510:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f27000/0x48868a4e4395529e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fc1 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.338539:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054034048:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129821.338583:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.340612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:3.0:1746129821.340869:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129820 -> 1746129821 00002000:00010000:3.0:1746129821.340873:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129820 -> 1746129821 00002000:00010000:3.0:1746129821.340874:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129820 -> 1746129821 00000100:00100000:3.0:1746129821.340893:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054034048:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129821.340970:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f27000/0x48868a4e4395529e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fc1 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.340983:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f27000/0x48868a4e4395529e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fc1 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.340991:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f27000, rc 0) 00000100:00100000:3.0:1746129821.341040:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1963:x1830949054381056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2540us (2772us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.341048:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15504 00000100:00100000:2.0:1746129821.341202:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054381440 00000100:00100000:2.0:1746129821.341207:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054381440 00000100:00100000:2.0:1746129821.341246:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4615 00000100:00100000:2.0:1746129821.341253:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31598:x1830949054381440:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129821.341403:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31598:x1830949054381440:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 150us (797us total) trans 8589945046 rc 0/0 00000100:00100000:2.0:1746129821.341408:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4615 00000100:00100000:2.0:1746129821.344533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.344911:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054381696 00000100:00100000:3.0:1746129821.344919:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054381696 00000100:00100000:0.0:1746129821.345370:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.345400:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4616 00000100:00100000:3.0:1746129821.345409:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31550:x1830949054381696:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129821.345611:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31550:x1830949054381696:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 202us (1091us total) trans 8589945047 rc 0/0 00000100:00100000:3.0:1746129821.345617:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4616 00000100:00100000:2.0:1746129821.345913:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054381952 00000100:00100000:2.0:1746129821.345917:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054381952 00002000:00100000:2.0:1746129821.345941:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094a4ed80 x1830949054381952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 504/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.345951:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ed80 with x1830949054381952 ext(1048576->2097151) 00002000:00010000:2.0:1746129821.345956:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4ed80 00000100:00100000:2.0:1746129821.345967:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6946 00000100:00100000:2.0:1746129821.345972:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054381952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129821.348822:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.348904:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054382208 00000100:00100000:3.0:1746129821.348911:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054382208 00000100:00100000:3.0:1746129821.348943:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4617 00000100:00100000:3.0:1746129821.348949:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31550:x1830949054382208:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129821.349092:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31550:x1830949054382208:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 143us (278us total) trans 8589945048 rc 0/0 00000100:00100000:3.0:1746129821.349099:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4617 00000100:00100000:1.0:1746129821.349360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.349409:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054382464 00000100:00100000:3.0:1746129821.349412:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054382464 00002000:00100000:3.0:1746129821.349431:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa1c00 x1830949054382464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.349441:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1c00 with x1830949054382464 ext(4194304->4931583) 00002000:00010000:3.0:1746129821.349446:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1c00 00000100:00100000:3.0:1746129821.350158:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6947 00000100:00100000:3.0:1746129821.350166:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054382464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129821.357943:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054381952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11959us (12562us total) trans 0 rc 425984/425984 00000100:00100000:2.0:1746129821.357957:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6946 00002000:00100000:2.0:1746129821.357968:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094a4ed80 x1830949054381952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 504/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 425984/425984 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.357976:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ed80 with x1830949054381952 ext(1048576->2097151) 00002000:00010000:2.0:1746129821.357981:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4ed80 00000100:00100000:3.0:1746129821.360488:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054382464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10315us (11120us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129821.360498:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6947 00002000:00100000:3.0:1746129821.360507:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa1c00 x1830949054382464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.360515:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa1c00 with x1830949054382464 ext(4194304->4931583) 00002000:00010000:3.0:1746129821.360520:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa1c00 00000100:00100000:0.0:1746129821.364519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.364609:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054382592 00000100:00100000:3.0:1746129821.364616:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054382592 00000100:00100000:3.0:1746129821.364666:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15505 00000100:00100000:3.0:1746129821.364674:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31601:x1830949054382592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.364701:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.364715:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fcf expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.364740:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.364747:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.364749:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.364752:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.364779:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.364790:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 10 pid: 20441 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.364807:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054034176:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.365473:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.367101:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.367167:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.367299:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054382720 00000100:00100000:0.0:1746129821.367306:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054382720 00000100:00100000:0.0:1746129821.367330:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054382848 00000100:00100000:0.0:1746129821.367331:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054382848 00000100:00100000:0.0:1746129821.367343:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15506 00000100:00100000:0.0:1746129821.367349:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054382720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129821.367360:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129821.367372:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c69a00/0x48868a4e439552ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fd6 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129821.367417:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054034304:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129821.367468:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.367604:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15507 00000100:00100000:3.0:1746129821.367612:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054382848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.367619:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.367627:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439552b3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fdd expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.367645:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439552b3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fdd expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.367654:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f26600/0x48868a4e439552b3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fdd expref: 11 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.367673:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f26600, rc 0) 00000100:00100000:3.0:1746129821.367695:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054382848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 85us (527us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.367700:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15507 00000100:00100000:3.0:1746129821.371036:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054034176:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.371064:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.371080:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f26400, rc 0) 00000100:00100000:3.0:1746129821.371143:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31601:x1830949054382592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6469us (6630us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.371152:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15505 00002000:00010000:1.0:1746129821.371260:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129821 -> 1746129822 00000100:00100000:1.0:1746129821.371280:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054034304:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.371299:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c69a00/0x48868a4e439552ac lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fd6 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.371308:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c69a00/0x48868a4e439552ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fd6 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.371320:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c69a00, rc 0) 00000100:00100000:1.0:1746129821.371339:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054382720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3990us (4243us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.371344:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15506 00000100:00100000:0.0:1746129821.373100:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.373162:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054382976 00000100:00100000:3.0:1746129821.373169:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054382976 00002000:00100000:3.0:1746129821.373205:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1454080->2097151) req@ffff880094a4dc00 x1830949054382976/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.373213:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4dc00 with x1830949054382976 ext(1454080->2097151) 00010000:00010000:3.0:1746129821.373220:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 11 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.373231:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 11 pid: 20441 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.373236:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a4dc00 00000100:00100000:3.0:1746129821.373268:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1873 00000100:00100000:3.0:1746129821.373274:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054382976:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129821.373917:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.374010:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054383104 00000100:00100000:1.0:1746129821.374015:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054383104 00000100:00100000:1.0:1746129821.374035:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15508 00000100:00100000:1.0:1746129821.374040:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054383104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.374048:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.374060:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439552ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355fe4 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.374097:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054034432:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.374163:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.376884:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.377158:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054383360 00000100:00100000:3.0:1746129821.377165:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054383360 00000100:00100000:3.0:1746129821.377214:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15509 00000100:00100000:3.0:1746129821.377221:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054383360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.377234:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129821.377289:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.377351:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054383232 00000100:00100000:1.0:1746129821.377355:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054383232 00000100:00100000:1.0:1746129821.377374:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15510 00000100:00100000:1.0:1746129821.377379:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054383232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.377386:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.377396:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e439552c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355feb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.377450:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054034560:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.377504:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129821.377630:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f27600/0x48868a4e439552c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ff2 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.377650:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f27600/0x48868a4e439552c8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ff2 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.377666:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f27600/0x48868a4e439552c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ff2 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.377681:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f27600, rc 0) 00000100:00100000:3.0:1746129821.377710:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054383360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 489us (862us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.377716:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15509 00000100:00100000:1.0:1746129821.381169:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054034432:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.381200:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439552ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fe4 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.381220:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507f000/0x48868a4e439552ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fe4 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.381233:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f000, rc 0) 00000100:00100000:1.0:1746129821.381277:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054383104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7235us (7360us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.381284:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15508 00002000:00010000:1.0:1746129821.381772:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129821 -> 1746129822 00000100:00100000:1.0:1746129821.381783:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054034560:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129821.381798:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e439552c1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355feb expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.381807:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a507e600/0x48868a4e439552c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355feb expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.381820:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507e600, rc 0) 00000100:00100000:1.0:1746129821.381898:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054383232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4517us (4609us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.381903:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15510 00000100:00100000:3.0:1746129821.385776:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054382976:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12493us (12671us total) trans 21474841323 rc 0/0 00000100:00100000:3.0:1746129821.385788:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1873 00002000:00100000:3.0:1746129821.385799:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1454080->2097151) req@ffff880094a4dc00 x1830949054382976/t21474841323(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.385808:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4dc00 with x1830949054382976 ext(1454080->2097151) 00010000:00010000:3.0:1746129821.385816:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 13 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.385830:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 13 pid: 20441 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.385837:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094a4dc00 00000100:00100000:0.0:1746129821.391564:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.391667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.391743:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054383744 00000100:00100000:2.0:1746129821.391751:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054383744 00010000:00010000:2.0:1746129821.391782:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 13 pid: 20441 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.391822:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7744 00000100:00100000:2.0:1746129821.391830:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054383744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.391843:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.391885:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 13 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.391897:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 13 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.391917:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009519e600/0x48868a4e439551a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f3c expref: 13 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.391946:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.391948:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.391954:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.391962:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.391990:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.392000:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054034688:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.392065:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.392564:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054383616 00000100:00100000:3.0:1746129821.392569:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054383616 00000100:00100000:3.0:1746129821.392827:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4618 00000100:00100000:3.0:1746129821.392834:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31594:x1830949054383616:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129821.393017:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d62850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31594:x1830949054383616:12345-192.168.204.31@tcp:35:cat.0 Request processed in 182us (1464us total) trans 8589945049 rc 0/0 00000100:00100000:3.0:1746129821.393023:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4618 00000100:00100000:2.0:1746129821.394530:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054034688:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.394544:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.394571:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054383744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2742us (2903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.394578:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7744 00000100:00100000:0.0:1746129821.398691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.398764:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384000 00000100:00100000:3.0:1746129821.398772:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384000 00002000:00100000:3.0:1746129821.398811:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ba38700 x1830949054384000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.398820:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38700 with x1830949054384000 ext(1048576->2097151) 00002000:00010000:3.0:1746129821.398825:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38700 00000100:00100000:2.0:1746129821.399795:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6948 00000100:00100000:2.0:1746129821.399804:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054384000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129821.409256:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054384000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9445us (10565us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129821.409268:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6948 00002000:00100000:2.0:1746129821.409278:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ba38700 x1830949054384000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.409287:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38700 with x1830949054384000 ext(1048576->2097151) 00002000:00010000:2.0:1746129821.409293:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38700 00000100:00100000:0.0:1746129821.414160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.414786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.414952:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384128 00000100:00100000:1.0:1746129821.414960:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384128 00000100:00100000:1.0:1746129821.415090:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384256 00000100:00100000:1.0:1746129821.415094:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384256 00000100:00100000:2.0:1746129821.415165:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15511 00000100:00100000:2.0:1746129821.415173:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054384128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.415188:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.415203:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e439552cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf355ff9 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.415246:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054034816:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.415314:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.415674:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15512 00000100:00100000:1.0:1746129821.415681:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054384256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.415690:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.415698:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507f200/0x48868a4e439552d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356000 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.415717:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507f200/0x48868a4e439552d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356000 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.415727:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507f200/0x48868a4e439552d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356000 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.415738:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f200, rc 0) 00000100:00100000:1.0:1746129821.415761:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054384256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 81us (976us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.415767:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15512 00002000:00010000:2.0:1746129821.419481:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129821 -> 1746129822 00000100:00100000:2.0:1746129821.419509:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054034816:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.419534:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e439552cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ff9 expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.419547:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e439552cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355ff9 expref: 15 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.419567:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c200, rc 0) 00000100:00100000:2.0:1746129821.419605:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054384128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4431us (5453us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.419612:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15511 00000100:00100000:0.0:1746129821.421691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.421750:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384384 00000100:00100000:2.0:1746129821.421756:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384384 00000100:00100000:2.0:1746129821.423841:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15513 00000100:00100000:2.0:1746129821.423868:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31601:x1830949054384384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.423886:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.423900:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356007 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.423929:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.423936:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.423937:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.423940:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.423966:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.423979:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 11 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.423990:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054034944:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.424074:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.427912:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054034944:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.427941:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.427960:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c400, rc 0) 00000100:00100000:2.0:1746129821.428008:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:31601:x1830949054384384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4143us (6319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.428015:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15513 00000100:00100000:0.0:1746129821.429570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.429651:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384512 00000100:00100000:2.0:1746129821.429657:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384512 00002000:00100000:2.0:1746129821.429693:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ba3aa00 x1830949054384512/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 504/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.429701:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949054384512 ext(2097152->3145727) 00010000:00010000:2.0:1746129821.429708:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 12 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.429720:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 12 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.429730:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba3aa00 00000100:00100000:3.0:1746129821.431443:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1874 00000100:00100000:3.0:1746129821.431457:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054384512:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129821.445135:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054384512:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13652us (15538us total) trans 21474841324 rc 0/0 00000100:00100000:3.0:1746129821.445146:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1874 00002000:00100000:3.0:1746129821.445155:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ba3aa00 x1830949054384512/t21474841324(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 504/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.445165:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949054384512 ext(2097152->3145727) 00010000:00010000:3.0:1746129821.445172:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 14 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.445184:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 14 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.445190:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba3aa00 00000100:00100000:0.0:1746129821.457010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.457077:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384640 00000100:00100000:2.0:1746129821.457086:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384640 00010000:00010000:2.0:1746129821.457126:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 14 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.457166:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7745 00000100:00100000:2.0:1746129821.457173:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054384640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.457186:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.457204:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 14 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.457215:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 14 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.457235:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba6e400/0x48868a4e439551b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2334719) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f51 expref: 14 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.457260:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.457262:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.457268:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.457275:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.457308:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.457319:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054035072:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.457393:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.459643:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054035072:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.459671:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.459710:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054384640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2537us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.459718:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7745 00000100:00100000:0.0:1746129821.463228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.463345:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054384896 00000100:00100000:2.0:1746129821.463746:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054384896 00002000:00100000:2.0:1746129821.463785:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a504f800 x1830949054384896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.463795:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f800 with x1830949054384896 ext(2097152->3145727) 00002000:00010000:2.0:1746129821.463799:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f800 00000100:00100000:2.0:1746129821.463828:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6949 00000100:00100000:2.0:1746129821.463834:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054384896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.476427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.476486:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385152 00000100:00100000:1.0:1746129821.476494:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385152 00000100:00100000:1.0:1746129821.476534:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11042 00000100:00100000:1.0:1746129821.476541:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31607:x1830949054385152:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129821.476560:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.476574:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f400/0x48868a4e439552e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35600e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.476662:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476673:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476685:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476695:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476700:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476704:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476789:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e439552f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476796:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e439552f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476802:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e439552f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.476809:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.476909:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476916:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476921:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476927:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507fc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.476930:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476936:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476946:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.476948:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.476952:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476956:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fc00/0x48868a4e439552eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476970:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476975:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476979:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476983:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507f800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.476986:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476990:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.476996:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b800) 00010000:00010000:1.0:1746129821.476998:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.477000:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.477004:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f800/0x48868a4e439552f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.477035:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f400/0x48868a4e439552e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35600e expref: 26 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.477044:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e439552f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35600e expref: 25 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.477049:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.477051:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129821.477053:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507e200, rc 0) 00000100:00100000:3.0:1746129821.477057:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054384896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13223us (13835us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.477065:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6949 00002000:00100000:3.0:1746129821.477073:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a504f800 x1830949054384896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129821.477073:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31607:x1830949054385152:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 534us (655us total) trans 8589945050 rc 0/0 00000100:00100000:1.0:1746129821.477078:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11042 00002000:00100000:3.0:1746129821.477205:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f800 with x1830949054384896 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.477209:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f800 00000100:00100000:0.0:1746129821.488144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.488729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.488799:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385280 00000100:00100000:3.0:1746129821.488807:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385280 00000100:00100000:3.0:1746129821.488890:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 730 00000100:00100000:3.0:1746129821.488898:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054385280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.488909:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.488928:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e439552f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35600e expref: 25 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.489120:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385408 00000100:00100000:2.0:1746129821.489125:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385408 00000100:00100000:2.0:1746129821.489151:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15514 00000100:00100000:2.0:1746129821.489157:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31601:x1830949054385408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.489169:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.489181:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356015 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.489199:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.489206:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.489207:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.489210:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.489233:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.489242:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 7 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.489252:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054035200:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.489325:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746129821.489386:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129821.489390:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.489412:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054385280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 515us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.489418:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 730 00000100:00100000:0.0:1746129821.491253:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.491346:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385536 00000100:00100000:3.0:1746129821.491351:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385536 00002000:00100000:3.0:1746129821.491378:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2256895) req@ffff8800a504c380 x1830949054385536/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.491386:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c380 with x1830949054385536 ext(2097152->2256895) 00010000:00010000:3.0:1746129821.491393:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 8 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.491404:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 8 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.491410:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504c380 00000100:00100000:3.0:1746129821.491425:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1875 00000100:00100000:3.0:1746129821.491431:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054385536:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129821.491659:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054035200:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.491678:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.491691:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08de00, rc 0) 00000100:00100000:2.0:1746129821.491712:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31601:x1830949054385408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2555us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.491718:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15514 00000100:00100000:0.0:1746129821.495277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.495646:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385664 00000100:00100000:2.0:1746129821.495654:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385664 00000100:00100000:2.0:1746129821.495694:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15515 00000100:00100000:2.0:1746129821.495701:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31607:x1830949054385664:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129821.495716:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.495730:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35601c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.495754:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.495760:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.495762:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.495765:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3915776->4194303] (req 3915776->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.495788:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.495797:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.495807:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054035328:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.495909:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.504264:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054385536:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12825us (13009us total) trans 17179874127 rc 0/0 00000100:00100000:3.0:1746129821.504274:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1875 00002000:00100000:3.0:1746129821.504283:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2256895) req@ffff8800a504c380 x1830949054385536/t17179874127(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.504292:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c380 with x1830949054385536 ext(2097152->2256895) 00010000:00010000:3.0:1746129821.504300:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.504309:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.504315:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504c380 00000100:00100000:2.0:1746129821.504474:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054035328:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.504499:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3915776->4194303] (req 3915776->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.504518:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08d800, rc 0) 00000100:00100000:2.0:1746129821.504542:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31607:x1830949054385664:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8841us (9271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.504548:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15515 00000100:00100000:0.0:1746129821.506224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.506431:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385792 00000100:00100000:3.0:1746129821.506438:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385792 00010000:00010000:3.0:1746129821.506463:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 15 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.506499:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7746 00000100:00100000:3.0:1746129821.506507:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054385792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.506517:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.506533:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 15 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.506542:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 15 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.506560:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c400/0x48868a4e439552dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356007 expref: 15 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.506721:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.506724:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.506730:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.506738:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.506766:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.506777:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054035456:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129821.507463:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.510936:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.511008:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.511083:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054385920 00000100:00100000:1.0:1746129821.511091:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054385920 00010000:00010000:1.0:1746129821.511128:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746129821.511151:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7747 00000100:00100000:1.0:1746129821.511158:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054385920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129821.511169:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129821.511189:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746129821.511199:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746129821.511223:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a7ca00/0x48868a4e43955235 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->2256895) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f7b expref: 10 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746129821.511239:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.511240:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.511247:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.511254:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.511280:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 23 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.511291:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054035584:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129821.511349:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.511524:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054035456:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.511542:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.511561:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054385792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5055us (5341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.511567:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7746 00000100:00100000:2.0:1746129821.511636:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054386176 00000100:00100000:2.0:1746129821.511640:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054386176 00002000:00100000:2.0:1746129821.511664:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3915776->3919871) req@ffff8800a504e680 x1830949054386176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.511672:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949054386176 ext(3915776->3919871) 00002000:00010000:2.0:1746129821.511676:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504e680 00000100:00100000:2.0:1746129821.511698:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6950 00000100:00100000:2.0:1746129821.511703:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054386176:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129821.511827:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054386176:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 124us (819us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129821.511833:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6950 00002000:00100000:2.0:1746129821.511838:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3915776->3919871) req@ffff8800a504e680 x1830949054386176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.512226:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e680 with x1830949054386176 ext(3915776->3919871) 00002000:00010000:2.0:1746129821.512229:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504e680 00000100:00100000:0.0:1746129821.515333:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.515396:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054386432 00000100:00100000:1.0:1746129821.515403:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054386432 00000100:00100000:1.0:1746129821.515444:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11043 00000100:00100000:1.0:1746129821.515450:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937da850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31610:x1830949054386432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.515469:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.515485:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e600/0x48868a4e43955315 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356023 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.515632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.515653:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054386688 00000100:00100000:2.0:1746129821.515656:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054386688 00002000:00100000:2.0:1746129821.515842:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009206e300 x1830949054386688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.515872:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e300 with x1830949054386688 ext(2097152->3145727) 00002000:00010000:2.0:1746129821.515876:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009206e300 00010000:00010000:1.0:1746129821.515945:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129821.516005:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054035584:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129821.516017:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.516049:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054385920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4892us (5122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.516056:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7747 00000100:00100000:2.0:1746129821.516096:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6951 00000100:00100000:2.0:1746129821.516101:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054386688:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129821.516275:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.516285:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.516294:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.516441:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e600/0x48868a4e43955315 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 27 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.516453:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 26 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.516460:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.516462:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129821.516464:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507fe00, rc 0) 00000100:00100000:1.0:1746129821.516934:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937da850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31610:x1830949054386432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1482us (1608us total) trans 8589945051 rc 0/0 00000100:00100000:1.0:1746129821.516940:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11043 00000100:00100000:0.0:1746129821.518158:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.520132:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054386816 00000100:00100000:0.0:1746129821.520140:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054386816 00000100:00100000:0.0:1746129821.520183:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15516 00000100:00100000:0.0:1746129821.520191:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31607:x1830949054386816:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129821.520205:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129821.520223:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35602a expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.520248:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 25 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.520256:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.520262:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129821.520264:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129821.520267:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.520585:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.520595:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 10 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746129821.520607:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054035712:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129821.520683:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 25 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.520691:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 25 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746129821.520698:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054035840:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129821.520714:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.526311:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.527040:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.527238:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.527306:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387072 00000100:00100000:0.0:1746129821.527306:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054386944 00000100:00100000:2.0:1746129821.527313:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387072 00000100:00100000:0.0:1746129821.527313:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054386944 00000100:00100000:1.0:1746129821.527436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.527508:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387200 00000100:00100000:2.0:1746129821.527514:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387200 00000100:00100000:0.0:1746129821.527544:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15517 00000100:00100000:2.0:1746129821.527584:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15518 00000100:00100000:0.0:1746129821.527587:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054387072:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129821.527588:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054386944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.527601:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129821.527601:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.527614:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc53000/0x48868a4e43955338 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356031 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.527614:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356038 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.527631:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.527634:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.527640:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129821.527651:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054035968:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129821.527652:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 15 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129821.527660:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c69600, rc 0) 00000100:00100000:3.0:1746129821.527702:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15519 00000100:00100000:3.0:1746129821.527709:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054387200:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129821.527711:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00010000:00010000:3.0:1746129821.527715:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.527721:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395533f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35603f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.527729:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.527735:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395533f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35603f expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.527742:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395533f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35603f expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.527764:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907600, rc 0) 00000100:00100000:0.0:1746129821.527898:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054387072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 311us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.527904:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15517 00000100:00100000:0.0:1746129821.527922:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387328 00000100:00100000:0.0:1746129821.527925:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387328 00010000:00010000:0.0:1746129821.527938:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746129821.527954:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7748 00000100:00100000:0.0:1746129821.527959:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054387328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129821.527966:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129821.527982:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746129821.527991:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746129821.528003:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.528017:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054387328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.528023:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7748 00010000:00010000:0.0:1746129821.528048:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c69c00/0x48868a4e4395523c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f82 expref: 13 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.528135:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054387200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 426us (896us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.528140:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15519 00000100:00100000:0.0:1746129821.528760:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054035712:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129821.528774:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054035840:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129821.528791:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->3190783] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.528799:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c69000, rc 0) 00000100:00100000:3.0:1746129821.529463:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054386688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13359us (13829us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.529471:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6951 00002000:00100000:3.0:1746129821.529479:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009206e300 x1830949054386688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.529487:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e300 with x1830949054386688 ext(2097152->3145727) 00010000:00010000:3.0:1746129821.529493:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.529504:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.529509:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206e300 00000100:00100000:0.0:1746129821.529589:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31607:x1830949054386816:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9397us (11433us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.529595:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15516 00000100:00100000:2.0:1746129821.530464:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054035968:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.530482:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc53000/0x48868a4e43955338 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356031 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.530491:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc53000/0x48868a4e43955338 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356031 expref: 10 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.530511:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc53000, rc 0) 00000100:00100000:2.0:1746129821.530624:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054386944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3033us (4319us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.530629:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15518 00000100:00100000:0.0:1746129821.537522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.537763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.537844:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387456 00000100:00100000:2.0:1746129821.537872:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387456 00000100:00100000:2.0:1746129821.537913:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15520 00000100:00100000:2.0:1746129821.537920:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31610:x1830949054387456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.537934:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.537947:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356046 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.537970:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.537976:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.537978:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.537981:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.538003:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.538013:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 23 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.538023:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054036096:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.538139:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387584 00000100:00100000:3.0:1746129821.538143:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387584 00010000:00010000:3.0:1746129821.538158:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.538174:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7749 00000100:00100000:3.0:1746129821.538179:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054387584:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.538186:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.538203:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.538212:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.538227:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08de00/0x48868a4e43955307 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356015 expref: 24 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.538242:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.538243:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.538248:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.538258:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.538277:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 10 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.538285:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054036224:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.538527:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.538645:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.540218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.540531:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387712 00000100:00100000:2.0:1746129821.540536:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387712 00000100:00100000:2.0:1746129821.540572:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15521 00000100:00100000:2.0:1746129821.540578:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31601:x1830949054387712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.540589:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.540602:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35604d expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.540621:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.540627:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.540628:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.540631:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.540651:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.540659:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.540667:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054036352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.540992:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054036096:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.541009:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 10 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.541017:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc52600, rc 0) 00000100:00100000:3.0:1746129821.541033:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31610:x1830949054387456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3115us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.541038:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15520 00000100:00100000:2.0:1746129821.541679:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.542788:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.542938:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054387968 00000100:00100000:2.0:1746129821.542944:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054387968 00002000:00100000:2.0:1746129821.542973:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3186688->3190783) req@ffff880091fa7800 x1830949054387968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.542987:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7800 with x1830949054387968 ext(3186688->3190783) 00002000:00010000:2.0:1746129821.542991:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa7800 00000100:00100000:2.0:1746129821.543023:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6952 00000100:00100000:2.0:1746129821.543030:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054387968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129821.543171:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054387968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 142us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129821.543177:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6952 00002000:00100000:2.0:1746129821.543182:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3186688->3190783) req@ffff880091fa7800 x1830949054387968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.543188:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa7800 with x1830949054387968 ext(3186688->3190783) 00002000:00010000:2.0:1746129821.543191:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa7800 00000100:00100000:0.0:1746129821.543688:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.543745:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054388096 00000100:00100000:0.0:1746129821.543749:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054388096 00002000:00100000:0.0:1746129821.543765:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1458176->2080767) req@ffff8800a504d500 x1830949054388096/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129821.543771:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d500 with x1830949054388096 ext(1458176->2080767) 00010000:00010000:0.0:1746129821.543777:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 24 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746129821.543791:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 24 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746129821.543796:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504d500 00000100:00100000:0.0:1746129821.543807:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1876 00000100:00100000:0.0:1746129821.543812:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054388096:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129821.544942:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054036224:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.544963:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.544983:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054387584:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6803us (7220us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.544990:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7749 00000100:00100000:0.0:1746129821.546301:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.546387:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054036352:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.546406:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.546420:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a51c4000, rc 0) 00000100:00100000:2.0:1746129821.547484:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:31601:x1830949054387712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6901us (7265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.547491:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15521 00000100:00100000:0.0:1746129821.548080:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.548635:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054388480 00000100:00100000:2.0:1746129821.548641:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054388480 00002000:00100000:2.0:1746129821.548672:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3915776->4194303) req@ffff8800a504ce00 x1830949054388480/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.548687:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ce00 with x1830949054388480 ext(3915776->4194303) 00010000:00010000:2.0:1746129821.548695:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 15 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.548706:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 15 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.548712:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504ce00 00000100:00100000:2.0:1746129821.548728:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1877 00000100:00100000:2.0:1746129821.548735:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054388480:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129821.548897:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054388352 00000100:00100000:3.0:1746129821.548901:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054388352 00000100:00100000:3.0:1746129821.548931:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4619 00000100:00100000:3.0:1746129821.548937:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31607:x1830949054388352:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129821.549571:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31607:x1830949054388352:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 633us (3274us total) trans 8589945052 rc 0/0 00000100:00100000:3.0:1746129821.549578:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4619 00000100:00100000:2.0:1746129821.558011:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054388096:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14189us (14314us total) trans 17179874128 rc 0/0 00000100:00100000:2.0:1746129821.558022:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1876 00002000:00100000:2.0:1746129821.558032:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1458176->2080767) req@ffff8800a504d500 x1830949054388096/t17179874128(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.558040:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d500 with x1830949054388096 ext(1458176->2080767) 00010000:00010000:2.0:1746129821.558049:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 25 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.558060:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 25 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.558065:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a504d500 00000100:00100000:3.0:1746129821.559778:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054388480:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11038us (11693us total) trans 21474841325 rc 0/0 00000100:00100000:3.0:1746129821.559786:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1877 00002000:00100000:3.0:1746129821.559792:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3915776->4194303) req@ffff8800a504ce00 x1830949054388480/t21474841325(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.559800:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ce00 with x1830949054388480 ext(3915776->4194303) 00010000:00010000:3.0:1746129821.559806:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 17 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.559815:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 17 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.559820:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a504ce00 00000100:00100000:0.0:1746129821.566688:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.569534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.570091:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054388608 00000100:00100000:3.0:1746129821.570100:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054388608 00010000:00010000:3.0:1746129821.570142:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 25 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.570176:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054388736 00000100:00100000:3.0:1746129821.570179:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054388736 00010000:00010000:3.0:1746129821.570190:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 17 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.570207:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7750 00000100:00100000:3.0:1746129821.570213:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054388608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129821.570216:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7751 00000100:00100000:2.0:1746129821.570223:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054388736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.570227:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.570229:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129821.570242:0:10979:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129821 -> 1746129822 00010000:00010000:3.0:1746129821.570245:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 25 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.570245:0:10979:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129821 -> 1746129822 00010000:00010000:2.0:1746129821.570249:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 17 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.570254:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 25 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.570255:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 17 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.570274:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135cab800/0x48868a4e43955243 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1458176->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355f89 expref: 25 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.570274:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08d800/0x48868a4e4395530e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3915776->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35601c expref: 17 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.570290:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.570290:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.570292:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.570292:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.570298:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.570298:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.570305:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.570305:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.570329:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 9 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.570329:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.570339:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054036608:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.570339:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054036480:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129821.570406:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.570415:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.577894:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.577905:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054036608:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.577923:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.577968:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054388608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7754us (11286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.577978:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7750 00000100:00100000:3.0:1746129821.578035:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054388992 00000100:00100000:3.0:1746129821.578040:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054388992 00002000:00100000:3.0:1746129821.578066:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a504f100 x1830949054388992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.578074:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f100 with x1830949054388992 ext(3145728->4194303) 00002000:00010000:3.0:1746129821.578078:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f100 00000100:00100000:3.0:1746129821.578089:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6953 00000100:00100000:3.0:1746129821.578094:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054388992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.579767:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.579790:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054389376 00000100:00100000:0.0:1746129821.579794:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054389376 00002000:00100000:0.0:1746129821.579818:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504ea00 x1830949054389376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129821.579826:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ea00 with x1830949054389376 ext(1048576->2097151) 00002000:00010000:0.0:1746129821.579829:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504ea00 00000100:00100000:0.0:1746129821.579882:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6954 00000100:00100000:0.0:1746129821.579907:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054389376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129821.581679:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054036480:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.581696:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.581726:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054388736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11502us (12223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.581735:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7751 00000100:00100000:0.0:1746129821.588685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.588749:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054389504 00000100:00100000:2.0:1746129821.588758:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054389504 00002000:00100000:2.0:1746129821.588796:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a504c700 x1830949054389504/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.588805:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949054389504 ext(1048576->2097151) 00002000:00010000:2.0:1746129821.588809:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c700 00000100:00100000:2.0:1746129821.588842:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6955 00000100:00100000:2.0:1746129821.588873:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054389504:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.591401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.591443:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054389760 00000100:00100000:1.0:1746129821.591449:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054389760 00000100:00100000:1.0:1746129821.591499:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11044 00000100:00100000:1.0:1746129821.591507:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31613:x1830949054389760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129821.591527:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.591541:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054800/0x48868a4e43955354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356054 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.591633:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591645:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591653:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591665:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591670:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591676:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591762:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054400/0x48868a4e43955369 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591770:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054400/0x48868a4e43955369 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.591777:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054400/0x48868a4e43955369 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129821.591785:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.592006:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592016:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592021:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592026:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e055e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.592029:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592034:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592044:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.592046:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.592050:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592054:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e4395535b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592072:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592078:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592082:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592087:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e055c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.592089:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592097:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592102:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b800) 00010000:00010000:1.0:1746129821.592104:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.592106:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592120:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055c00/0x48868a4e43955362 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.592151:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054800/0x48868a4e43955354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356054 expref: 300 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.592160:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054400/0x48868a4e43955369 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356054 expref: 299 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.592166:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.592168:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129821.592170:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e054400, rc 0) 00000100:00100000:1.0:1746129821.593073:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31613:x1830949054389760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1562us (2920us total) trans 8589945053 rc 0/0 00000100:00100000:1.0:1746129821.593080:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11044 00000100:00100000:3.0:1746129821.596571:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054388992:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18467us (19994us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.596582:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6953 00002000:00100000:3.0:1746129821.596592:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a504f100 x1830949054388992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.596600:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504f100 with x1830949054388992 ext(3145728->4194303) 00002000:00010000:3.0:1746129821.596607:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504f100 00000100:00100000:1.0:1746129821.601065:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054389376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21166us (21292us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129821.601078:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6954 00002000:00100000:1.0:1746129821.601089:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504ea00 x1830949054389376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.601104:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ea00 with x1830949054389376 ext(1048576->2097151) 00002000:00010000:1.0:1746129821.601120:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504ea00 00000100:00100000:3.0:1746129821.603916:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054389504:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15049us (15219us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.603932:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6955 00002000:00100000:3.0:1746129821.603947:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a504c700 x1830949054389504/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.603956:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504c700 with x1830949054389504 ext(1048576->2097151) 00002000:00010000:3.0:1746129821.603961:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504c700 00000100:00100000:0.0:1746129821.608322:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.611133:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054389888 00000100:00100000:2.0:1746129821.611146:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054389888 00000100:00100000:2.0:1746129821.611210:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 731 00000100:00100000:2.0:1746129821.611217:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1962:x1830949054389888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.611229:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.611252:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e054400/0x48868a4e43955369 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356054 expref: 299 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.611270:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129821.611274:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.611319:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054389888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (3005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.611325:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 731 00000100:00100000:2.0:1746129821.611997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.612264:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390144 00000100:00100000:0.0:1746129821.612269:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390144 00000100:00100000:0.0:1746129821.612302:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15522 00000100:00100000:0.0:1746129821.612307:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31610:x1830949054390144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129821.612319:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129821.612330:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356062 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.612348:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.612349:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.612369:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.612381:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.612388:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f200, rc 0) 00000100:00100000:0.0:1746129821.612424:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31610:x1830949054390144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 116us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.612429:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15522 00000100:00100000:0.0:1746129821.614116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.614186:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390016 00000100:00100000:3.0:1746129821.614191:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390016 00000100:00100000:3.0:1746129821.614217:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15523 00000100:00100000:3.0:1746129821.614222:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31601:x1830949054390016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.614233:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.614244:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35605b expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.614264:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 9 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.614270:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.614271:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.614274:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.614296:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 9 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.614306:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 9 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.614317:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054036736:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.614694:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.616895:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.616999:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054036736:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.617020:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.617034:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fd800, rc 0) 00000100:00100000:3.0:1746129821.617064:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31601:x1830949054390016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2842us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.617071:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15523 00000100:00100000:2.0:1746129821.617476:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390272 00000100:00100000:2.0:1746129821.617483:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390272 00002000:00100000:2.0:1746129821.617514:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3190783) req@ffff8800a8793b80 x1830949054390272/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.617522:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793b80 with x1830949054390272 ext(3145728->3190783) 00010000:00010000:2.0:1746129821.617528:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 10 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.617538:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 10 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746129821.617543:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8793b80 00000100:00100000:0.0:1746129821.617689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.617766:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1878 00000100:00100000:2.0:1746129821.617773:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054390272:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129821.618164:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390400 00000100:00100000:3.0:1746129821.618168:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390400 00000100:00100000:3.0:1746129821.618525:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15524 00000100:00100000:3.0:1746129821.618532:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31613:x1830949054390400:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129821.618541:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.618552:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356069 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.618569:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.618575:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.618577:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.618579:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.618602:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.618615:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 11 pid: 3623 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.618625:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054036864:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.619463:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.621797:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054390272:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4017us (4900us total) trans 17179874129 rc 0/0 00000100:00100000:3.0:1746129821.621806:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1878 00002000:00100000:3.0:1746129821.621816:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3190783) req@ffff8800a8793b80 x1830949054390272/t17179874129(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.621825:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793b80 with x1830949054390272 ext(3145728->3190783) 00010000:00010000:3.0:1746129821.621833:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.621843:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746129821.621874:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a8793b80 00000100:00100000:0.0:1746129821.622057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.622354:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054036864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.622376:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1982464->2097151] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.622389:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fd600, rc 0) 00000100:00100000:3.0:1746129821.622439:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390656 00000100:00100000:3.0:1746129821.622444:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390656 00002000:00100000:3.0:1746129821.622466:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a8792a00 x1830949054390656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.622474:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792a00 with x1830949054390656 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.622476:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8792a00 00000100:00100000:3.0:1746129821.622497:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6956 00000100:00100000:3.0:1746129821.622503:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054390656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129821.623066:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31613:x1830949054390400:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4532us (5374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.623072:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15524 00000100:00100000:0.0:1746129821.625805:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.625889:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.625944:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390784 00000100:00100000:2.0:1746129821.625951:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390784 00010000:00010000:2.0:1746129821.626043:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 12 pid: 3623 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.626044:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054390912 00000100:00100000:3.0:1746129821.626047:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054390912 00010000:00010000:3.0:1746129821.626060:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 13 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.626087:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7752 00000100:00100000:3.0:1746129821.626094:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054390784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.626105:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.626133:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 13 pid: 3623 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.626143:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 13 pid: 3623 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.626163:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc52600/0x48868a4e43955346 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356046 expref: 13 pid: 3623 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.626182:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.626184:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129821.626253:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7753 00000100:00100000:2.0:1746129821.626259:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054390912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.626265:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129821.626274:0:10979:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129821 -> 1746129822 00002000:00010000:2.0:1746129821.626276:0:10979:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129821 -> 1746129822 00010000:00010000:2.0:1746129821.626280:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.626289:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.626299:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c69000/0x48868a4e4395532a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3190783) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35602a expref: 12 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.626310:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.626312:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.626317:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.626324:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.626349:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.626362:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054036992:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129821.626420:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00010000:00010000:3.0:1746129821.627116:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.627124:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.627144:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.627151:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054037120:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129821.627448:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b56cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.629164:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054036992:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.629181:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.629219:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054390912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2959us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.629228:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7753 00000100:00100000:2.0:1746129821.629261:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054037120:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129821.629269:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.629280:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054390784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3188us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.629284:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7752 00000100:00100000:3.0:1746129821.629419:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054390656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6915us (7361us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.629425:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6956 00002000:00100000:3.0:1746129821.629431:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a8792a00 x1830949054390656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.629439:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792a00 with x1830949054390656 ext(2097152->3145727) 00002000:00010000:3.0:1746129821.629443:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8792a00 00000100:00100000:0.0:1746129821.629718:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.630205:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054391168 00000100:00100000:3.0:1746129821.630211:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054391168 00002000:00100000:3.0:1746129821.630236:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1982464->1986559) req@ffff8800a8790e00 x1830949054391168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.630243:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790e00 with x1830949054391168 ext(1982464->1986559) 00002000:00010000:3.0:1746129821.630246:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790e00 00000100:00100000:3.0:1746129821.630303:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6957 00000100:00100000:3.0:1746129821.630310:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054391168:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129821.630434:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054391168:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 124us (716us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129821.630443:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6957 00002000:00100000:3.0:1746129821.630448:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1982464->1986559) req@ffff8800a8790e00 x1830949054391168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.630453:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790e00 with x1830949054391168 ext(1982464->1986559) 00002000:00010000:3.0:1746129821.630456:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790e00 00000100:00100000:0.0:1746129821.633738:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.633803:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.633891:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054391552 00000100:00100000:2.0:1746129821.633903:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054391552 00000100:00100000:2.0:1746129821.633956:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15525 00000100:00100000:2.0:1746129821.633964:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31613:x1830949054391552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129821.633987:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.634008:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356070 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.634038:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.634045:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 27 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.634053:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.634059:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.634061:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.634064:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.634099:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.634123:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 9 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.634137:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037248:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.634250:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 27 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.634258:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 27 pid: 7975 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.634267:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037376:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.634292:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.634305:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 5 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.634313:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.634329:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.634583:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054391424 00000100:00100000:3.0:1746129821.634587:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054391424 00002000:00100000:3.0:1746129821.634610:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8792d80 x1830949054391424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.634618:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792d80 with x1830949054391424 ext(3145728->4194303) 00002000:00010000:3.0:1746129821.634622:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8792d80 00000100:00100000:3.0:1746129821.634635:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6958 00000100:00100000:3.0:1746129821.634641:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054391424:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129821.637977:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.638035:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054391680 00000100:00100000:1.0:1746129821.638042:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054391680 00000100:00100000:1.0:1746129821.638085:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15526 00000100:00100000:1.0:1746129821.638092:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31610:x1830949054391680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.638105:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.638128:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356077 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.638148:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.638150:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.638156:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.638168:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 11 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.638176:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e055c00, rc 0) 00000100:00100000:1.0:1746129821.638207:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31610:x1830949054391680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 116us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129821.638212:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15526 00000100:00100000:2.0:1746129821.640819:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037248:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129821.641587:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.642904:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054391808 00000100:00100000:2.0:1746129821.642912:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054391808 00010000:00010000:2.0:1746129821.642941:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 11 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746129821.643409:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7754 00000100:00100000:2.0:1746129821.643417:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054391808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.643428:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.643447:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 11 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.643458:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 11 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.643476:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136379c00/0x48868a4e43954f4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e08 expref: 11 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746129821.643503:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.643539:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054391808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (1953us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.643544:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7754 00000100:00100000:2.0:1746129821.643576:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.643585:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037504:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.643608:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1249279] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.643617:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fde9a00, rc 0) 00000100:00100000:2.0:1746129821.643633:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31613:x1830949054391552:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9671us (9830us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.643638:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15525 00000100:00100000:0.0:1746129821.646349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.646452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.646553:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054391936 00000100:00100000:3.0:1746129821.646560:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054391936 00010000:00010000:3.0:1746129821.646588:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 6 pid: 3623 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746129821.646607:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054392064 00000100:00100000:3.0:1746129821.646609:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054392064 00010000:00010000:3.0:1746129821.646618:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 29 pid: 7975 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746129821.646643:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7755 00000100:00100000:3.0:1746129821.646649:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054391936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.646661:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.646677:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 6 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.646687:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 6 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.646705:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b43e400/0x48868a4e43954f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355de5 expref: 6 pid: 3623 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.646722:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.646751:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1961:x1830949054391936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.646756:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7755 00000100:00100000:3.0:1746129821.646772:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7756 00000100:00100000:3.0:1746129821.646777:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054392064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.646783:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.646789:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 29 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.646797:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 29 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.646808:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e43954f87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e39 expref: 29 pid: 7975 timeout: 867 lvb_type: 1 00010000:00010000:3.0:1746129821.646816:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.646817:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.646823:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.646830:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.646891:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 28 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.646902:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054037632:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129821.646947:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b56cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.647261:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054391424:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12620us (13535us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.647268:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6958 00002000:00100000:3.0:1746129821.647276:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8792d80 x1830949054391424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.647283:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8792d80 with x1830949054391424 ext(3145728->4194303) 00002000:00010000:3.0:1746129821.647287:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8792d80 00000100:00100000:3.0:1746129821.649409:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054037632:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.649429:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.649570:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054392064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2791us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.649579:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7756 00000100:00100000:0.0:1746129821.650923:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.651047:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054392320 00000100:00100000:3.0:1746129821.651053:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054392320 00002000:00100000:3.0:1746129821.651090:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1245184->1249279) req@ffff8800a8793100 x1830949054392320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.651103:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793100 with x1830949054392320 ext(1245184->1249279) 00002000:00010000:3.0:1746129821.651125:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8793100 00000100:00100000:3.0:1746129821.651146:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6959 00000100:00100000:3.0:1746129821.651152:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054392320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129821.651820:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054392320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 667us (898us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129821.651826:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6959 00002000:00100000:3.0:1746129821.651832:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1245184->1249279) req@ffff8800a8793100 x1830949054392320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.651839:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8793100 with x1830949054392320 ext(1245184->1249279) 00002000:00010000:3.0:1746129821.651841:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8793100 00000100:00100000:0.0:1746129821.655060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.655094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.655127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.655186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.655194:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054392576 00000100:00100000:1.0:1746129821.655202:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054392576 00000100:00100000:3.0:1746129821.655210:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054393344 00000100:00100000:3.0:1746129821.655215:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054393344 00002000:00100000:1.0:1746129821.655236:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a8790a80 x1830949054392576/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129821.655249:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4620 00002000:00100000:1.0:1746129821.655250:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790a80 with x1830949054392576 ext(2097152->3145727) 00002000:00010000:1.0:1746129821.655253:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790a80 00000100:00100000:3.0:1746129821.655256:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:31613:x1830949054393344:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129821.655277:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054392832 00000100:00100000:1.0:1746129821.655279:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054392832 00002000:00100000:1.0:1746129821.655289:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8791880 x1830949054392832/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.655295:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8791880 with x1830949054392832 ext(3145728->4194303) 00002000:00010000:1.0:1746129821.655297:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8791880 00000100:00100000:1.0:1746129821.655306:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054393088 00000100:00100000:1.0:1746129821.655308:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054393088 00002000:00100000:1.0:1746129821.655318:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a8790380 x1830949054393088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.655323:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790380 with x1830949054393088 ext(3145728->4194303) 00002000:00010000:1.0:1746129821.655326:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8790380 00000100:00100000:1.0:1746129821.655335:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6960 00000100:00100000:1.0:1746129821.655340:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054392576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.655407:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6961 00000100:00100000:0.0:1746129821.655414:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054392832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129821.655418:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31613:x1830949054393344:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 162us (230us total) trans 8589945054 rc 0/0 00000100:00100000:3.0:1746129821.655424:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4620 00000100:00100000:3.0:1746129821.655457:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6962 00000100:00100000:3.0:1746129821.655463:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054393088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.655650:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.655662:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054393600 00000100:00100000:1.0:1746129821.655665:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054393600 00002000:00100000:1.0:1746129821.655679:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880092ad8000 x1830949054393600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.655685:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949054393600 ext(4194304->4931583) 00002000:00010000:1.0:1746129821.655688:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad8000 00000100:00100000:1.0:1746129821.655707:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6963 00000100:00100000:1.0:1746129821.655712:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054393600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129821.662772:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054393600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7048us (7110us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129821.662785:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6963 00002000:00100000:1.0:1746129821.662797:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880092ad8000 x1830949054393600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.662806:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949054393600 ext(4194304->4931583) 00002000:00010000:1.0:1746129821.662811:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad8000 00000100:00100000:1.0:1746129821.665626:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054392576:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10277us (10564us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129821.665637:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6960 00002000:00100000:1.0:1746129821.665647:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a8790a80 x1830949054392576/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.665656:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790a80 with x1830949054392576 ext(2097152->3145727) 00002000:00010000:1.0:1746129821.665660:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8790a80 00000100:00100000:3.0:1746129821.666188:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054392832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10771us (11090us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.666198:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6961 00002000:00100000:3.0:1746129821.666203:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a8791880 x1830949054392832/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.666210:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8791880 with x1830949054392832 ext(3145728->4194303) 00002000:00010000:3.0:1746129821.666213:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8791880 00000100:00100000:3.0:1746129821.670581:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054393088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15111us (15445us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129821.670591:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6962 00002000:00100000:3.0:1746129821.670601:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a8790380 x1830949054393088/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.670609:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8790380 with x1830949054393088 ext(3145728->4194303) 00002000:00010000:3.0:1746129821.670615:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8790380 00000100:00100000:0.0:1746129821.670863:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.670900:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054393856 00000100:00100000:2.0:1746129821.670907:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054393856 00000100:00100000:2.0:1746129821.670941:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4621 00000100:00100000:2.0:1746129821.670947:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31601:x1830949054393856:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129821.671124:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31601:x1830949054393856:12345-192.168.204.31@tcp:35:cat.0 Request processed in 176us (260us total) trans 8589945055 rc 0/0 00000100:00100000:2.0:1746129821.671130:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4621 00000100:00100000:0.0:1746129821.675593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.675639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.675694:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054394112 00000100:00100000:2.0:1746129821.675694:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054393984 00000100:00100000:3.0:1746129821.675700:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054394112 00000100:00100000:2.0:1746129821.675700:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054393984 00000100:00100000:2.0:1746129821.675738:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15527 00000100:00100000:2.0:1746129821.675743:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054393984:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129821.675744:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15528 00000100:00100000:3.0:1746129821.675750:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054394112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.675756:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.675756:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.675768:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98f800/0x48868a4e439553a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356085 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.675768:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b52c7e00/0x48868a4e4395539a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35607e expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.675804:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054037888:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.675804:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037760:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129821.675901:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.675931:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00002000:00010000:3.0:1746129821.677127:0:1140:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129820 -> 1746129822 00002000:00010000:3.0:1746129821.677131:0:1140:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129820 -> 1746129822 00002000:00010000:3.0:1746129821.677133:0:1140:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129820 -> 1746129822 00000100:00100000:3.0:1746129821.677148:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054037888:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129821.677168:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f98f800/0x48868a4e439553a1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356085 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.677177:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98f800/0x48868a4e439553a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356085 expref: 13 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.677189:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98f800, rc 0) 00000100:00100000:3.0:1746129821.677222:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054394112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1472us (1636us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.677228:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15528 00002000:00010000:2.0:1746129821.677381:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129821 -> 1746129822 00002000:00010000:2.0:1746129821.677384:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129821 -> 1746129822 00000100:00100000:2.0:1746129821.677394:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054037760:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.677407:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b52c7e00/0x48868a4e4395539a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35607e expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.677416:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c7e00/0x48868a4e4395539a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35607e expref: 11 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.677433:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52c7e00, rc 0) 00000100:00100000:2.0:1746129821.677451:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054393984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1708us (1811us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.677456:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15527 00000100:00100000:0.0:1746129821.682379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.682482:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054394368 00000100:00100000:3.0:1746129821.682491:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054394368 00002000:00100000:3.0:1746129821.682528:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880092ad9c00 x1830949054394368/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.682537:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9c00 with x1830949054394368 ext(4194304->4931583) 00002000:00010000:3.0:1746129821.682542:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9c00 00000100:00100000:3.0:1746129821.682559:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6964 00000100:00100000:3.0:1746129821.682565:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054394368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129821.689602:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054394368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7027us (7221us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129821.689613:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6964 00002000:00100000:3.0:1746129821.689622:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880092ad9c00 x1830949054394368/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.689637:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9c00 with x1830949054394368 ext(4194304->4931583) 00002000:00010000:3.0:1746129821.689642:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ad9c00 00000100:00100000:0.0:1746129821.695412:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.696177:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054394624 00000100:00100000:2.0:1746129821.696185:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054394624 00000100:00100000:2.0:1746129821.696237:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15529 00000100:00100000:2.0:1746129821.696244:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054394624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.696259:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.696273:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800920fda00/0x48868a4e439553a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356093 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.696317:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054038016:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.696395:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.696531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.696576:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054394496 00000100:00100000:2.0:1746129821.696579:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054394496 00000100:00100000:2.0:1746129821.696598:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15530 00000100:00100000:2.0:1746129821.696603:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054394496:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.696609:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.696615:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b52c7600/0x48868a4e439553af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35608c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.696638:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054038144:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.696658:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.698454:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054038144:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.698673:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054038016:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.698690:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800920fda00/0x48868a4e439553a8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356093 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.698701:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fda00/0x48868a4e439553a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356093 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.698714:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800920fda00, rc 0) 00000100:00100000:2.0:1746129821.698755:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054394624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2511us (3352us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.698761:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15529 00010000:00010000:3.0:1746129821.699007:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b52c7600/0x48868a4e439553af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35608c expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.699017:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b52c7600/0x48868a4e439553af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35608c expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.699035:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52c7600, rc 0) 00000100:00100000:3.0:1746129821.699068:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054394496:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2464us (2537us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.699074:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15530 00000100:00100000:0.0:1746129821.701226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.701261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.701289:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054394752 00000100:00100000:3.0:1746129821.701296:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054394752 00000100:00100000:2.0:1746129821.701308:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054394880 00000100:00100000:2.0:1746129821.701312:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054394880 00000100:00100000:3.0:1746129821.701334:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15531 00000100:00100000:3.0:1746129821.701340:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054394752:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.701352:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129821.701352:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15532 00000100:00100000:2.0:1746129821.701358:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054394880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.701364:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f98e200/0x48868a4e439553b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35609a expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.701365:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.701372:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fde9800/0x48868a4e439553bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560a1 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.701401:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054038272:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.701401:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054038400:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.701452:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.701459:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.702429:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054038400:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129821.702430:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054038272:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.702447:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fde9800/0x48868a4e439553bd lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a1 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.702448:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f98e200/0x48868a4e439553b6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35609a expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.702456:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fde9800/0x48868a4e439553bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a1 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.702457:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f98e200/0x48868a4e439553b6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35609a expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.702464:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98e200, rc 0) 00010000:00010000:2.0:1746129821.702475:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fde9800, rc 0) 00000100:00100000:3.0:1746129821.702541:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054394752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1200us (1319us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.702541:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054394880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1182us (1278us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.702546:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15532 00000100:00100000:3.0:1746129821.702549:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15531 00000100:00100000:0.0:1746129821.787718:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.788612:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054395136 00000100:00100000:1.0:1746129821.788620:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054395136 00000100:00100000:1.0:1746129821.788671:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11045 00000100:00100000:1.0:1746129821.788678:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31619:x1830949054395136:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129821.788697:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.788712:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1c00/0x48868a4e439553c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560a8 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.788787:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.788800:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.788806:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 28 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.788811:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129821.788836:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 28 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.788845:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 28 pid: 14315 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746129821.788869:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054038528:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129821.788949:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.788957:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 299 pid: 14315 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746129821.788964:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054038656:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129821.788980:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.794265:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054038528:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129821.794278:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054038656:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129821.794299:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129821.796209:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.796296:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.796385:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054395264 00000100:00100000:3.0:1746129821.796392:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054395264 00010000:00010000:3.0:1746129821.796425:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 29 pid: 14315 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.796449:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054395392 00000100:00100000:3.0:1746129821.796451:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054395392 00010000:00010000:3.0:1746129821.796458:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 300 pid: 14315 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.796480:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7757 00000100:00100000:3.0:1746129821.796486:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054395264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.796497:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.796501:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 29 pid: 14315 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.796511:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 29 pid: 14315 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.796529:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4ff2600/0x48868a4e4395508a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355eb0 expref: 29 pid: 14315 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.796546:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129821.796550:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.796556:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.796561:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.796594:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054395264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.796600:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7757 00000100:00100000:3.0:1746129821.796614:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7758 00000100:00100000:3.0:1746129821.796618:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:1961:x1830949054395392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.796625:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.796628:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 300 pid: 14315 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.796636:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 300 pid: 14315 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.796646:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f96f600/0x48868a4e43955052 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e9b expref: 300 pid: 14315 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.796653:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129821.796657:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.796662:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.796668:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.796681:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.796693:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:1961:x1830949054395392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.796698:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7758 00010000:00010000:3.0:1746129821.796779:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.796785:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129821.796799:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129821.796933:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1c00/0x48868a4e439553c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 29 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.796944:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 28 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.796951:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129821.796952:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129821.796954:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1e00, rc 0) 00000100:00100000:3.0:1746129821.796975:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31619:x1830949054395136:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8298us (9265us total) trans 8589945056 rc 0/0 00000100:00100000:3.0:1746129821.796984:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11045 00000100:00100000:0.0:1746129821.859242:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.859981:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054395520 00000100:00100000:3.0:1746129821.859990:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054395520 00000100:00100000:3.0:1746129821.860742:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15533 00000100:00100000:3.0:1746129821.860751:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31619:x1830949054395520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129821.860767:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.860783:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560af expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.860809:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.860817:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.860822:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.860824:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.860827:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1441792->2097151] (req 1441792->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.860907:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.860918:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746129821.860928:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054038784:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.861022:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.861028:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 14 pid: 20441 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.861034:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054038912:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.861049:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129821.870165:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054038784:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.870179:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054038912:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.870210:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1441792->2097151] (req 1441792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.870226:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98fa00, rc 0) 00000100:00100000:3.0:1746129821.870326:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31619:x1830949054395520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9575us (11091us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.870338:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15533 00000100:00100000:0.0:1746129821.870828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.870893:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.871031:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054395776 00000100:00100000:2.0:1746129821.871037:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054395776 00010000:00010000:2.0:1746129821.871059:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 15 pid: 20441 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.872254:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054395648 00000100:00100000:2.0:1746129821.872260:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054395648 00010000:00010000:2.0:1746129821.872277:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746129821.872391:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7759 00000100:00100000:1.0:1746129821.872400:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054395776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129821.872412:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129821.872430:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 15 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746129821.872439:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 15 pid: 20441 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746129821.872487:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7760 00000100:00100000:0.0:1746129821.872494:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054395648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129821.872501:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129821.872869:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746129821.872878:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746129821.872895:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091c69600/0x48868a4e43955331 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356038 expref: 18 pid: 8436 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746129821.872913:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.872949:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054395648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 456us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.872955:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7760 00010000:00010000:1.0:1746129821.874518:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f26400/0x48868a4e439552a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355fcf expref: 15 pid: 20441 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746129821.874539:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.874541:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.874546:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.874553:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.874581:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129821.874590:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054039040:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129821.874645:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.879173:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.881187:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054396032 00000100:00100000:3.0:1746129821.881198:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054396032 00000100:00100000:3.0:1746129821.881256:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11046 00000100:00100000:3.0:1746129821.881263:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31621:x1830949054396032:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129821.881279:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.881292:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439553e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560b6 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.881385:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881395:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881403:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881413:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881418:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881422:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881496:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881502:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881506:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129821.881513:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129821.881570:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881575:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881583:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881588:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98e600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129821.881590:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881595:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881603:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129821.881605:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129821.881608:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881611:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e600/0x48868a4e439553e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881638:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881642:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881646:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881649:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f98e800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129821.881651:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881655:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881663:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012bfcad00) 00010000:00010000:3.0:1746129821.881664:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129821.881666:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881669:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e800/0x48868a4e439553ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129821.881695:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98ea00/0x48868a4e439553e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 302 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.881702:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 301 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.881707:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129821.881708:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129821.881710:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f98e200, rc 0) 00000100:00100000:3.0:1746129821.881760:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:31621:x1830949054396032:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 497us (2595us total) trans 8589945057 rc 0/0 00000100:00100000:3.0:1746129821.881765:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11046 00000100:00100000:0.0:1746129821.884457:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.884615:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054039040:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129821.884629:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129821.884663:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054395776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 12265us (13835us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129821.884673:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7759 00000100:00100000:1.0:1746129821.884711:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054396288 00000100:00100000:1.0:1746129821.884717:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054396288 00002000:00100000:1.0:1746129821.885978:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1441792->1445887) req@ffff8800934d4380 x1830949054396288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.885989:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4380 with x1830949054396288 ext(1441792->1445887) 00002000:00010000:1.0:1746129821.885993:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4380 00000100:00100000:1.0:1746129821.886025:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6965 00000100:00100000:1.0:1746129821.886032:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054396288:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129821.886184:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054396288:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (1733us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129821.886190:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6965 00002000:00100000:1.0:1746129821.886195:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1441792->1445887) req@ffff8800934d4380 x1830949054396288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.886201:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4380 with x1830949054396288 ext(1441792->1445887) 00002000:00010000:1.0:1746129821.886204:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4380 00000100:00100000:0.0:1746129821.894270:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.894364:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054396416 00000100:00100000:3.0:1746129821.894372:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054396416 00000100:00100000:0.0:1746129821.896702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.897307:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15534 00000100:00100000:2.0:1746129821.897320:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31619:x1830949054396416:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129821.897338:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.897353:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560bd expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.897378:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.897385:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.897391:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.897392:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129821.897395:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.897420:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.897429:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.897438:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054039168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.897523:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 13 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.897531:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 13 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.897538:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054039296:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.897557:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.900805:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054396672 00000100:00100000:1.0:1746129821.900816:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054396672 00000100:00100000:2.0:1746129821.901013:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054039168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.901023:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054039296:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.901045:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->2105343] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 18 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.901058:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fde9600, rc 0) 00000100:00100000:2.0:1746129821.901088:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31619:x1830949054396416:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3773us (6826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.901095:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15534 00000100:00100000:1.0:1746129821.901279:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11047 00000100:00100000:1.0:1746129821.901287:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+301:31624:x1830949054396672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.901303:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.901315:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0400/0x48868a4e4395540a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560c4 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.901641:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901652:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901660:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901670:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901674:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901679:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901758:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1200/0x48868a4e4395541f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901764:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1200/0x48868a4e4395541f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901769:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1200/0x48868a4e4395541f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:1.0:1746129821.901775:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129821.901835:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901843:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901862:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901867:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54b1600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.901870:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901875:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901882:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129821.901885:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.901887:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901891:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1600/0x48868a4e43955411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901902:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901906:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901910:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901913:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54b0e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129821.901915:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901922:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901926:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b200) 00010000:00010000:1.0:1746129821.901928:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129821.901929:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901933:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955418 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129821.901973:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b0400/0x48868a4e4395540a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560c4 expref: 304 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.901982:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1200/0x48868a4e4395541f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560c4 expref: 303 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.901986:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129821.901988:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129821.901989:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1200, rc 0) 00000100:00100000:1.0:1746129821.902013:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:31624:x1830949054396672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 728us (5320us total) trans 8589945058 rc 0/0 00000100:00100000:1.0:1746129821.902018:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11047 00000100:00100000:0.0:1746129821.902992:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.903135:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054396800 00000100:00100000:2.0:1746129821.903141:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054396800 00010000:00010000:2.0:1746129821.903162:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746129821.903839:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7761 00000100:00100000:2.0:1746129821.903869:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054396800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129821.903880:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129821.903898:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.903908:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.903925:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a51c4000/0x48868a4e4395534d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35604d expref: 14 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746129821.903945:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129821.903976:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054396800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 130us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.903981:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7761 00000100:00100000:1.0:1746129821.904541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.905509:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054396928 00000100:00100000:3.0:1746129821.905515:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054396928 00010000:00010000:3.0:1746129821.905537:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746129821.905556:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7762 00000100:00100000:3.0:1746129821.905561:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054396928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.905570:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.905582:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.905592:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.905605:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43955377 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356062 expref: 18 pid: 7976 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746129821.905618:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.905620:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.905625:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.905631:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.905656:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.905667:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054039424:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129821.905727:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.905877:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.905905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.905940:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.905956:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054397184 00000100:00100000:2.0:1746129821.905959:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054397184 00000100:00100000:2.0:1746129821.905977:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054397312 00000100:00100000:2.0:1746129821.905979:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054397312 00000100:00100000:2.0:1746129821.905990:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15535 00000100:00100000:2.0:1746129821.905994:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054397184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.906004:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.906014:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fde9800/0x48868a4e4395542d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560cb expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.906037:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054039552:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.906038:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15536 00000100:00100000:1.0:1746129821.906046:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054397312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129821.906052:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.906059:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955434 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560d2 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.906063:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.906082:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054039680:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.906119:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.906208:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054397056 00000100:00100000:0.0:1746129821.906212:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054397056 00000100:00100000:0.0:1746129821.906235:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:0.0:1746129821.906239:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:1962:x1830949054397056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129821.906246:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129821.906258:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1200/0x48868a4e4395541f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560c4 expref: 303 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.906274:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129821.906277:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.906295:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:1962:x1830949054397056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.906300:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 732 00000100:00100000:0.0:1746129821.907617:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00010000:2.0:1746129821.907722:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129821 -> 1746129822 00002000:00010000:2.0:1746129821.907725:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129821 -> 1746129822 00000100:00100000:1.0:1746129821.907731:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054039680:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.907732:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054039552:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.907749:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fde9800/0x48868a4e4395542d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560cb expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.907749:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955434 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d2 expref: 16 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.907759:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fde9800/0x48868a4e4395542d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560cb expref: 16 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.907759:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955434 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d2 expref: 16 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.907767:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fde9800, rc 0) 00010000:00010000:1.0:1746129821.907767:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0a00, rc 0) 00000100:00100000:2.0:1746129821.908095:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054397184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2099us (2187us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129821.908110:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15535 00000100:00100000:1.0:1746129821.908129:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054397312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2084us (2188us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.908134:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15536 00000100:00100000:3.0:1746129821.908895:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054039424:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.908907:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.908927:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054396928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3366us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.908935:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7762 00000100:00100000:1.0:1746129821.908949:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054397568 00000100:00100000:1.0:1746129821.908954:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054397568 00002000:00100000:1.0:1746129821.908988:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2101248->2105343) req@ffff8800934d7800 x1830949054397568/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.908997:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949054397568 ext(2101248->2105343) 00002000:00010000:1.0:1746129821.909001:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000100:00100000:1.0:1746129821.909023:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6966 00000100:00100000:1.0:1746129821.909029:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054397568:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129821.909158:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054397568:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 129us (1543us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129821.909171:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6966 00002000:00100000:1.0:1746129821.909175:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2101248->2105343) req@ffff8800934d7800 x1830949054397568/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/4536 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.909182:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949054397568 ext(2101248->2105343) 00002000:00010000:1.0:1746129821.909184:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000100:00100000:0.0:1746129821.916414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.916458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.916595:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054397952 00000100:00100000:1.0:1746129821.916608:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054397952 00002000:00100000:1.0:1746129821.916646:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1249280->2097151) req@ffff8800934d4700 x1830949054397952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.916655:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949054397952 ext(1249280->2097151) 00002000:00010000:1.0:1746129821.916660:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4700 00000100:00100000:1.0:1746129821.916686:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054397824 00000100:00100000:1.0:1746129821.916688:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054397824 00002000:00100000:1.0:1746129821.916699:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1982463) req@ffff8800934d7b80 x1830949054397824/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.916705:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949054397824 ext(1048576->1982463) 00002000:00010000:1.0:1746129821.916709:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d7b80 00000100:00100000:0.0:1746129821.916713:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6967 00000100:00100000:0.0:1746129821.916721:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054397952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129821.917331:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6968 00000100:00100000:1.0:1746129821.917338:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054397824:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129821.929577:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.929827:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054398336 00000100:00100000:2.0:1746129821.929834:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054398336 00000100:00100000:1.0:1746129821.930548:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054397824:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13209us (14087us total) trans 0 rc 933888/933888 00000100:00100000:1.0:1746129821.930558:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6968 00002000:00100000:1.0:1746129821.930567:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1982463) req@ffff8800934d7b80 x1830949054397824/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 933888/933888 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.930581:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949054397824 ext(1048576->1982463) 00002000:00010000:1.0:1746129821.930586:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d7b80 00000100:00100000:2.0:1746129821.930623:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11048 00000100:00100000:2.0:1746129821.930631:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31628:x1830949054398336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.930649:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.930665:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858a00/0x48868a4e4395543b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560d9 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.930757:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.930769:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.930779:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.930794:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.930800:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.930804:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931038:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931046:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931052:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129821.931060:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129821.931132:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931138:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931143:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931147:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f858e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129821.931150:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931155:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931165:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129821.931167:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129821.931171:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931175:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931708:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931714:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931718:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931722:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f859400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129821.931724:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931728:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931735:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8e00) 00010000:00010000:2.0:1746129821.931737:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129821.931739:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931743:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e43955449 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129821.931772:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858a00/0x48868a4e4395543b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 31 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.931781:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 30 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.931787:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129821.931789:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129821.931792:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858800, rc 0) 00000100:00100000:2.0:1746129821.931871:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31628:x1830949054398336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1240us (2467us total) trans 8589945059 rc 0/0 00000100:00100000:2.0:1746129821.931876:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11048 00000100:00100000:2.0:1746129821.934193:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054397952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17467us (17780us total) trans 0 rc 847872/847872 00000100:00100000:2.0:1746129821.934202:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6967 00002000:00100000:2.0:1746129821.934212:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1249280->2097151) req@ffff8800934d4700 x1830949054397952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 847872/847872 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.934220:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949054397952 ext(1249280->2097151) 00002000:00010000:2.0:1746129821.934225:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4700 00000100:00100000:2.0:1746129821.936263:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.936321:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054398592 00000100:00100000:0.0:1746129821.936328:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054398592 00000100:00100000:0.0:1746129821.936373:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4622 00000100:00100000:0.0:1746129821.936381:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31628:x1830949054398592:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129821.936548:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31628:x1830949054398592:12345-192.168.204.31@tcp:35:cat.0 Request processed in 167us (290us total) trans 8589945060 rc 0/0 00000100:00100000:0.0:1746129821.936554:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4622 00000100:00100000:3.0:1746129821.939336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.939682:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.939748:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054398720 00000100:00100000:2.0:1746129821.939756:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054398720 00000100:00100000:2.0:1746129821.939802:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054398848 00000100:00100000:2.0:1746129821.939804:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054398848 00000100:00100000:2.0:1746129821.939880:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15537 00000100:00100000:2.0:1746129821.939887:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054398720:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129821.939887:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15538 00000100:00100000:1.0:1746129821.939894:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054398848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.939900:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.939901:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.939912:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858e00/0x48868a4e43955465 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560e0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.939913:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1400/0x48868a4e4395545e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560e7 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129821.939951:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054039808:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129821.939951:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054039936:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129821.940029:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.940039:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.942189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.942248:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054398976 00000100:00100000:2.0:1746129821.942254:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054398976 00000100:00100000:2.0:1746129821.942289:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15539 00000100:00100000:2.0:1746129821.942295:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31624:x1830949054398976:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129821.942304:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054039936:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.942305:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.942315:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560ee expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.942327:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1400/0x48868a4e4395545e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560e7 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129821.942329:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054039808:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129821.942335:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.942336:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b1400/0x48868a4e4395545e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560e7 expref: 13 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129821.942341:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f858e00/0x48868a4e43955465 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560e0 expref: 13 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.942342:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.942344:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.942347:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858e00/0x48868a4e43955465 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560e0 expref: 12 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129821.942347:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.942347:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1400, rc 0) 00010000:00010000:3.0:1746129821.942355:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858e00, rc 0) 00010000:00010000:2.0:1746129821.942366:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.942377:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 16 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129821.942377:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054398848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2483us (2696us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129821.942382:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15538 00000100:00100000:2.0:1746129821.942386:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054040064:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.942461:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054398720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2574us (3134us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129821.942465:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15537 00000100:00100000:2.0:1746129821.942919:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.944558:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.944793:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054040064:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129821.944811:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.944825:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859a00, rc 0) 00000100:00100000:2.0:1746129821.944879:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31624:x1830949054398976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2584us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129821.944886:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15539 00000100:00100000:3.0:1746129821.944961:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054399104 00000100:00100000:3.0:1746129821.944967:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054399104 00002000:00100000:3.0:1746129821.944997:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1441792->2097151) req@ffff8800934d5180 x1830949054399104/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.945006:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5180 with x1830949054399104 ext(1441792->2097151) 00010000:00010000:3.0:1746129821.945011:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 17 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129821.945021:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 17 pid: 20441 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129821.945031:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800934d5180 00000100:00100000:3.0:1746129821.945178:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1879 00000100:00100000:3.0:1746129821.945185:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054399104:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129821.946508:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.946642:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054399232 00000100:00100000:2.0:1746129821.946646:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054399232 00000100:00100000:2.0:1746129821.946674:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15540 00000100:00100000:2.0:1746129821.946679:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31628:x1830949054399232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.946688:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.946700:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560f5 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.946717:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.946723:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.946725:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.946727:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.946746:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.946758:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 25 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129821.946767:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054040192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.946814:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.951192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.951436:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054040192:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.951460:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.951486:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858600, rc 0) 00000100:00100000:1.0:1746129821.951503:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054399360 00000100:00100000:1.0:1746129821.951512:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054399360 00000100:00100000:3.0:1746129821.951533:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31628:x1830949054399232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4846us (5020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.951541:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15540 00002000:00100000:1.0:1746129821.951551:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1982464->2097151) req@ffff88009206df80 x1830949054399360/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.951561:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206df80 with x1830949054399360 ext(1982464->2097151) 00010000:00010000:1.0:1746129821.951568:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 26 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129821.951578:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 26 pid: 3623 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746129821.951584:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206df80 00000100:00100000:1.0:1746129821.951616:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1880 00000100:00100000:1.0:1746129821.951625:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054399360:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129821.954021:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054399104:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8830us (9460us total) trans 21474841326 rc 0/0 00000100:00100000:3.0:1746129821.954030:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1879 00002000:00100000:3.0:1746129821.954039:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1441792->2097151) req@ffff8800934d5180 x1830949054399104/t21474841326(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129821.954047:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5180 with x1830949054399104 ext(1441792->2097151) 00010000:00010000:3.0:1746129821.954055:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 19 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129821.954065:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 19 pid: 20441 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129821.954076:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800934d5180 00000100:00100000:1.0:1746129821.956520:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054399360:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4887us (5328us total) trans 17179874130 rc 0/0 00000100:00100000:1.0:1746129821.956531:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1880 00002000:00100000:1.0:1746129821.956542:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1982464->2097151) req@ffff88009206df80 x1830949054399360/t17179874130(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.956550:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206df80 with x1830949054399360 ext(1982464->2097151) 00010000:00010000:1.0:1746129821.956559:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 28 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129821.956570:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 28 pid: 3623 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746129821.956575:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009206df80 00000100:00100000:0.0:1746129821.958536:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.958844:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054399488 00000100:00100000:3.0:1746129821.958933:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054399488 00010000:00010000:3.0:1746129821.958960:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 19 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129821.958998:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7763 00000100:00100000:3.0:1746129821.959004:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054399488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129821.959016:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129821.959033:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 19 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129821.959043:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 19 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129821.959063:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f98fa00/0x48868a4e439553d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1441792->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560af expref: 19 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129821.959088:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.959090:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129821.959096:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.959112:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.959145:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129821.959156:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054040320:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129821.959747:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129821.960202:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129821.960244:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054399616 00000100:00100000:0.0:1746129821.960248:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054399616 00010000:00010000:0.0:1746129821.960263:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 28 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746129821.960294:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7764 00000100:00100000:0.0:1746129821.960298:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054399616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129821.960306:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129821.960317:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 28 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129821.960325:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 28 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129821.960338:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd600/0x48868a4e43955385 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1982464->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356069 expref: 28 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129821.960348:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.960350:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129821.960354:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.960360:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129821.960376:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129821.960383:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054040448:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129821.960461:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.967841:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054040448:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129821.967891:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129821.967939:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054399616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7637us (7737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129821.967949:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7764 00000100:00100000:3.0:1746129821.968384:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054040320:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129821.968401:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129821.968422:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054399488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9419us (9891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.968428:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7763 00000100:00100000:2.0:1746129821.970619:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.972275:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400000 00000100:00100000:1.0:1746129821.972285:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400000 00000100:00100000:3.0:1746129821.972840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129821.973012:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009206d880 x1830949054400000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.973023:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206d880 with x1830949054400000 ext(1048576->2097151) 00002000:00010000:1.0:1746129821.973029:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206d880 00000100:00100000:2.0:1746129821.973321:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400128 00000100:00100000:2.0:1746129821.973326:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400128 00002000:00100000:2.0:1746129821.973349:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009a04e300 x1830949054400128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.973357:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e300 with x1830949054400128 ext(1048576->2097151) 00002000:00010000:2.0:1746129821.973360:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04e300 00000100:00100000:2.0:1746129821.973390:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6969 00000100:00100000:2.0:1746129821.973398:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054400000:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129821.973539:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6970 00000100:00100000:1.0:1746129821.973545:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054400128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129821.987766:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054400000:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14359us (17144us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129821.987778:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6969 00002000:00100000:2.0:1746129821.987789:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009206d880 x1830949054400000/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.987797:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206d880 with x1830949054400000 ext(1048576->2097151) 00002000:00010000:2.0:1746129821.987802:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206d880 00000100:00100000:1.0:1746129821.988679:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1964:x1830949054400128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15131us (15839us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129821.988687:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6970 00002000:00100000:1.0:1746129821.988693:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009a04e300 x1830949054400128/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 488/440 e 0 to 0 dl 1746129832 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.988700:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04e300 with x1830949054400128 ext(1048576->2097151) 00002000:00010000:1.0:1746129821.988703:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04e300 00000100:00100000:0.0:1746129821.993994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129821.994067:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400256 00000100:00100000:3.0:1746129821.994076:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400256 00000100:00100000:3.0:1746129821.994131:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15541 00000100:00100000:3.0:1746129821.994138:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31624:x1830949054400256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129821.994153:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129821.994168:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3560fc expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.994192:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.994198:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.994200:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129821.994203:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.994228:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 17 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.994239:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 17 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129821.994249:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054040576:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129821.994320:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.995272:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129821.995310:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400384 00000100:00100000:2.0:1746129821.995315:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400384 00000100:00100000:2.0:1746129821.995336:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15542 00000100:00100000:2.0:1746129821.995342:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31628:x1830949054400384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129821.995350:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129821.995360:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356103 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.995377:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.995383:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.995384:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129821.995387:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.995403:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 26 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129821.995410:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 26 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129821.995418:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054040704:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129821.995457:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129821.996936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.997074:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400512 00000100:00100000:1.0:1746129821.997079:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400512 00000100:00100000:1.0:1746129821.997123:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15543 00000100:00100000:1.0:1746129821.997130:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31621:x1830949054400512:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129821.997139:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129821.997149:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35610a expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.997173:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.997184:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 17 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.997191:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.997196:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.997197:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129821.997200:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [978944->1048575] (req 978944->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129821.997219:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.997228:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 5 pid: 3623 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129821.997236:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054040832:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129821.997298:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 17 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129821.997298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129821.997305:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 17 pid: 7975 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129821.997313:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054040960:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129821.997339:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129821.997346:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 17 pid: 4589 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746129821.997348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129821.997353:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054041088:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129821.997368:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129821.997381:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400640 00000100:00100000:1.0:1746129821.997383:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400640 00000100:00100000:2.0:1746129821.997439:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400768 00000100:00100000:2.0:1746129821.997442:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400768 00002000:00100000:2.0:1746129821.997457:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1249279) req@ffff8800934d4a80 x1830949054400768/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129821.997472:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4a80 with x1830949054400768 ext(1048576->1249279) 00010000:00010000:2.0:1746129821.997479:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 27 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129821.997487:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 27 pid: 3623 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129821.997493:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d4a80 00000100:00100000:2.0:1746129821.997506:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1881 00000100:00100000:2.0:1746129821.997510:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054400768:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129821.997648:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054040576:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.997664:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.997674:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093360000, rc 0) 00000100:00100000:3.0:1746129821.997709:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31624:x1830949054400256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3571us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.997715:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15541 00002000:00100000:1.0:1746129821.998088:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2105343) req@ffff8800934d4e00 x1830949054400640/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 8680/0 e 0 to 0 dl 1746129832 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.998096:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4e00 with x1830949054400640 ext(2097152->2105343) 00010000:00010000:1.0:1746129821.998112:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 18 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129821.998120:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 18 pid: 3623 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746129821.998126:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800934d4e00 00000100:00100000:1.0:1746129821.998144:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1882 00000100:00100000:1.0:1746129821.998150:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054400640:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129821.998383:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054400640:12345-192.168.204.31@tcp:4:cat.0 Request processed in 232us (1084us total) trans 21474841327 rc 0/0 00000100:00100000:1.0:1746129821.998389:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1882 00002000:00100000:1.0:1746129821.998395:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2105343) req@ffff8800934d4e00 x1830949054400640/t21474841327(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:562/0 lens 8680/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129821.998402:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4e00 with x1830949054400640 ext(2097152->2105343) 00010000:00010000:1.0:1746129821.998406:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 20 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129821.998414:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 20 pid: 3623 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746129821.998420:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800934d4e00 00000100:00100000:3.0:1746129821.998719:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054040704:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129821.998733:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129821.998741:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae6800, rc 0) 00000100:00100000:3.0:1746129821.998768:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31628:x1830949054400384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3426us (3498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129821.998776:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15542 00000100:00100000:0.0:1746129821.999400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.000035:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054040832:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.000044:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054040960:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.000434:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054400896 00000100:00100000:3.0:1746129822.000439:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054400896 00010000:00010000:3.0:1746129822.000459:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 6 pid: 3623 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.000484:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7765 00000100:00100000:3.0:1746129822.000490:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054400896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.000499:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.000515:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 6 pid: 3623 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.000523:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 6 pid: 3623 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.000541:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b43f800/0x48868a4e43954f25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd7 expref: 6 pid: 3623 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.000567:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.000591:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054400896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.000596:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7765 00000100:00100000:3.0:1746129822.001381:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054041088:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129822.001777:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.001792:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054401024 00000100:00100000:0.0:1746129822.001795:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054401024 00010000:00010000:0.0:1746129822.001815:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 20 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746129822.001833:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7766 00000100:00100000:0.0:1746129822.001838:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054401024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129822.001861:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129822.001871:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 20 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.001879:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 20 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.001891:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fde9600/0x48868a4e43955403 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560bd expref: 20 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.001940:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [978944->1048575] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 16 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.001954:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0e00, rc 0) 00000100:00100000:3.0:1746129822.002140:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31621:x1830949054400512:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5010us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.002146:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15543 00000100:00100000:1.0:1746129822.002342:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.002394:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054401152 00000100:00100000:3.0:1746129822.002398:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054401152 00010000:00010000:3.0:1746129822.002409:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 20 pid: 4589 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.002424:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7767 00000100:00100000:3.0:1746129822.002428:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054401152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.002433:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.002441:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 20 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.002448:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 20 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.002459:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136379200/0x48868a4e43954f1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355dd0 expref: 20 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.002466:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.002782:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054401152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 352us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.002788:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7767 00000100:00100000:2.0:1746129822.002991:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054400768:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 5479us (5641us total) trans 17179874131 rc 0/0 00000100:00100000:2.0:1746129822.002999:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1881 00002000:00100000:2.0:1746129822.003007:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1249279) req@ffff8800934d4a80 x1830949054400768/t17179874131(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:562/0 lens 488/448 e 0 to 0 dl 1746129832 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.003014:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4a80 with x1830949054400768 ext(1048576->1249279) 00010000:00010000:2.0:1746129822.003021:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.003029:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.003038:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d4a80 00010000:00010000:0.0:1746129822.003044:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.003046:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.003053:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.003060:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.003069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129822.003085:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 15 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.003095:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054041216:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.003213:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054401280 00000100:00100000:3.0:1746129822.003217:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054401280 00010000:00010000:3.0:1746129822.003230:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 16 pid: 7975 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.003246:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7768 00000100:00100000:3.0:1746129822.003250:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054401280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.003256:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.003264:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 16 pid: 7975 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.003271:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 16 pid: 7975 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.003281:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bab9e00/0x48868a4e43954f79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e24 expref: 16 pid: 7975 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.003289:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.003290:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.003293:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.003299:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.003311:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 15 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.003322:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054041344:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.003354:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.004737:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00080000:0.0:1746129822.004751:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129822.005563:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054041344:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129822.005580:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.005605:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054401280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2353us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.005613:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7768 00000100:00100000:1.0:1746129822.005745:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054041216:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.005757:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.005789:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054401024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3950us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.005794:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7766 00000100:00100000:0.0:1746129822.007434:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.007501:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054401408 00000100:00100000:1.0:1746129822.007507:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054401408 00010000:00010000:1.0:1746129822.007570:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 868 lvb_type: 0 00000100:00080000:0.0:1746129822.007627:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129822.007710:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7769 00000100:00100000:1.0:1746129822.007718:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054401408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.007728:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.007746:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.007761:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.007780:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fde9a00/0x48868a4e4395538c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1249279) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356070 expref: 29 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.007795:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.007797:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.007803:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.007811:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.007840:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 11 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.007866:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054041472:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.007925:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.011264:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054041472:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.011283:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.011320:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054401408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3602us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.011329:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7769 00000100:00100000:0.0:1746129822.012129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.012162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.012185:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054401664 00000100:00100000:0.0:1746129822.012186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.012190:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054401664 00000100:00100000:0.0:1746129822.012206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:2.0:1746129822.012226:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009423f800 x1830949054401664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.012234:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f800 with x1830949054401664 ext(2097152->3145727) 00002000:00010000:2.0:1746129822.012238:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f800 00000100:00100000:2.0:1746129822.012262:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054401792 00000100:00100000:2.0:1746129822.012268:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054401792 00002000:00100000:2.0:1746129822.012280:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009423d180 x1830949054401792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.012286:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d180 with x1830949054401792 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.012289:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423d180 00000100:00100000:1.0:1746129822.012290:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054402176 00000100:00100000:1.0:1746129822.012293:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054402176 00000100:00100000:2.0:1746129822.012296:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054402432 00000100:00100000:2.0:1746129822.012298:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054402432 00002000:00100000:2.0:1746129822.012304:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (978944->983039) req@ffff88009423dc00 x1830949054402432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.012304:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009423f480 x1830949054402176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.012310:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423dc00 with x1830949054402432 ext(978944->983039) 00002000:00100000:1.0:1746129822.012311:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f480 with x1830949054402176 ext(2097152->3145727) 00002000:00010000:2.0:1746129822.012313:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423dc00 00002000:00010000:1.0:1746129822.012314:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423f480 00000100:00100000:2.0:1746129822.012321:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6971 00000100:00100000:1.0:1746129822.012324:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6972 00000100:00100000:2.0:1746129822.012326:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054401664:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.012328:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054401792:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.012339:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6973 00000100:00100000:1.0:1746129822.012342:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054402432:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.012448:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054402432:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 104us (241us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129822.012453:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6973 00002000:00100000:1.0:1746129822.012457:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (978944->983039) req@ffff88009423dc00 x1830949054402432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.012463:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423dc00 with x1830949054402432 ext(978944->983039) 00002000:00010000:1.0:1746129822.012465:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423dc00 00000100:00100000:1.0:1746129822.012475:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6974 00000100:00100000:1.0:1746129822.012478:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054402176:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129822.014174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.014195:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054402688 00000100:00100000:0.0:1746129822.014199:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054402688 00002000:00100000:0.0:1746129822.014228:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009423c380 x1830949054402688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129822.014235:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c380 with x1830949054402688 ext(1048576->2097151) 00002000:00010000:0.0:1746129822.014239:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423c380 00000100:00100000:0.0:1746129822.014251:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6975 00000100:00100000:0.0:1746129822.014256:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054402688:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129822.014886:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129822.022129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.023016:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054402816 00000100:00100000:3.0:1746129822.023025:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054402816 00000100:00100000:3.0:1746129822.023068:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15544 00000100:00100000:3.0:1746129822.023076:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31621:x1830949054402816:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.023091:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.023118:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356111 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.023146:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.023153:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.023154:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.023157:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->1720319] (req 1048576->1720319) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.023182:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.023200:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 13 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.023211:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054041600:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.023519:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.024225:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054401792:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11894us (12060us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129822.024233:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6972 00002000:00100000:0.0:1746129822.024241:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009423d180 x1830949054401792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129822.024250:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423d180 with x1830949054401792 ext(3145728->4194303) 00002000:00010000:0.0:1746129822.024253:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423d180 00000100:00100000:3.0:1746129822.027901:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054041600:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.027929:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->1720319] (req 1048576->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.027945:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00000, rc 0) 00000100:00100000:3.0:1746129822.028473:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31621:x1830949054402816:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5396us (6374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.028481:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15544 00000100:00100000:1.0:1746129822.029378:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054402176:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16895us (17187us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.029387:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6974 00002000:00100000:1.0:1746129822.029394:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009423f480 x1830949054402176/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.029407:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f480 with x1830949054402176 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.029411:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423f480 00000100:00100000:3.0:1746129822.031401:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054401664:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19068us (19267us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.031409:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6971 00002000:00100000:3.0:1746129822.031416:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009423f800 x1830949054401664/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.031424:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423f800 with x1830949054401664 ext(2097152->3145727) 00002000:00010000:3.0:1746129822.031428:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009423f800 00000100:00100000:0.0:1746129822.032600:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.032782:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054402944 00000100:00100000:1.0:1746129822.032788:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054402944 00010000:00010000:1.0:1746129822.032813:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 14 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.035269:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7770 00000100:00100000:1.0:1746129822.035286:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054402944:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.035302:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.035324:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 14 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.035336:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 14 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.035357:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e43955473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560f5 expref: 14 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.035376:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.035378:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.035383:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.035390:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.035435:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.035446:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009423f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054041728:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.036084:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054402688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21825us (21912us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.036091:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6975 00002000:00100000:1.0:1746129822.036098:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009423c380 x1830949054402688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.036115:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423c380 with x1830949054402688 ext(1048576->2097151) 00002000:00010000:1.0:1746129822.036119:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423c380 00000100:00100000:0.0:1746129822.039202:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.043155:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.045147:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009423f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054041728:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.045167:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.045221:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054402944:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9941us (12623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.045231:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7770 00000100:00100000:3.0:1746129822.045579:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054403072 00000100:00100000:3.0:1746129822.045586:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054403072 00000100:00100000:3.0:1746129822.045709:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15545 00000100:00100000:3.0:1746129822.045717:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054403072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.045731:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.045744:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356118 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.045762:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.045764:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.045770:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 30 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.045784:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 30 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.045793:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01600, rc 0) 00000100:00100000:0.0:1746129822.045914:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.045953:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054403328 00000100:00100000:1.0:1746129822.045957:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054403328 00000100:00100000:0.0:1746129822.045963:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:1.0:1746129822.045982:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1716224->1720319) req@ffff88009423ce00 x1830949054403328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.045991:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ce00 with x1830949054403328 ext(1716224->1720319) 00002000:00010000:1.0:1746129822.045995:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423ce00 00000100:00100000:1.0:1746129822.046007:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6976 00000100:00100000:1.0:1746129822.046012:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949054403328:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129822.046025:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054403456 00000100:00100000:3.0:1746129822.046028:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054403456 00000100:00100000:3.0:1746129822.046045:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15546 00000100:00100000:3.0:1746129822.046049:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31628:x1830949054403456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.046055:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.046063:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35611f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.046073:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.046074:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.046078:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.046087:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.046094:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00c00, rc 0) 00000100:00100000:3.0:1746129822.046123:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31628:x1830949054403456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 74us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.046127:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15546 00000100:00100000:3.0:1746129822.046146:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054403072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 431us (3000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.046149:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15545 00000100:00100000:1.0:1746129822.046317:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054403328:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 304us (404us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129822.046323:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6976 00002000:00100000:1.0:1746129822.046328:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1716224->1720319) req@ffff88009423ce00 x1830949054403328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.046335:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009423ce00 with x1830949054403328 ext(1716224->1720319) 00002000:00010000:1.0:1746129822.046338:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009423ce00 00000100:00100000:0.0:1746129822.050116:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.050175:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054403712 00000100:00100000:2.0:1746129822.050183:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054403712 00000100:00100000:2.0:1746129822.050233:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11049 00000100:00100000:2.0:1746129822.050241:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31630:x1830949054403712:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129822.050259:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.050274:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5ba00/0x48868a4e439554a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356126 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.050368:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050379:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050390:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050402:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050407:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050412:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050917:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c31800/0x48868a4e439554b9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050926:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129c31800/0x48868a4e439554b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.050932:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129c31800/0x48868a4e439554b9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129822.050987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.051014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.051027:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054403968 00000100:00100000:0.0:1746129822.051031:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054403968 00002000:00100000:0.0:1746129822.051053:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880091fa4700 x1830949054403968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129822.051074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000004:00200000:2.0:1746129822.051124:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129822.051197:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051203:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051209:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051214:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c5b400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.051217:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051222:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00002000:00100000:0.0:1746129822.051227:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4700 with x1830949054403968 ext(4194304->4931583) 00010000:00010000:2.0:1746129822.051231:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00002000:00010000:0.0:1746129822.051231:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa4700 00010000:00010000:2.0:1746129822.051234:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.051236:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051241:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5b400/0x48868a4e439554ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129822.051242:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054404480 00000100:00100000:0.0:1746129822.051245:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054404480 00010000:00010000:2.0:1746129822.051255:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00002000:00100000:0.0:1746129822.051257:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880091fa6300 x1830949054404480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129822.051263:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00002000:00100000:0.0:1746129822.051263:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6300 with x1830949054404480 ext(1048576->2097151) 00002000:00010000:0.0:1746129822.051266:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa6300 00010000:00010000:2.0:1746129822.051268:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051271:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b4c5bc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.051274:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129822.051275:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6977 00010000:00010000:2.0:1746129822.051278:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129822.051280:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054403968:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:2.0:1746129822.051283:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8a00) 00010000:00010000:2.0:1746129822.051285:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.051287:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051291:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5bc00/0x48868a4e439554b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.051319:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4c5ba00/0x48868a4e439554a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356126 expref: 34 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.051328:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129c31800/0x48868a4e439554b9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356126 expref: 33 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.051334:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.051335:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129822.051337:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129c31800, rc 0) 00000100:00100000:2.0:1746129822.051369:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:31630:x1830949054403712:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1130us (1260us total) trans 8589945061 rc 0/0 00000100:00100000:2.0:1746129822.051375:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11049 00000100:00100000:3.0:1746129822.051504:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054404224 00000100:00100000:3.0:1746129822.051507:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054404224 00000100:00100000:3.0:1746129822.051532:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4623 00000100:00100000:3.0:1746129822.051537:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+302:31621:x1830949054404224:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129822.051615:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:31621:x1830949054404224:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 78us (600us total) trans 8589945062 rc 0/0 00000100:00100000:3.0:1746129822.051620:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4623 00000100:00100000:1.0:1746129822.051843:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6978 00000100:00100000:1.0:1746129822.051864:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054404480:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:2.0:1746129822.052142:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129822.056875:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.056932:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.057034:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054404864 00000100:00100000:2.0:1746129822.057042:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054404864 00000100:00100000:2.0:1746129822.057088:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00100000:2.0:1746129822.057095:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1961:x1830949054404864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.057118:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.057138:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129c31800/0x48868a4e439554b9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356126 expref: 33 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.057152:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.057157:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.057193:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054404864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.057198:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 733 00000100:00100000:3.0:1746129822.057496:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054404736 00000100:00100000:3.0:1746129822.057500:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054404736 00000100:00100000:3.0:1746129822.057526:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4624 00000100:00100000:3.0:1746129822.057531:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:31630:x1830949054404736:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129822.057705:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d61850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:31630:x1830949054404736:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 173us (865us total) trans 8589945063 rc 0/0 00000100:00100000:3.0:1746129822.057710:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4624 00000100:00100000:2.0:1746129822.062815:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054403968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11527us (11820us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129822.062827:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6977 00002000:00100000:2.0:1746129822.062838:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880091fa4700 x1830949054403968/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.062860:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4700 with x1830949054403968 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.062866:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa4700 00000100:00100000:1.0:1746129822.068010:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054404480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16147us (16921us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.068025:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6978 00002000:00100000:1.0:1746129822.068039:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff880091fa6300 x1830949054404480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.068048:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6300 with x1830949054404480 ext(1048576->2097151) 00002000:00010000:1.0:1746129822.068054:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa6300 00000100:00100000:0.0:1746129822.075926:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.075973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.075984:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054404992 00000100:00100000:3.0:1746129822.075992:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054404992 00000100:00100000:3.0:1746129822.076038:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11050 00000100:00100000:3.0:1746129822.076045:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31632:x1830949054404992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.076068:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1746129822.076082:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129822.076083:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439554c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35612d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.076140:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076154:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076165:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076175:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076180:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076184:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076265:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076272:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 32 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.076513:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.076536:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 32 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.076546:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 32 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.076555:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054041856:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.076728:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054405248 00000100:00100000:1.0:1746129822.076732:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054405248 00000100:00100000:3.0:1746129822.076736:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.076754:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4625 00000100:00100000:1.0:1746129822.076758:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+303:31624:x1830949054405248:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129822.076895:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:31624:x1830949054405248:12345-192.168.204.31@tcp:35:cat.0 Request processed in 136us (922us total) trans 8589945064 rc 0/0 00000100:00100000:1.0:1746129822.076901:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4625 00000100:00100000:3.0:1746129822.078358:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054041856:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.078381:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129822.079133:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.079390:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054405376 00000100:00100000:2.0:1746129822.079398:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054405376 00010000:00010000:2.0:1746129822.079428:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 33 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.079473:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7771 00000100:00100000:2.0:1746129822.079483:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1964:x1830949054405376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.079499:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.079506:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 33 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.079516:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 33 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.079537:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a54b1e00/0x48868a4e439553cb lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560a8 expref: 33 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.080403:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.080410:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.080419:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.080425:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.080620:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.080696:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1964:x1830949054405376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1211us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.080703:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7771 00010000:00010000:3.0:1746129822.080793:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080801:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.080841:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129822.080873:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129822.080893:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080905:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080913:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080918:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080923:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080929:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa00e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.080933:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080938:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080948:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.080951:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.080954:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080958:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e439554ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080968:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080973:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080977:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080981:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.080983:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080987:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.080993:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244a00) 00010000:00010000:3.0:1746129822.080995:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.080998:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.081002:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01800/0x48868a4e439554d5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.081038:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00a00/0x48868a4e439554c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.081051:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.081057:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.081059:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129822.081061:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01c00, rc 0) 00000100:00100000:3.0:1746129822.081119:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31632:x1830949054404992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5072us (5198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.081125:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11050 00000100:00100000:0.0:1746129822.084990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.085464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.085497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.085509:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.085520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.086108:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054405504 00000100:00100000:3.0:1746129822.086116:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054405504 00000100:00100000:0.0:1746129822.086125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.086162:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054405760 00000100:00100000:3.0:1746129822.086165:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054405760 00000100:00100000:1.0:1746129822.086169:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054406016 00000100:00100000:1.0:1746129822.086172:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054406016 00000100:00100000:2.0:1746129822.086191:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054405632 00000100:00100000:2.0:1746129822.086194:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054405632 00000100:00080000:0.0:1746129822.086252:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129822.086278:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.086390:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054405888 00000100:00100000:3.0:1746129822.086392:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054405888 00000100:00100000:0.0:1746129822.086398:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054406144 00000100:00100000:0.0:1746129822.086401:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054406144 00000100:00100000:3.0:1746129822.086405:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054406272 00000100:00100000:3.0:1746129822.086407:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054406272 00000100:00100000:0.0:1746129822.086414:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15547 00000100:00100000:3.0:1746129822.086420:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15548 00000100:00100000:0.0:1746129822.086421:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054405504:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129822.086424:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054405760:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.086436:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.086436:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.086449:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356142 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.086449:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439554e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356134 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.086467:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.086469:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.086476:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.086487:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129822.086490:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054041984:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.086496:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67a00, rc 0) 00000100:00100000:3.0:1746129822.086528:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054405760:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 103us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.086533:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15548 00000100:00100000:3.0:1746129822.086550:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15549 00000100:00100000:3.0:1746129822.086555:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054406016:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.086560:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.086566:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356150 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.086574:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.086575:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.086578:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.086586:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.086596:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67c00, rc 0) 00000100:00100000:0.0:1746129822.088408:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.088433:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054406016:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1873us (2930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.088435:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15550 00000100:00100000:3.0:1746129822.088439:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15549 00000100:00100000:0.0:1746129822.088443:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054405632:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129822.088453:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15551 00010000:00010000:0.0:1746129822.088453:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129822.088458:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054405888:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.088463:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.088464:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e439554f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35613b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.088469:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356149 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.088477:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.088479:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.088483:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.088493:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129822.088494:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054042112:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.088499:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01a00, rc 0) 00000100:00100000:3.0:1746129822.088517:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054405888:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 59us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.088521:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15551 00000100:00100000:0.0:1746129822.088521:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.088532:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15552 00000100:00100000:3.0:1746129822.088536:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054406144:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.088544:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.088548:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356157 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.088557:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.088558:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.088561:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.088570:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.088577:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01000, rc 0) 00000100:00100000:3.0:1746129822.088589:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054406144:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 52us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.088593:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15552 00000100:00100000:3.0:1746129822.088602:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15553 00000100:00100000:3.0:1746129822.088606:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31628:x1830949054406272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.088611:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.088616:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35615e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.088626:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.088627:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.088631:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.088638:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.088645:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:3.0:1746129822.088663:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31628:x1830949054406272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 57us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.088667:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15553 00000100:00100000:1.0:1746129822.098432:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054042112:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.098463:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e439554f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35613b expref: 8 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.098480:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e439554f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35613b expref: 8 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.098493:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f400, rc 0) 00000100:00100000:1.0:1746129822.098531:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054405632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 10089us (13020us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.098538:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15550 00002000:00010000:2.0:1746129822.098623:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129820 -> 1746129822 00002000:00010000:2.0:1746129822.098627:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129820 -> 1746129822 00002000:00010000:2.0:1746129822.098628:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129820 -> 1746129822 00000100:00100000:2.0:1746129822.098640:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054041984:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129822.098653:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439554e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356134 expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.098661:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439554e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356134 expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.098685:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ee00, rc 0) 00000100:00100000:2.0:1746129822.098704:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009423d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054405504:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 12284us (13722us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.098709:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15547 00000100:00100000:0.0:1746129822.101698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.101765:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054406528 00000100:00100000:1.0:1746129822.101772:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054406528 00002000:00100000:1.0:1746129822.101807:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880131460000 x1830949054406528/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.101816:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460000 with x1830949054406528 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.101820:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460000 00000100:00100000:1.0:1746129822.101900:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6979 00000100:00100000:1.0:1746129822.101907:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054406528:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129822.102621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.102665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.102735:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054406784 00000100:00100000:2.0:1746129822.102742:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054406784 00002000:00100000:2.0:1746129822.102765:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880131461c00 x1830949054406784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.102773:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461c00 with x1830949054406784 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.102777:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131461c00 00000100:00100000:2.0:1746129822.102795:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6980 00000100:00100000:2.0:1746129822.102803:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054406784:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.105231:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407040 00000100:00100000:3.0:1746129822.105242:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407040 00000100:00100000:3.0:1746129822.105291:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11051 00000100:00100000:3.0:1746129822.105299:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31632:x1830949054407040:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.105316:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.105333:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e43955514 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356165 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.105428:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.105442:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.105448:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.105482:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.105493:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 10 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.105510:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054042240:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.105577:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.113502:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054042240:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.113531:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129822.117390:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054406784:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14577us (14713us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.117402:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6980 00002000:00100000:2.0:1746129822.117415:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880131461c00 x1830949054406784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.117424:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131461c00 with x1830949054406784 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.117429:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131461c00 00000100:00100000:1.0:1746129822.118536:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.118607:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407168 00000100:00100000:2.0:1746129822.118614:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407168 00010000:00010000:2.0:1746129822.118639:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.118660:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7772 00000100:00100000:2.0:1746129822.118665:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054407168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.118674:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.118679:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.118688:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.118705:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439554dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35612d expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.119076:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.119081:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.119089:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.119094:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.119292:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.119459:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054407168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 792us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.119465:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7772 00010000:00010000:3.0:1746129822.119641:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.119648:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.119663:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.119774:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e43955514 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.119796:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.119802:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.119803:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129822.119805:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f200, rc 0) 00000100:00100000:3.0:1746129822.119828:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31632:x1830949054407040:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 14531us (17209us total) trans 8589945065 rc 0/0 00000100:00100000:3.0:1746129822.119833:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11051 00000100:00100000:1.0:1746129822.120360:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054406528:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18453us (18668us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.120367:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6979 00002000:00100000:1.0:1746129822.120374:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880131460000 x1830949054406528/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.120382:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131460000 with x1830949054406528 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.120385:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131460000 00000100:00100000:0.0:1746129822.121823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.121984:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407296 00000100:00100000:3.0:1746129822.121991:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407296 00000100:00100000:3.0:1746129822.122152:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11052 00000100:00100000:3.0:1746129822.122159:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31632:x1830949054407296:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.122177:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.122190:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955529 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35616c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.122250:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.122261:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.122267:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.122292:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.122302:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.122311:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054042368:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.123083:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.127564:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.127611:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.127746:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407424 00000100:00100000:1.0:1746129822.127755:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407424 00000100:00100000:1.0:1746129822.127787:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407552 00000100:00100000:1.0:1746129822.127789:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407552 00000100:00100000:1.0:1746129822.127803:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15554 00000100:00100000:1.0:1746129822.127809:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054407424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.127822:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.127835:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e43955537 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356173 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.127895:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054042496:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129822.127961:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.128249:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15555 00000100:00100000:2.0:1746129822.128257:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054407552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.128264:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.128273:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0a00/0x48868a4e4395553e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35617a expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.128296:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054042624:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129822.128317:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.129012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.129079:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054042368:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.129108:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129822.129239:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407680 00000100:00100000:2.0:1746129822.129243:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407680 00010000:00010000:2.0:1746129822.129260:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 12 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.129284:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7773 00000100:00100000:2.0:1746129822.129290:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054407680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.129298:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.129303:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 12 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.129312:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 12 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.129332:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f200/0x48868a4e4395551b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356165 expref: 12 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.129358:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.129361:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.129369:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.129375:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.129386:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.129407:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054407680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 118us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.129413:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7773 00010000:00010000:3.0:1746129822.129629:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.129638:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.129671:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129822.129675:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129822.129686:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.129710:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955529 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.129720:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.129725:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.129728:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129822.129729:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fc00, rc 0) 00000100:00100000:3.0:1746129822.129751:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31632:x1830949054407296:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7594us (7934us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.129757:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11052 00000100:00100000:1.0:1746129822.133013:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054042496:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.133039:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e43955537 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356173 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129822.133052:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054042624:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.133052:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3800/0x48868a4e43955537 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356173 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.133068:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0a00/0x48868a4e4395553e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35617a expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.133077:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0a00/0x48868a4e4395553e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35617a expref: 12 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.133077:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3800, rc 0) 00010000:00010000:2.0:1746129822.133084:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0a00, rc 0) 00000100:00100000:1.0:1746129822.133121:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054407424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5311us (5564us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.133123:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054407552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4866us (5510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.133128:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15554 00000100:00100000:2.0:1746129822.133132:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15555 00000100:00100000:0.0:1746129822.133731:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.133782:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.134093:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407936 00000100:00100000:1.0:1746129822.134093:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054407808 00000100:00100000:3.0:1746129822.134106:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407936 00000100:00100000:1.0:1746129822.134107:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054407808 00000100:00100000:3.0:1746129822.134213:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15556 00000100:00100000:1.0:1746129822.134234:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15557 00000100:00100000:1.0:1746129822.134241:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054407808:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129822.134255:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.134266:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e43955545 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356181 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.134305:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054042752:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.134310:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054407936:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.134317:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.134326:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e4395554c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356188 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.134350:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054042880:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129822.134405:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.134515:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.136709:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054042752:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.136735:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e43955545 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356181 expref: 8 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.136748:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e43955545 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356181 expref: 8 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.136757:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3c00, rc 0) 00000100:00100000:1.0:1746129822.136800:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054407808:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2558us (3015us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.136806:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15557 00000100:00100000:3.0:1746129822.139318:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054042880:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.139346:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e4395554c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356188 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.139357:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86000/0x48868a4e4395554c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356188 expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.139384:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86000, rc 0) 00000100:00100000:3.0:1746129822.139433:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054407936:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5212us (5701us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.139439:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15556 00000100:00100000:0.0:1746129822.139786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.139938:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054408192 00000100:00100000:1.0:1746129822.139944:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054408192 00002000:00100000:1.0:1746129822.139975:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880131462680 x1830949054408192/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.139983:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462680 with x1830949054408192 ext(4194304->4931583) 00002000:00010000:1.0:1746129822.139992:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131462680 00000100:00100000:1.0:1746129822.140007:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6981 00000100:00100000:1.0:1746129822.140016:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054408192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.146627:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.147377:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054408192:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7362us (7590us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129822.147386:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6981 00002000:00100000:1.0:1746129822.147396:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880131462680 x1830949054408192/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.147404:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131462680 with x1830949054408192 ext(4194304->4931583) 00002000:00010000:1.0:1746129822.147408:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131462680 00000100:00100000:0.0:1746129822.147657:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054408448 00000100:00100000:0.0:1746129822.147664:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054408448 00000100:00100000:0.0:1746129822.147823:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11053 00000100:00100000:0.0:1746129822.147830:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31632:x1830949054408448:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129822.147881:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.147939:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955553 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35618f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.148166:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148192:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148201:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148211:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148216:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148222:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148249:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1f400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129822.148252:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148258:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148267:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129822.148269:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746129822.148272:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148287:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1f400/0x48868a4e4395555a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.148323:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955553 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35618f expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.148330:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955553 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35618f expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.148335:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:0.0:1746129822.148371:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31632:x1830949054408448:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 542us (1751us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129822.148377:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11053 00000100:00100000:0.0:1746129822.154676:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.154713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.154756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.154764:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054408832 00000100:00100000:3.0:1746129822.154771:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054408832 00000100:00100000:3.0:1746129822.154809:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054408960 00000100:00100000:3.0:1746129822.154811:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054408960 00000100:00100000:3.0:1746129822.154843:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15558 00000100:00100000:3.0:1746129822.154875:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054408832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.154891:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.154905:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e43955561 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356196 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.154948:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15559 00000100:00100000:3.0:1746129822.154949:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054043008:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.154954:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054408960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129822.154961:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.154969:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fe00/0x48868a4e43955568 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35619d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.154990:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054043136:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.155024:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.155025:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.155570:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054408704 00000100:00100000:1.0:1746129822.155574:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054408704 00000100:00100000:1.0:1746129822.155602:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4626 00000100:00100000:1.0:1746129822.155608:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31632:x1830949054408704:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129822.155769:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31632:x1830949054408704:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 160us (1099us total) trans 8589945066 rc 0/0 00000100:00100000:1.0:1746129822.155775:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4626 00000100:00100000:0.0:1746129822.155789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.156275:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054043008:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.156296:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e43955561 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356196 expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.156306:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87c00/0x48868a4e43955561 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356196 expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.156317:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87c00, rc 0) 00000100:00100000:3.0:1746129822.156344:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054408832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1471us (1631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.156350:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15558 00000100:00100000:3.0:1746129822.156364:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409088 00000100:00100000:3.0:1746129822.156367:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409088 00000100:00100000:3.0:1746129822.156380:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15560 00000100:00100000:3.0:1746129822.156385:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31630:x1830949054409088:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.156391:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.156399:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561a4 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.156415:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.156421:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.156423:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.156426:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1912832->2097151] (req 1912832->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.156449:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 29 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.156460:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 29 pid: 7976 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.156469:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054043264:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.156498:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.156698:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054043136:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.156712:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fe00/0x48868a4e43955568 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35619d expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.156720:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fe00/0x48868a4e43955568 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35619d expref: 14 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.156727:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:1.0:1746129822.156745:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054408960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1791us (1989us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.156753:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15559 00000100:00100000:0.0:1746129822.163154:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.163279:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054043264:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.163310:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1912832->2097151] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.163327:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86200, rc 0) 00000100:00100000:3.0:1746129822.163366:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31630:x1830949054409088:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6980us (7576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.163374:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15560 00000100:00100000:1.0:1746129822.163693:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409216 00000100:00100000:1.0:1746129822.163700:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409216 00002000:00100000:1.0:1746129822.163731:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1720319) req@ffff88008fad2d80 x1830949054409216/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.163739:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2d80 with x1830949054409216 ext(1048576->1720319) 00010000:00010000:1.0:1746129822.163745:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 30 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.163755:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 30 pid: 7976 timeout: 868 lvb_type: 0 00002000:00010000:1.0:1746129822.163760:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad2d80 00000100:00100000:1.0:1746129822.163783:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1883 00000100:00100000:1.0:1746129822.163788:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054409216:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129822.164779:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.164822:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409344 00000100:00100000:3.0:1746129822.164826:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409344 00000100:00100000:0.0:1746129822.164837:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.164870:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409472 00000100:00100000:3.0:1746129822.164873:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409472 00000100:00100000:3.0:1746129822.164892:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15561 00000100:00100000:3.0:1746129822.164897:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054409344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.164907:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.164919:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa86c00/0x48868a4e43955576 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561ab expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.164953:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054043392:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.165002:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.165054:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15562 00000100:00100000:2.0:1746129822.165061:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054409472:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.165068:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.165077:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0c00/0x48868a4e4395557d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561b2 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.165108:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054043520:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129822.165129:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.168456:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054043520:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129822.168484:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0c00/0x48868a4e4395557d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b2 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.168496:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0c00/0x48868a4e4395557d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b2 expref: 13 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.168510:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0c00, rc 0) 00000100:00100000:2.0:1746129822.168559:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054409472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3496us (3719us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.168566:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15562 00000100:00100000:3.0:1746129822.168727:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054043392:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.168745:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa86c00/0x48868a4e43955576 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ab expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.168754:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa86c00/0x48868a4e43955576 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ab expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.168765:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86c00, rc 0) 00000100:00100000:3.0:1746129822.168784:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054409344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3886us (4007us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.168789:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15561 00000100:00100000:0.0:1746129822.174199:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054409216:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10400us (11042us total) trans 17179874132 rc 0/0 00000100:00100000:0.0:1746129822.174210:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1883 00002000:00100000:0.0:1746129822.174220:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1720319) req@ffff88008fad2d80 x1830949054409216/t17179874132(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129822.174228:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2d80 with x1830949054409216 ext(1048576->1720319) 00010000:00010000:0.0:1746129822.174236:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 32 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.174250:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 32 pid: 7976 timeout: 868 lvb_type: 0 00002000:00010000:0.0:1746129822.174256:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad2d80 00000100:00100000:0.0:1746129822.176305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.176479:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409600 00000100:00100000:2.0:1746129822.176486:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409600 00010000:00010000:2.0:1746129822.176514:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 32 pid: 7976 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.176554:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7774 00000100:00100000:2.0:1746129822.176561:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054409600:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.176572:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.176587:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 32 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.176597:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 32 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.176615:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00000/0x48868a4e4395548f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1720319) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356111 expref: 32 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.176641:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.176643:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.176649:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.176656:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.176684:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.176695:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054043648:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.176754:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.180658:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054043648:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.180678:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.180718:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054409600:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4156us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.180728:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7774 00000100:00100000:0.0:1746129822.181175:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.181400:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409856 00000100:00100000:2.0:1746129822.181405:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409856 00002000:00100000:2.0:1746129822.181437:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1912832->1916927) req@ffff88008fad3800 x1830949054409856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.181445:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949054409856 ext(1912832->1916927) 00002000:00010000:2.0:1746129822.181450:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad3800 00000100:00100000:2.0:1746129822.181464:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6982 00000100:00100000:2.0:1746129822.181469:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054409856:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.183381:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054409856:12345-192.168.204.31@tcp:3:cat.0 Request processed in 1905us (2201us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129822.183390:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6982 00002000:00100000:2.0:1746129822.183397:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1912832->1916927) req@ffff88008fad3800 x1830949054409856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.183406:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3800 with x1830949054409856 ext(1912832->1916927) 00002000:00010000:2.0:1746129822.183410:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad3800 00000100:00100000:0.0:1746129822.188589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.188649:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054409984 00000100:00100000:3.0:1746129822.188657:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054409984 00000100:00100000:3.0:1746129822.188707:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15563 00000100:00100000:3.0:1746129822.188714:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31630:x1830949054409984:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.188730:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.188743:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561b9 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.188767:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.188776:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.188782:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 30 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.188788:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.188789:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.188792:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.188817:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 30 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.188826:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 30 pid: 7976 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.188836:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054043776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.188951:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.188959:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.188966:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054043904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.188992:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.189004:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.189011:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054044032:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.189027:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.193668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.193730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.193801:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054410112 00000100:00100000:1.0:1746129822.193809:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054410112 00010000:00010000:1.0:1746129822.193835:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 31 pid: 7976 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.193879:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054410240 00000100:00100000:1.0:1746129822.193882:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054410240 00010000:00010000:1.0:1746129822.193892:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.193906:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7775 00000100:00100000:1.0:1746129822.193913:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054410112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.193924:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.193943:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 31 pid: 7976 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.193953:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 31 pid: 7976 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.193975:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.194010:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8e0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054410112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.194016:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7775 00000100:00100000:1.0:1746129822.194081:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7776 00000100:00100000:1.0:1746129822.194086:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054410240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.194092:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.194111:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.194118:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.194128:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.194142:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054410240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 56us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.194147:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7776 00010000:00010000:3.0:1746129822.195382:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01600/0x48868a4e43955496 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356118 expref: 30 pid: 7976 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.195410:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054043776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.195421:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e439554ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356142 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.195428:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054043904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.195437:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054044032:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.195463:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.195473:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87c00, rc 0) 00000100:00100000:3.0:1746129822.195512:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31630:x1830949054409984:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6798us (6930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.195519:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15563 00000100:00100000:2.0:1746129822.199842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.200054:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054410368 00000100:00100000:0.0:1746129822.200062:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054410368 00010000:00010000:0.0:1746129822.200092:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746129822.200141:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7777 00000100:00100000:0.0:1746129822.200149:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054410368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129822.200162:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129822.200181:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.200191:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.200210:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955481 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356103 expref: 13 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.200239:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.200241:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.200247:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.200254:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.200282:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.200293:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054044160:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129822.200361:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.204732:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054044160:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129822.204750:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129822.204797:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054410368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4647us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.204806:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7777 00000100:00100000:0.0:1746129822.206458:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.206622:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054410624 00000100:00100000:3.0:1746129822.206629:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054410624 00000100:00100000:3.0:1746129822.206666:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11054 00000100:00100000:3.0:1746129822.206672:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+304:31638:x1830949054410624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.206689:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.206702:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e4395558b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561c0 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.206787:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.206797:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.206806:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.206817:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.206822:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.206827:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207213:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207222:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207228:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129822.207236:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.207301:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207307:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207313:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207318:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa86400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.207321:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207327:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207337:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.207339:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.207342:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207347:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86400/0x48868a4e43955592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207372:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207376:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207380:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207385:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa86000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.207387:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207392:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207398:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244800) 00010000:00010000:3.0:1746129822.207400:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.207402:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207406:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86000/0x48868a4e43955599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.207436:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135b66e00/0x48868a4e4395558b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 307 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.207445:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 306 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.207451:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.207452:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129822.207455:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86800, rc 0) 00000100:00100000:3.0:1746129822.208463:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+306:31638:x1830949054410624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1787us (2007us total) trans 8589945067 rc 0/0 00000100:00100000:3.0:1746129822.208471:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11054 00010000:00010000:2.0:1746129822.211367:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129822.211818:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.211912:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054410880 00000100:00100000:2.0:1746129822.211920:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054410880 00002000:00100000:2.0:1746129822.211955:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1556480->1560575) req@ffff88008fad2680 x1830949054410880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.211970:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2680 with x1830949054410880 ext(1556480->1560575) 00002000:00010000:2.0:1746129822.211975:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2680 00000100:00100000:2.0:1746129822.212004:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6983 00000100:00100000:2.0:1746129822.212010:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054410880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.212173:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054410880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 162us (358us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129822.212180:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6983 00002000:00100000:2.0:1746129822.212185:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1556480->1560575) req@ffff88008fad2680 x1830949054410880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.212192:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad2680 with x1830949054410880 ext(1556480->1560575) 00002000:00010000:2.0:1746129822.212194:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad2680 00000100:00100000:0.0:1746129822.214892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.214945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.215029:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054411008 00000100:00100000:2.0:1746129822.215036:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054411008 00000100:00100000:2.0:1746129822.215074:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054411136 00000100:00100000:2.0:1746129822.215076:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054411136 00000100:00100000:2.0:1746129822.215089:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15564 00000100:00100000:2.0:1746129822.215106:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054411008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.215119:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.215133:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555ae lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561c7 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.215178:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054044288:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.215291:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15565 00000100:00100000:3.0:1746129822.215299:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054411136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.215305:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.215312:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa87200/0x48868a4e439555b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561ce expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.215339:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054044416:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129822.215824:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.215968:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.216257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.216690:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054411392 00000100:00100000:3.0:1746129822.216695:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054411392 00000100:00100000:3.0:1746129822.216723:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4627 00000100:00100000:3.0:1746129822.216728:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:31630:x1830949054411392:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129822.216878:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:31630:x1830949054411392:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 150us (622us total) trans 8589945068 rc 0/0 00000100:00100000:3.0:1746129822.216883:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4627 00000100:00100000:2.0:1746129822.217590:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054044288:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.217604:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054044416:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129822.217613:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555ae lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c7 expref: 33 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.217620:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa87200/0x48868a4e439555b5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ce expref: 33 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.217624:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555ae lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c7 expref: 33 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.217628:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87200/0x48868a4e439555b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ce expref: 33 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.217635:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87200, rc 0) 00010000:00010000:2.0:1746129822.217646:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0600, rc 0) 00000100:00100000:3.0:1746129822.217655:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054411136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2358us (2715us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.217661:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15565 00000100:00100000:2.0:1746129822.217664:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054411008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2569us (2778us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.217670:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15564 00000100:00100000:0.0:1746129822.221446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.221767:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054411648 00000100:00100000:2.0:1746129822.221775:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054411648 00002000:00100000:2.0:1746129822.221811:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->978943) req@ffff8800a5493480 x1830949054411648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.221820:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493480 with x1830949054411648 ext(0->978943) 00002000:00010000:2.0:1746129822.221825:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493480 00000100:00100000:2.0:1746129822.221878:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6984 00000100:00100000:2.0:1746129822.221886:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054411648:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.234202:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054411648:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12308us (12754us total) trans 0 rc 978944/978944 00000100:00100000:2.0:1746129822.234212:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6984 00002000:00100000:2.0:1746129822.234222:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->978943) req@ffff8800a5493480 x1830949054411648/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.234231:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493480 with x1830949054411648 ext(0->978943) 00002000:00010000:2.0:1746129822.234236:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493480 00000100:00100000:0.0:1746129822.238771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.239218:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054411776 00000100:00100000:2.0:1746129822.239225:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054411776 00000100:00100000:2.0:1746129822.239267:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15566 00000100:00100000:2.0:1746129822.239272:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31638:x1830949054411776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.239286:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.239298:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561d5 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.239320:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.239325:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129822.239326:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129822.239329:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.239348:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 11 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.239355:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 11 pid: 1140 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.239363:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054044544:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.239428:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.240483:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054044544:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129822.240501:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.240514:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0e00, rc 0) 00000100:00100000:2.0:1746129822.240547:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31638:x1830949054411776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1274us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.240554:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15566 00000100:00100000:0.0:1746129822.240884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.241250:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054411904 00000100:00100000:3.0:1746129822.241255:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054411904 00002000:00100000:3.0:1746129822.241283:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1912832->2097151) req@ffff8800a5491180 x1830949054411904/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.241297:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949054411904 ext(1912832->2097151) 00010000:00010000:3.0:1746129822.241302:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 12 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.241311:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 12 pid: 1140 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.241317:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491180 00000100:00100000:3.0:1746129822.241339:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1884 00000100:00100000:3.0:1746129822.241344:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054411904:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.245613:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054411904:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4262us (4723us total) trans 17179874133 rc 0/0 00000100:00100000:3.0:1746129822.245623:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1884 00002000:00100000:3.0:1746129822.245631:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1912832->2097151) req@ffff8800a5491180 x1830949054411904/t17179874133(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.245639:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491180 with x1830949054411904 ext(1912832->2097151) 00010000:00010000:3.0:1746129822.245750:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.245764:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.245770:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491180 00000100:00100000:0.0:1746129822.248480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.248565:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054412032 00000100:00100000:2.0:1746129822.248572:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054412032 00010000:00010000:2.0:1746129822.248599:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.248621:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7778 00000100:00100000:2.0:1746129822.248626:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054412032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.248638:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.248653:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.248664:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.248684:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86200/0x48868a4e4395556f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561a4 expref: 14 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.249042:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.249044:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.249051:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.249061:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.249140:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.249150:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054044672:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.249510:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.256407:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054044672:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.256427:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.256465:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054412032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7837us (7989us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.256474:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7778 00000100:00100000:0.0:1746129822.257217:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.259267:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054412288 00000100:00100000:3.0:1746129822.259278:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054412288 00002000:00100000:3.0:1746129822.259319:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a5490000 x1830949054412288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.259329:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490000 with x1830949054412288 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.259334:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490000 00000100:00100000:3.0:1746129822.259371:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6985 00000100:00100000:3.0:1746129822.259378:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054412288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.268063:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054412288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8677us (10839us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.268076:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6985 00002000:00100000:3.0:1746129822.268085:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a5490000 x1830949054412288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.268107:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490000 with x1830949054412288 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.268112:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490000 00000100:00100000:0.0:1746129822.271954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.272386:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054412416 00000100:00100000:2.0:1746129822.272394:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054412416 00000100:00100000:2.0:1746129822.272445:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15567 00000100:00100000:2.0:1746129822.272452:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31638:x1830949054412416:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.272467:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.272487:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561dc expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.272511:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.272517:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129822.272519:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129822.272522:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.272545:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 12 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.272554:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 12 pid: 1140 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.272563:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054044800:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.272627:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.274576:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054044800:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129822.274576:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129822.274598:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 32 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.274613:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0600, rc 0) 00000100:00100000:2.0:1746129822.274652:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31638:x1830949054412416:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2201us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.274722:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15567 00000100:00100000:3.0:1746129822.274955:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054412544 00000100:00100000:3.0:1746129822.274960:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054412544 00002000:00100000:3.0:1746129822.274988:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1560575) req@ffff8800a5491c00 x1830949054412544/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.274996:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491c00 with x1830949054412544 ext(1048576->1560575) 00010000:00010000:3.0:1746129822.275002:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 13 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.275013:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 13 pid: 1140 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.275023:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491c00 00000100:00100000:3.0:1746129822.275212:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1885 00000100:00100000:3.0:1746129822.275219:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054412544:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.283995:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054412544:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8769us (9411us total) trans 17179874134 rc 0/0 00000100:00100000:3.0:1746129822.284007:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1885 00002000:00100000:3.0:1746129822.284015:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1560575) req@ffff8800a5491c00 x1830949054412544/t17179874134(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.284023:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491c00 with x1830949054412544 ext(1048576->1560575) 00010000:00010000:3.0:1746129822.284030:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 15 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.284043:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 15 pid: 1140 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.284049:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5491c00 00000100:00100000:0.0:1746129822.285211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.285551:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054412800 00000100:00100000:3.0:1746129822.285557:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054412800 00000100:00100000:1.0:1746129822.286512:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.288752:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11055 00000100:00100000:3.0:1746129822.288767:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+306:31641:x1830949054412800:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.288788:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.288804:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e439555ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561e3 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.288896:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054412928 00010000:00010000:3.0:1746129822.288901:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129822.288903:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054412928 00010000:00010000:3.0:1746129822.288913:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.288919:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 307 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.288923:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 15 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.288925:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.288949:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 307 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.288955:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7779 00010000:00010000:3.0:1746129822.288957:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 307 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.288959:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054412928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.288967:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129822.288969:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054044928:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129822.288981:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 15 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.289055:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.289063:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 10 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.289070:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054045056:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.289086:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129e84a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129822.289223:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 15 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.289239:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa87c00/0x48868a4e43955584 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561b9 expref: 15 pid: 1140 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.289263:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.289265:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.289271:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.289277:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.289294:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.289303:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054045184:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.289321:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.291770:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054044928:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.291781:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054045056:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.291801:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129822.292314:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054045184:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.292328:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.292369:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054412928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3408us (5858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.292378:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7779 00000100:00100000:0.0:1746129822.292796:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.292819:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.292835:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.292868:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.292956:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054413056 00000100:00100000:3.0:1746129822.292961:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054413056 00010000:00010000:3.0:1746129822.292980:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 308 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.292994:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054413184 00000100:00100000:3.0:1746129822.293000:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054413184 00000100:00100000:2.0:1746129822.293034:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7780 00000100:00100000:2.0:1746129822.293040:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+308:1962:x1830949054413056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.293053:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.293058:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 308 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.293066:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 308 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.293118:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054413440 00000100:00100000:1.0:1746129822.293121:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054413440 00000100:00100000:1.0:1746129822.293142:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11056 00000100:00100000:1.0:1746129822.293146:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:31644:x1830949054413440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.293160:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.293168:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08dc00/0x48868a4e439555d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561ea expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.293239:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.293249:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.293256:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.293266:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.293270:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.293274:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.293357:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c000/0x48868a4e439555ed lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.293379:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.293394:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7781 00000100:00100000:3.0:1746129822.293399:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054413184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.293406:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.293409:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.293431:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86800/0x48868a4e439555a0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561c0 expref: 308 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.294169:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c000/0x48868a4e439555ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294178:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c000/0x48868a4e439555ed lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:1.0:1746129822.294187:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129822.294254:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294260:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294265:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294270:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d08cc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129822.294273:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294278:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294284:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129822.294286:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129822.294289:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294293:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08cc00/0x48868a4e439555df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294315:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294320:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294324:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294331:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d08d400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129822.294333:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294337:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294342:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f99b200) 00010000:00010000:1.0:1746129822.294344:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129822.294346:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294350:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08d400/0x48868a4e439555e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.294377:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08dc00/0x48868a4e439555d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ea expref: 36 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.294386:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c000/0x48868a4e439555ed lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ea expref: 35 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.294391:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129822.294393:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129822.294395:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c000, rc 0) 00000100:00100000:1.0:1746129822.294427:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:31644:x1830949054413440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1280us (1631us total) trans 8589945069 rc 0/0 00000100:00100000:1.0:1746129822.294432:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11056 00010000:00010000:3.0:1746129822.294692:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.294701:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.294706:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.294716:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.294721:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129822.294728:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955530 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35616c expref: 11 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.294742:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.294745:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.294752:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.294756:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.294771:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129822.294783:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.294788:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129822.294798:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.294868:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055e00/0x48868a4e439555ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 309 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.294877:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 308 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.294882:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.294884:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129822.294885:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e055800, rc 0) 00000100:00100000:3.0:1746129822.294942:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+308:31641:x1830949054412800:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6181us (9733us total) trans 8589945070 rc 0/0 00000100:00100000:2.0:1746129822.294942:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+308:1962:x1830949054413056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1900us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.294946:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11055 00000100:00100000:2.0:1746129822.294947:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7780 00000100:00100000:3.0:1746129822.294967:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054413184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1568us (2131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.294975:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7781 00000100:00100000:3.0:1746129822.294988:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054413696 00000100:00100000:3.0:1746129822.294992:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054413696 00002000:00100000:3.0:1746129822.295012:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a5493b80 x1830949054413696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.295020:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949054413696 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.295023:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:3.0:1746129822.295033:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6986 00000100:00100000:3.0:1746129822.295037:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054413696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129822.298824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.298889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.299006:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054413952 00000100:00100000:3.0:1746129822.299013:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054413952 00000100:00100000:3.0:1746129822.299049:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4628 00000100:00100000:3.0:1746129822.299056:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:31644:x1830949054413952:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129822.299235:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:31644:x1830949054413952:12345-192.168.204.31@tcp:35:cat.0 Request processed in 179us (419us total) trans 8589945071 rc 0/0 00000100:00100000:3.0:1746129822.299241:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4628 00000100:00100000:3.0:1746129822.299261:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414080 00000100:00100000:3.0:1746129822.299264:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414080 00000100:00100000:3.0:1746129822.299288:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 734 00000100:00100000:3.0:1746129822.299292:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1aea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1963:x1830949054414080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.299299:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.299459:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d08c000/0x48868a4e439555ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ea expref: 36 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.299477:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.299480:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.299509:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1aea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1963:x1830949054414080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 216us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.299515:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 734 00000100:00100000:3.0:1746129822.302679:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054413696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7634us (9802us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.302688:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6986 00002000:00100000:3.0:1746129822.302696:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a5493b80 x1830949054413696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.302704:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493b80 with x1830949054413696 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.302708:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5493b80 00000100:00100000:0.0:1746129822.304739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.305639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.305664:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414208 00000100:00100000:2.0:1746129822.305671:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414208 00000100:00100000:2.0:1746129822.305716:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15568 00000100:00100000:2.0:1746129822.305723:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054414208:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.305736:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.305749:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a060e00/0x48868a4e43955602 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561f1 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.306579:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414336 00000100:00100000:1.0:1746129822.306580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.306583:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414336 00000100:00100000:3.0:1746129822.306602:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414464 00000100:00100000:3.0:1746129822.306604:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414464 00000100:00100000:1.0:1746129822.306613:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15569 00000100:00100000:3.0:1746129822.306618:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15570 00000100:00100000:1.0:1746129822.306619:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054414336:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129822.306623:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054414464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.306626:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.306629:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.306635:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561f8 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.306637:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3561ff expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.306647:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.306648:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.306649:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.306649:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.306655:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.306655:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.306668:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 17 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.306668:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.306676:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4e7f200, rc 0) 00010000:00010000:1.0:1746129822.306676:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c000, rc 0) 00000100:00100000:3.0:1746129822.306719:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054414464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.306725:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15570 00000100:00100000:2.0:1746129822.306736:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054045312:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129822.306779:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054414336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 161us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.306784:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15569 00000100:00100000:2.0:1746129822.307008:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.309543:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054045312:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129822.309570:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a060e00/0x48868a4e43955602 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f1 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.309581:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a060e00/0x48868a4e43955602 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f1 expref: 21 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.309769:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060e00, rc 0) 00000100:00100000:2.0:1746129822.309825:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054414208:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4102us (5090us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.309832:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15568 00000100:00100000:0.0:1746129822.313675:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.314570:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414592 00000100:00100000:2.0:1746129822.314577:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414592 00000100:00100000:2.0:1746129822.314617:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15571 00000100:00100000:2.0:1746129822.314626:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31644:x1830949054414592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.314642:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.314657:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356206 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.314685:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.314694:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129822.314695:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129822.314698:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.314726:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 14 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.314738:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 14 pid: 7976 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.314748:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054045440:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.314828:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.318616:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054045440:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129822.318642:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.318717:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060000, rc 0) 00000100:00100000:2.0:1746129822.318762:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31644:x1830949054414592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4137us (5094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.318769:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15571 00000100:00100000:0.0:1746129822.320537:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.320576:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.320594:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414848 00000100:00100000:0.0:1746129822.320598:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414848 00000100:00100000:3.0:1746129822.320601:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414720 00000100:00100000:3.0:1746129822.320605:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414720 00000100:00100000:0.0:1746129822.320625:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15572 00000100:00100000:0.0:1746129822.320631:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949054414848:12345-192.168.204.31@tcp:101:cat.0 00002000:00100000:3.0:1746129822.320637:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (978944->1048575) req@ffff8800a5493800 x1830949054414720/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746129822.320642:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:3.0:1746129822.320652:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493800 with x1830949054414720 ext(978944->1048575) 00010000:00010000:0.0:1746129822.320654:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c0ff000/0x48868a4e4395561e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35620d expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.320658:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 16 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.320671:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.320682:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5493800 00000100:00100000:0.0:1746129822.320689:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054045568:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.320696:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1886 00000100:00100000:3.0:1746129822.320701:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054414720:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129822.320736:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.323260:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054045568:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129822.323285:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c0ff000/0x48868a4e4395561e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35620d expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.323295:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c0ff000/0x48868a4e4395561e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35620d expref: 18 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.323306:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0ff000, rc 0) 00000100:00100000:0.0:1746129822.323333:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054414848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2702us (2755us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129822.323339:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15572 00000100:00100000:3.0:1746129822.323910:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054414720:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3207us (3375us total) trans 21474841328 rc 0/0 00000100:00100000:3.0:1746129822.323917:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1886 00002000:00100000:3.0:1746129822.323925:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (978944->1048575) req@ffff8800a5493800 x1830949054414720/t21474841328(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.323934:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493800 with x1830949054414720 ext(978944->1048575) 00010000:00010000:3.0:1746129822.323940:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.323951:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.323957:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a5493800 00000100:00100000:0.0:1746129822.330518:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.332270:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054414976 00000100:00100000:2.0:1746129822.332279:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054414976 00000100:00100000:2.0:1746129822.332562:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15573 00000100:00100000:2.0:1746129822.332570:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054414976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.332585:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.332599:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a061000/0x48868a4e43955625 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356214 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.332643:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054045696:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129822.333184:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.336073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.336141:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054415104 00000100:00100000:3.0:1746129822.336147:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054415104 00010000:00010000:3.0:1746129822.336177:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 19 pid: 7976 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.336199:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7782 00000100:00100000:2.0:1746129822.336200:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054045696:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.336205:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054415104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.336216:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.336225:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a061000/0x48868a4e43955625 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356214 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.336226:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 19 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.336235:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a061000/0x48868a4e43955625 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356214 expref: 19 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.336236:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 19 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.336253:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e43955488 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35610a expref: 18 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.336370:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a061000, rc 0) 00010000:00010000:3.0:1746129822.336374:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.336376:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.336383:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 20 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.336390:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 20 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.336415:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 20 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.336425:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054045824:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.336832:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054414976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4261us (6319us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.336838:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15573 00000100:00100000:3.0:1746129822.336844:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.341019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.341045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.341155:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054415232 00000100:00100000:0.0:1746129822.341163:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054415232 00000100:00100000:3.0:1746129822.341191:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054045824:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129822.341211:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.341246:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054415104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5040us (5178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.341254:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7782 00000100:00100000:1.0:1746129822.341314:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054415360 00000100:00100000:1.0:1746129822.341318:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054415360 00000100:00100000:1.0:1746129822.341334:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15574 00000100:00100000:1.0:1746129822.341339:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31641:x1830949054415232:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.341351:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.341363:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35621b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341386:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341395:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.341401:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341407:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.341408:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.341412:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341436:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341445:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 20 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.341456:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054045952:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.341499:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.341506:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.341513:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046080:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.341538:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341557:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.341565:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046208:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.341583:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.341599:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15575 00000100:00100000:1.0:1746129822.341605:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054415360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.341611:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.341617:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356222 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.341627:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.341629:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.341634:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.341646:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 19 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.341654:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08dc00, rc 0) 00000100:00100000:1.0:1746129822.341670:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054415360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 65us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.341675:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15575 00000100:00100000:0.0:1746129822.347265:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.347301:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.347322:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054415488 00000100:00100000:0.0:1746129822.347328:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054415488 00010000:00010000:0.0:1746129822.347356:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746129822.347383:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054415616 00000100:00100000:0.0:1746129822.347385:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054415616 00000100:00100000:1.0:1746129822.347393:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054045952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129822.347393:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 21 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.347404:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046080:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129822.347408:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7783 00000100:00100000:1.0:1746129822.347412:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046208:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129822.347415:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054415488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129822.347426:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.347435:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [1765376->2097151] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.347444:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.347448:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d08c200, rc 0) 00010000:00010000:0.0:1746129822.347452:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.347498:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31641:x1830949054415232:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6158us (6488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.347505:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15574 00000100:00100000:3.0:1746129822.347508:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7784 00000100:00100000:3.0:1746129822.347521:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054415616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.347529:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129822.347549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.347566:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054415744 00000100:00100000:1.0:1746129822.347568:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054415744 00010000:00010000:1.0:1746129822.347579:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.347590:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7785 00000100:00100000:1.0:1746129822.347593:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1964:x1830949054415744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.347598:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.347612:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 21 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.347627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129822.347629:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 21 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.347646:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00c00/0x48868a4e4395549d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35611f expref: 21 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.347669:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.347687:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054415616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 169us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.347692:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7784 00010000:00010000:0.0:1746129822.347761:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e439554ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356149 expref: 7 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.347763:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.347772:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.347784:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f859a00/0x48868a4e4395546c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560ee expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746129822.347784:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.347786:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.347792:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.347799:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.347806:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.347825:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054415744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 230us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.347830:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7785 00000100:00100000:1.0:1746129822.347874:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054416000 00000100:00100000:1.0:1746129822.347878:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054416000 00000100:00100000:1.0:1746129822.347897:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4629 00000100:00100000:1.0:1746129822.347901:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+307:31638:x1830949054416000:12345-192.168.204.31@tcp:35:cat.0 00010000:00010000:0.0:1746129822.347959:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.347970:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054046336:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.348068:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+308:31638:x1830949054416000:12345-192.168.204.31@tcp:35:cat.0 Request processed in 166us (440us total) trans 8589945072 rc 0/0 00000100:00100000:1.0:1746129822.348074:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4629 00000100:00100000:0.0:1746129822.348077:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.350152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.350241:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01bb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054046336:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129822.350259:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129822.350295:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054415488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2879us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.350303:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7783 00000100:00100000:3.0:1746129822.350700:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054416256 00000100:00100000:3.0:1746129822.350705:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054416256 00002000:00100000:3.0:1746129822.350734:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1765376->1769471) req@ffff88009bb2d180 x1830949054416256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.350743:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d180 with x1830949054416256 ext(1765376->1769471) 00002000:00010000:3.0:1746129822.350746:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d180 00000100:00100000:3.0:1746129822.350759:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6987 00000100:00100000:3.0:1746129822.350765:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054416256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.350895:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054416256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 130us (747us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129822.350900:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6987 00002000:00100000:3.0:1746129822.350905:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1765376->1769471) req@ffff88009bb2d180 x1830949054416256/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.350912:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb2d180 with x1830949054416256 ext(1765376->1769471) 00002000:00010000:3.0:1746129822.350915:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb2d180 00000100:00100000:0.0:1746129822.353494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.353524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.353551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.353610:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054416640 00000100:00100000:3.0:1746129822.353615:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054416640 00002000:00100000:3.0:1746129822.353641:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a01bb480 x1830949054416640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.353649:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb480 with x1830949054416640 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.353653:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01bb480 00000100:00100000:3.0:1746129822.353663:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417024 00000100:00100000:3.0:1746129822.353665:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417024 00002000:00100000:3.0:1746129822.353672:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a01ba680 x1830949054417024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.353677:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01ba680 with x1830949054417024 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.353680:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01ba680 00000100:00100000:3.0:1746129822.353685:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054416896 00000100:00100000:3.0:1746129822.353687:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054416896 00002000:00100000:3.0:1746129822.353694:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a01b8a80 x1830949054416896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129822.353694:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6988 00002000:00100000:3.0:1746129822.353699:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8a80 with x1830949054416896 ext(0->1048575) 00002000:00010000:3.0:1746129822.353701:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01b8a80 00000100:00100000:1.0:1746129822.353706:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054416640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.353713:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6989 00000100:00100000:3.0:1746129822.353717:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054417024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.354681:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6990 00000100:00100000:3.0:1746129822.354689:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054416896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.358066:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.358147:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417152 00000100:00100000:1.0:1746129822.358155:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417152 00000100:00100000:1.0:1746129822.358193:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15576 00000100:00100000:1.0:1746129822.358200:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31641:x1830949054417152:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.358215:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.358230:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356229 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.358255:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.358267:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.358274:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 5 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.358280:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.358281:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.358284:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.358309:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 5 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.358320:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 5 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.358330:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046464:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.358394:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.358402:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 21 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.358409:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.358432:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.358439:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.358445:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046720:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.358460:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.365273:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054416640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11563us (11775us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.365284:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6988 00002000:00100000:1.0:1746129822.365294:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a01bb480 x1830949054416640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.365303:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb480 with x1830949054416640 ext(1048576->2097151) 00002000:00010000:1.0:1746129822.365308:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01bb480 00000100:00100000:3.0:1746129822.369571:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054417024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15844us (16037us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.369584:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6989 00002000:00100000:3.0:1746129822.369592:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a01ba680 x1830949054417024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.369601:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01ba680 with x1830949054417024 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.369605:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01ba680 00000100:00100000:0.0:1746129822.370726:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.370748:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.370781:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417280 00000100:00100000:2.0:1746129822.370787:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417280 00010000:00010000:2.0:1746129822.370809:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746129822.370830:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417408 00000100:00100000:2.0:1746129822.370832:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417408 00010000:00010000:2.0:1746129822.370840:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 22 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.370871:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7786 00000100:00100000:2.0:1746129822.370876:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054417280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129822.370877:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7787 00010000:00010000:2.0:1746129822.370886:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129822.370889:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054417408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.370896:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.370901:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.370906:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 22 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.370909:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.370917:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 22 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.370963:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.370982:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054417280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.370987:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7786 00010000:00010000:1.0:1746129822.371126:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.371157:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054417408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 274us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.371163:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7787 00010000:00010000:1.0:1746129822.371200:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b67c00/0x48868a4e439554f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356150 expref: 5 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.371215:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046464:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.371225:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395550d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35615e expref: 21 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.371232:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046592:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.371239:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046720:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.371258:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.371268:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e4ce00, rc 0) 00000100:00100000:1.0:1746129822.371284:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31641:x1830949054417152:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13086us (13228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.371290:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15576 00000100:00100000:3.0:1746129822.371383:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054416896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16695us (17830us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.371390:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6990 00002000:00100000:3.0:1746129822.371395:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a01b8a80 x1830949054416896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.371402:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8a80 with x1830949054416896 ext(0->1048575) 00002000:00010000:3.0:1746129822.371406:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01b8a80 00000100:00100000:0.0:1746129822.372811:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.372881:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417536 00000100:00100000:1.0:1746129822.372886:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417536 00010000:00010000:1.0:1746129822.372905:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.372937:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7788 00000100:00100000:1.0:1746129822.372943:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054417536:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.372953:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.372964:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.372973:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.372988:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093360000/0x48868a4e4395547a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560fc expref: 18 pid: 20441 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.372998:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.372999:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.373005:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.373012:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.373037:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.373048:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054046848:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.373118:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.376258:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054046848:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.376277:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.376312:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054417536:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3368us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.376321:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7788 00000100:00100000:0.0:1746129822.378140:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.378202:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417792 00000100:00100000:3.0:1746129822.378208:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417792 00002000:00100000:3.0:1746129822.378247:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2269184->2273279) req@ffff8800a01bb100 x1830949054417792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.378257:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb100 with x1830949054417792 ext(2269184->2273279) 00002000:00010000:3.0:1746129822.378261:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bb100 00000100:00100000:3.0:1746129822.378291:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6991 00000100:00100000:3.0:1746129822.378298:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054417792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.378449:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054417792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 151us (314us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129822.378455:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6991 00002000:00100000:3.0:1746129822.378461:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2269184->2273279) req@ffff8800a01bb100 x1830949054417792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.378468:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb100 with x1830949054417792 ext(2269184->2273279) 00002000:00010000:3.0:1746129822.378471:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bb100 00000100:00100000:0.0:1746129822.384968:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.385049:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054417920 00000100:00100000:1.0:1746129822.385057:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054417920 00000100:00100000:1.0:1746129822.385115:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15577 00000100:00100000:1.0:1746129822.385122:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31644:x1830949054417920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.385137:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.385150:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356230 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.385170:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.385176:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.385177:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.385180:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.385202:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.385210:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 16 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.385220:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046976:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.385283:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.388074:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054046976:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.388113:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.388132:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04c00, rc 0) 00000100:00100000:1.0:1746129822.388173:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31644:x1830949054417920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3051us (3212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.388181:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15577 00000100:00100000:0.0:1746129822.390019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.390146:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054418048 00000100:00100000:3.0:1746129822.390153:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054418048 00002000:00100000:3.0:1746129822.390189:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1765376->2097151) req@ffff8800a01b9c00 x1830949054418048/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.390197:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9c00 with x1830949054418048 ext(1765376->2097151) 00010000:00010000:3.0:1746129822.390215:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 17 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.390226:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 17 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.390232:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b9c00 00000100:00100000:3.0:1746129822.390247:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1887 00000100:00100000:3.0:1746129822.390254:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054418048:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.394153:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054418048:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3892us (4132us total) trans 21474841329 rc 0/0 00000100:00100000:3.0:1746129822.394163:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1887 00002000:00100000:3.0:1746129822.394173:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1765376->2097151) req@ffff8800a01b9c00 x1830949054418048/t21474841329(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.394182:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9c00 with x1830949054418048 ext(1765376->2097151) 00010000:00010000:3.0:1746129822.394191:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 19 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.394204:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 19 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.394210:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b9c00 00000100:00100000:0.0:1746129822.396233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.396535:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054418176 00000100:00100000:1.0:1746129822.396542:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054418176 00010000:00010000:1.0:1746129822.396568:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 19 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.397462:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7789 00000100:00100000:1.0:1746129822.397470:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054418176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.397482:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129822.397496:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129822 -> 1746129823 00002000:00010000:1.0:1746129822.397499:0:16449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129822 -> 1746129823 00010000:00010000:1.0:1746129822.397503:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 19 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.397514:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 19 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.397533:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08c200/0x48868a4e4395562c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1765376->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35621b expref: 19 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.397553:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.397555:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.397560:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.397567:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.397592:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.397602:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054047104:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.397679:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.401576:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054047104:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.401598:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.401651:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1963:x1830949054418176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4181us (5422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.401661:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7789 00000100:00100000:0.0:1746129822.402635:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.402714:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054418432 00000100:00100000:3.0:1746129822.402720:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054418432 00002000:00100000:3.0:1746129822.402751:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a01b8700 x1830949054418432/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.402761:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8700 with x1830949054418432 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.402765:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01b8700 00000100:00100000:3.0:1746129822.402781:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6992 00000100:00100000:3.0:1746129822.402787:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054418432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.409886:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054418432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7090us (7244us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.409897:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6992 00002000:00100000:3.0:1746129822.409908:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a01b8700 x1830949054418432/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.409917:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8700 with x1830949054418432 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.409922:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01b8700 00000100:00100000:0.0:1746129822.415132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.415192:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054418560 00000100:00100000:1.0:1746129822.415205:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054418560 00000100:00100000:1.0:1746129822.415739:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15578 00000100:00100000:1.0:1746129822.415748:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31644:x1830949054418560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.415762:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.415776:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356237 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.415804:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.415810:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.415811:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.415814:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.415840:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.415884:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 17 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.415895:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054047232:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.415965:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.417193:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054047232:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.417210:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.417221:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05c00, rc 0) 00000100:00100000:1.0:1746129822.417251:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31644:x1830949054418560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1505us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.417257:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15578 00000100:00100000:0.0:1746129822.418032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.418082:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054418688 00000100:00100000:3.0:1746129822.418087:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054418688 00002000:00100000:3.0:1746129822.418127:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2273279) req@ffff8800a01b9500 x1830949054418688/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.418137:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9500 with x1830949054418688 ext(2097152->2273279) 00010000:00010000:3.0:1746129822.418142:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.418149:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.418153:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b9500 00000100:00100000:3.0:1746129822.418171:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1888 00000100:00100000:3.0:1746129822.418177:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054418688:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.420316:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054418688:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2134us (2279us total) trans 21474841330 rc 0/0 00000100:00100000:3.0:1746129822.420325:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1888 00002000:00100000:3.0:1746129822.420334:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2273279) req@ffff8800a01b9500 x1830949054418688/t21474841330(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.420343:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9500 with x1830949054418688 ext(2097152->2273279) 00010000:00010000:3.0:1746129822.420350:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.420360:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.420366:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b9500 00000100:00100000:0.0:1746129822.421808:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.421934:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054418816 00000100:00100000:1.0:1746129822.421942:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054418816 00010000:00010000:1.0:1746129822.421966:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.421993:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7790 00000100:00100000:1.0:1746129822.421999:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054418816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.422010:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129822.422021:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129822 -> 1746129823 00002000:00010000:1.0:1746129822.422024:0:16449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129822 -> 1746129823 00010000:00010000:1.0:1746129822.422027:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.422035:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.422053:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4e4ce00/0x48868a4e4395563a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356229 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.422071:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.422073:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.422079:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.422086:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.422118:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.422128:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054047360:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.422186:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.423668:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054047360:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.423682:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.423717:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054418816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1717us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.423726:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7790 00000100:00100000:0.0:1746129822.429084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.429145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.429173:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054419072 00000100:00100000:3.0:1746129822.429181:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054419072 00002000:00100000:3.0:1746129822.429216:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a01b8e00 x1830949054419072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.429225:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8e00 with x1830949054419072 ext(2097152->3145727) 00002000:00010000:3.0:1746129822.429230:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01b8e00 00000100:00100000:3.0:1746129822.429246:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054419328 00000100:00100000:3.0:1746129822.429249:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054419328 00002000:00100000:3.0:1746129822.429259:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a01bbb80 x1830949054419328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.429265:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bbb80 with x1830949054419328 ext(3145728->4194303) 00002000:00010000:3.0:1746129822.429268:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bbb80 00000100:00100000:3.0:1746129822.429278:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6993 00000100:00100000:3.0:1746129822.429284:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054419072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129822.429456:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6994 00000100:00100000:1.0:1746129822.429464:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054419328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.439570:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054419072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10276us (10484us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.439581:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6993 00002000:00100000:3.0:1746129822.439592:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a01b8e00 x1830949054419072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.439601:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8e00 with x1830949054419072 ext(2097152->3145727) 00002000:00010000:3.0:1746129822.439606:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01b8e00 00000100:00100000:0.0:1746129822.439669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.439767:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054419584 00000100:00100000:3.0:1746129822.439778:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054419584 00000100:00100000:3.0:1746129822.439822:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11057 00000100:00100000:3.0:1746129822.439828:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:31648:x1830949054419584:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.439844:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.439875:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395564f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35623e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.439958:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.439970:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.439981:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.439989:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.439994:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.439998:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440081:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955664 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00000100:00100000:1.0:1746129822.440459:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054419328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10993us (11311us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.440467:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6994 00002000:00100000:1.0:1746129822.440473:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a01bbb80 x1830949054419328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.440481:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bbb80 with x1830949054419328 ext(3145728->4194303) 00002000:00010000:1.0:1746129822.440484:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01bbb80 00010000:00010000:3.0:1746129822.440596:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440602:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129822.440610:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.440678:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440683:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440688:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440693:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1e000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.440696:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440701:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440709:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.440711:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.440713:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440717:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1e000/0x48868a4e43955656 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440737:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440741:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440745:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440749:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1ec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.440750:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440754:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440762:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244500) 00010000:00010000:3.0:1746129822.440764:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.440765:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440769:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ec00/0x48868a4e4395565d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.440799:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e4395564f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35623e expref: 38 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.440808:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35623e expref: 37 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.440813:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.440815:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129822.440817:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:3.0:1746129822.440838:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:31648:x1830949054419584:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1010us (1170us total) trans 8589945073 rc 0/0 00000100:00100000:3.0:1746129822.440843:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11057 00000100:00100000:0.0:1746129822.448435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.449236:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054419712 00000100:00100000:1.0:1746129822.449245:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054419712 00000100:00100000:0.0:1746129822.449254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.449326:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 735 00000100:00100000:1.0:1746129822.449335:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:1963:x1830949054419712:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.449347:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.449365:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e43955664 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35623e expref: 37 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.449391:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129822.449395:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.449406:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054419968 00000100:00100000:2.0:1746129822.449410:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054419968 00000100:00100000:1.0:1746129822.449430:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:1963:x1830949054419712:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 98us (1003us total) trans 0 rc 0/0 00002000:00100000:2.0:1746129822.449436:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a01baa00 x1830949054419968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129822.449436:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 735 00002000:00100000:2.0:1746129822.449444:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01baa00 with x1830949054419968 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.449448:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01baa00 00000100:00100000:2.0:1746129822.449501:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6995 00000100:00100000:2.0:1746129822.449507:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054419968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.455002:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054419968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5487us (5739us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129822.455012:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6995 00002000:00100000:2.0:1746129822.455021:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a01baa00 x1830949054419968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.455029:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01baa00 with x1830949054419968 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.455034:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01baa00 00000100:00100000:0.0:1746129822.477397:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.477612:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054420096 00000100:00100000:1.0:1746129822.477620:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054420096 00000100:00100000:1.0:1746129822.477761:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15579 00000100:00100000:1.0:1746129822.477768:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31648:x1830949054420096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.477782:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.477796:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356245 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.477818:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.477825:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 5 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.477831:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.477836:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.477837:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.477840:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.477895:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.477904:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.477914:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054047488:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.477989:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 5 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.477996:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 5 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.478002:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054047616:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.478019:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.478025:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 31 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.478031:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054047744:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.478040:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b283c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.482320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.482352:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054047488:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.482365:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054047616:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.482373:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054047744:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.482399:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2912256->3145727] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.482414:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dae6800, rc 0) 00000100:00100000:1.0:1746129822.482452:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31648:x1830949054420096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4684us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.482460:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15579 00000100:00100000:0.0:1746129822.482561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.482622:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054420224 00000100:00100000:3.0:1746129822.482628:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054420224 00000100:00100000:2.0:1746129822.482641:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054420352 00000100:00100000:2.0:1746129822.482645:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054420352 00010000:00010000:3.0:1746129822.482650:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.482658:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.482672:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7791 00000100:00100000:2.0:1746129822.482676:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7792 00000100:00100000:3.0:1746129822.482678:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054420224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129822.482681:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054420352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.482688:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.482688:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.482704:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.482705:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.482712:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746129822.483165:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.483190:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e43955506 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356157 expref: 6 pid: 20441 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746129822.483314:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129822.483316:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e055c00/0x48868a4e43955393 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356077 expref: 17 pid: 7976 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.483367:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054420352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 684us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.483372:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7792 00010000:00010000:3.0:1746129822.484722:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.484765:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054420224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2085us (2450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.484777:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7791 00000100:00100000:0.0:1746129822.487703:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.488443:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054420480 00000100:00100000:3.0:1746129822.488451:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054420480 00010000:00010000:3.0:1746129822.488479:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 32 pid: 3623 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.489049:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7793 00000100:00100000:3.0:1746129822.489057:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054420480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.489068:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.489088:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 32 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.489108:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 32 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.489129:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fd800/0x48868a4e4395537e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35605b expref: 32 pid: 3623 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.489142:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.489144:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.489150:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.489158:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.489183:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.489193:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054047872:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.489749:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.491678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.491775:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054047872:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129822.491791:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.491835:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054420480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2779us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.491843:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054420736 00000100:00100000:3.0:1746129822.491844:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7793 00000100:00100000:2.0:1746129822.491867:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054420736 00002000:00100000:2.0:1746129822.491897:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2912256->2916351) req@ffff880094769500 x1830949054420736/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.491905:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949054420736 ext(2912256->2916351) 00002000:00010000:2.0:1746129822.491908:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:2.0:1746129822.491921:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6996 00000100:00100000:2.0:1746129822.491927:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054420736:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129822.492441:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054420736:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 513us (769us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129822.492447:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6996 00002000:00100000:2.0:1746129822.492452:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2912256->2916351) req@ffff880094769500 x1830949054420736/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.492459:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769500 with x1830949054420736 ext(2912256->2916351) 00002000:00010000:2.0:1746129822.492462:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769500 00000100:00100000:0.0:1746129822.495442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.495692:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054420864 00000100:00100000:1.0:1746129822.495700:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054420864 00000100:00100000:1.0:1746129822.495743:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15580 00000100:00100000:1.0:1746129822.495749:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31648:x1830949054420864:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.495762:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.495775:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35624c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.495797:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.495804:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.495805:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.495808:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.495830:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.495840:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.495883:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054048000:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.495951:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b283c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.498909:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054048000:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.498934:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->3375103] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.498947:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3600, rc 0) 00000100:00100000:1.0:1746129822.498979:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31648:x1830949054420864:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3230us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.498986:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15580 00000100:00100000:0.0:1746129822.499278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.499375:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054421120 00000100:00100000:3.0:1746129822.499381:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054421120 00000100:00100000:3.0:1746129822.499412:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11058 00000100:00100000:3.0:1746129822.499418:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+308:31651:x1830949054421120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.499435:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.499450:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356253 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.499532:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499542:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499550:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499560:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499565:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499569:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499646:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43955695 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499652:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43955695 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499657:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43955695 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129822.499663:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.499727:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499736:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499741:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499745:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1fa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.499748:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499753:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499760:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.499762:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.499764:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499769:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fa00/0x48868a4e43955687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499779:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499783:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499786:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499789:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800acc1fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.499791:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499798:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499803:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244400) 00010000:00010000:3.0:1746129822.499804:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.499805:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499808:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fe00/0x48868a4e4395568e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129822.499833:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1fc00/0x48868a4e43955680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356253 expref: 311 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.499840:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43955695 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356253 expref: 310 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.499844:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.499864:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129822.499866:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ee00, rc 0) 00000100:00100000:3.0:1746129822.499889:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:31651:x1830949054421120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 472us (612us total) trans 8589945074 rc 0/0 00000100:00100000:3.0:1746129822.499895:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11058 00000100:00100000:0.0:1746129822.501304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.501362:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054421248 00000100:00100000:3.0:1746129822.501366:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054421248 00010000:00010000:3.0:1746129822.501385:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.501403:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7794 00000100:00100000:3.0:1746129822.501408:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054421248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.501417:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.501430:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.501439:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.501453:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05c00/0x48868a4e43955648 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356237 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.501463:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.501464:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.501469:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.501476:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.501499:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.501507:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054048128:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.503545:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.503692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.503933:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054421376 00000100:00100000:2.0:1746129822.503940:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054421376 00000100:00100000:2.0:1746129822.503983:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 736 00000100:00100000:2.0:1746129822.503990:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:1961:x1830949054421376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.504003:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.504022:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800acc1ee00/0x48868a4e43955695 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356253 expref: 310 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.504043:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00000100:00100000:0.0:1746129822.504223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.504264:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054421632 00000100:00100000:1.0:1746129822.504268:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054421632 00000100:00100000:1.0:1746129822.504288:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4630 00000100:00100000:1.0:1746129822.504293:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:31651:x1830949054421632:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129822.504322:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054048128:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129822.504334:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.504362:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054421248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2953us (3061us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.504368:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7794 00010000:00010000:2.0:1746129822.504428:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.504444:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+311:1961:x1830949054421376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 454us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.504448:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 736 00000100:00100000:1.0:1746129822.504459:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d61450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:31651:x1830949054421632:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 166us (236us total) trans 8589945075 rc 0/0 00000100:00100000:1.0:1746129822.504463:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4630 00000100:00100000:0.0:1746129822.505712:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.505804:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054421888 00000100:00100000:2.0:1746129822.505808:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054421888 00002000:00100000:2.0:1746129822.505831:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3371008->3375103) req@ffff880094768380 x1830949054421888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.505840:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949054421888 ext(3371008->3375103) 00002000:00010000:2.0:1746129822.505844:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768380 00000100:00100000:2.0:1746129822.505894:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6997 00000100:00100000:2.0:1746129822.505899:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054421888:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129822.506006:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054421888:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 106us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129822.506011:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6997 00002000:00100000:2.0:1746129822.506015:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3371008->3375103) req@ffff880094768380 x1830949054421888/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.506021:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094768380 with x1830949054421888 ext(3371008->3375103) 00002000:00010000:2.0:1746129822.506024:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094768380 00000100:00100000:0.0:1746129822.507773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.507891:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054422144 00000100:00100000:2.0:1746129822.507898:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054422144 00000100:00100000:2.0:1746129822.507955:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4631 00000100:00100000:2.0:1746129822.507964:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+36:31648:x1830949054422144:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129822.508162:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:31648:x1830949054422144:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 197us (393us total) trans 8589945076 rc 0/0 00000100:00100000:2.0:1746129822.508169:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4631 00000100:00100000:0.0:1746129822.529605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.529689:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054422272 00000100:00100000:1.0:1746129822.529697:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054422272 00000100:00100000:1.0:1746129822.529744:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15581 00000100:00100000:1.0:1746129822.529751:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:31651:x1830949054422272:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.529767:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.529781:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35625a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.529806:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.529813:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.529814:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.529817:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.529845:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.529885:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.529896:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054048256:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.529973:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.531628:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054048256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.531650:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4136960->4194303] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.531662:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3200, rc 0) 00000100:00100000:1.0:1746129822.531701:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31651:x1830949054422272:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1949us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.531709:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15581 00000100:00100000:0.0:1746129822.533061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.533148:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054422400 00000100:00100000:3.0:1746129822.533154:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054422400 00002000:00100000:3.0:1746129822.533185:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3375103) req@ffff88009476b100 x1830949054422400/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.533191:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b100 with x1830949054422400 ext(3145728->3375103) 00010000:00010000:3.0:1746129822.533196:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 21 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.533204:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 21 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.533208:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009476b100 00000100:00100000:3.0:1746129822.533277:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1889 00000100:00100000:3.0:1746129822.533285:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054422400:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129822.537414:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054422400:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 4121us (4347us total) trans 21474841331 rc 0/0 00000100:00100000:3.0:1746129822.537425:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1889 00002000:00100000:3.0:1746129822.537435:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3375103) req@ffff88009476b100 x1830949054422400/t21474841331(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.537444:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476b100 with x1830949054422400 ext(3145728->3375103) 00010000:00010000:3.0:1746129822.537453:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.537472:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.537479:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009476b100 00000100:00100000:0.0:1746129822.539818:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.540032:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054422528 00000100:00100000:2.0:1746129822.540040:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054422528 00010000:00010000:2.0:1746129822.540502:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.540538:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7795 00000100:00100000:2.0:1746129822.540545:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054422528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.540556:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.540572:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.540587:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.540605:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955679 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35624c expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.540631:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.540633:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.540639:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.540646:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.540672:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.540682:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054048384:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.540755:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.546972:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054048384:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.546992:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.547563:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054422528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7016us (7747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.547573:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7795 00000100:00100000:0.0:1746129822.548003:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.548919:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054422784 00000100:00100000:3.0:1746129822.548926:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054422784 00002000:00100000:3.0:1746129822.548961:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4136960->4141055) req@ffff88009fbedc00 x1830949054422784/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.548971:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbedc00 with x1830949054422784 ext(4136960->4141055) 00002000:00010000:3.0:1746129822.548975:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbedc00 00000100:00100000:3.0:1746129822.548997:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6998 00000100:00100000:3.0:1746129822.549003:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054422784:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129822.549648:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054422784:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 643us (1644us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129822.549654:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6998 00002000:00100000:3.0:1746129822.549659:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4136960->4141055) req@ffff88009fbedc00 x1830949054422784/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.549666:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbedc00 with x1830949054422784 ext(4136960->4141055) 00002000:00010000:3.0:1746129822.549669:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbedc00 00000100:00100000:0.0:1746129822.554200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.554276:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054422912 00000100:00100000:1.0:1746129822.554283:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054422912 00000100:00100000:1.0:1746129822.554415:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15582 00000100:00100000:1.0:1746129822.554422:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31651:x1830949054422912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.554438:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.554451:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356261 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.554475:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.554481:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.554482:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129822.554486:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->3543039] (req 3145728->3543039) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.554510:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 15 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.554520:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 15 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.554530:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054048512:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.555178:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.560244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.560290:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054048512:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.560315:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->3543039] (req 3145728->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.560330:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3e00, rc 0) 00000100:00100000:1.0:1746129822.560365:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31651:x1830949054422912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5943us (6171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.560373:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15582 00000100:00100000:3.0:1746129822.560541:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054423040 00000100:00100000:3.0:1746129822.560547:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054423040 00002000:00100000:3.0:1746129822.560576:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2912256->3145727) req@ffff88009fbeea00 x1830949054423040/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.560590:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949054423040 ext(2912256->3145727) 00010000:00010000:3.0:1746129822.560595:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 16 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.560606:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 16 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.560612:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbeea00 00000100:00100000:3.0:1746129822.560638:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1890 00000100:00100000:3.0:1746129822.560645:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054423040:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129822.564030:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054423040:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 3377us (3785us total) trans 17179874135 rc 0/0 00000100:00100000:3.0:1746129822.564039:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1890 00002000:00100000:3.0:1746129822.564048:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2912256->3145727) req@ffff88009fbeea00 x1830949054423040/t17179874135(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.564056:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949054423040 ext(2912256->3145727) 00010000:00010000:3.0:1746129822.564064:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.564075:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.564082:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fbeea00 00000100:00100000:0.0:1746129822.567660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.567762:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054423168 00000100:00100000:2.0:1746129822.567770:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054423168 00010000:00010000:2.0:1746129822.567801:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.567839:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7796 00000100:00100000:2.0:1746129822.567873:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054423168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.567886:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129822.567902:0:16449:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129822 -> 1746129823 00002000:00010000:2.0:1746129822.567905:0:16449:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129822 -> 1746129823 00010000:00010000:2.0:1746129822.567909:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.567921:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.567940:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dae6800/0x48868a4e43955672 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2912256->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356245 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.567970:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.567972:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.567978:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.567984:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.568014:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 31 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.568079:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054048640:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.568679:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.577022:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054048640:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.577041:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.577084:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054423168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9238us (9432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.577102:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7796 00000100:00100000:0.0:1746129822.577926:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.578001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.578132:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054423552 00000100:00100000:2.0:1746129822.578139:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054423552 00000100:00100000:2.0:1746129822.578167:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11059 00000100:00100000:2.0:1746129822.578172:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+310:31655:x1830949054423552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.578188:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.578201:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060800/0x48868a4e439556b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356268 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.578278:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578288:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578296:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578305:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578310:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578314:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578397:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e439556c6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578405:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e439556c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578409:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e439556c6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129822.578419:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129822.578480:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578486:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578490:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578494:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a061a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.578497:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578502:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578510:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129822.578512:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.578515:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578518:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061a00/0x48868a4e439556b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578530:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578535:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578538:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578545:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a060200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.578547:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578550:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578554:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8a00) 00010000:00010000:2.0:1746129822.578556:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.578557:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578560:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e439556bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129822.578587:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060800/0x48868a4e439556b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356268 expref: 313 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.578595:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e439556c6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356268 expref: 312 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.578600:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.578602:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129822.578603:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060600, rc 0) 00000100:00100000:2.0:1746129822.578626:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:31655:x1830949054423552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 454us (625us total) trans 8589945077 rc 0/0 00000100:00100000:2.0:1746129822.578631:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11059 00000100:00100000:3.0:1746129822.578700:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054423680 00000100:00100000:3.0:1746129822.578703:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054423680 00002000:00100000:3.0:1746129822.578727:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3538944->3543039) req@ffff8800a645dc00 x1830949054423680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.578734:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645dc00 with x1830949054423680 ext(3538944->3543039) 00002000:00010000:3.0:1746129822.578739:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645dc00 00000100:00100000:3.0:1746129822.578759:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 6999 00000100:00100000:3.0:1746129822.578765:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054423680:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129822.578878:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054423680:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 113us (954us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129822.578884:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 6999 00002000:00100000:3.0:1746129822.578888:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3538944->3543039) req@ffff8800a645dc00 x1830949054423680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.578894:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645dc00 with x1830949054423680 ext(3538944->3543039) 00002000:00010000:3.0:1746129822.578897:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a645dc00 00000100:00100000:0.0:1746129822.583030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.583066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.583127:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054423808 00000100:00100000:1.0:1746129822.583134:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054423808 00000100:00100000:1.0:1746129822.583175:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15583 00000100:00100000:2.0:1746129822.583342:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054423936 00000100:00100000:2.0:1746129822.583345:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054423936 00000100:00100000:2.0:1746129822.583372:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 737 00000100:00100000:2.0:1746129822.583377:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:1962:x1830949054423936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.583388:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.583407:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e439556c6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356268 expref: 312 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.583421:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.583425:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.583458:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+311:1962:x1830949054423936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.583464:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 737 00000100:00100000:1.0:1746129822.583619:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949054423808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.583633:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.583643:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35626f expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.583658:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.583660:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.583666:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.583677:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.583685:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c2800, rc 0) 00000100:00100000:1.0:1746129822.583702:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054423808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.583706:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15583 00000100:00100000:0.0:1746129822.591450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.591494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.592561:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054424192 00000100:00100000:2.0:1746129822.592570:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054424192 00002000:00100000:2.0:1746129822.592607:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a645d880 x1830949054424192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.592615:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d880 with x1830949054424192 ext(0->1048575) 00002000:00010000:2.0:1746129822.592619:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d880 00000100:00100000:2.0:1746129822.592633:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054424448 00000100:00100000:2.0:1746129822.592635:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054424448 00002000:00100000:2.0:1746129822.592644:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a645e300 x1830949054424448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.592650:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e300 with x1830949054424448 ext(1048576->2097151) 00002000:00010000:2.0:1746129822.592653:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645e300 00000100:00100000:2.0:1746129822.592666:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7000 00000100:00100000:2.0:1746129822.592672:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054424192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.593876:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7001 00000100:00100000:3.0:1746129822.593884:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054424448:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.607898:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054424192:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15216us (16445us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.607909:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7000 00002000:00100000:2.0:1746129822.607918:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800a645d880 x1830949054424192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.607927:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645d880 with x1830949054424192 ext(0->1048575) 00002000:00010000:2.0:1746129822.607931:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645d880 00000100:00100000:3.0:1746129822.612227:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1964:x1830949054424448:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18334us (20722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.612239:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7001 00002000:00100000:3.0:1746129822.612249:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a645e300 x1830949054424448/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.612258:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645e300 with x1830949054424448 ext(1048576->2097151) 00002000:00010000:3.0:1746129822.612263:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645e300 00000100:00100000:0.0:1746129822.632250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.632387:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054424704 00000100:00100000:2.0:1746129822.632395:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054424704 00000100:00100000:2.0:1746129822.632435:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11060 00000100:00100000:2.0:1746129822.632442:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+37:31658:x1830949054424704:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129822.632462:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.632477:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060e00/0x48868a4e439556db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356276 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.632570:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632582:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632591:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632601:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632606:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632611:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632697:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060c00/0x48868a4e439556f0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632704:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060c00/0x48868a4e439556f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632709:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060c00/0x48868a4e439556f0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129822.632717:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129822.632783:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632789:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632794:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632799:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a061000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.632802:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632808:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632816:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129822.632818:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.632821:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.632826:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061000/0x48868a4e439556e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633791:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633799:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633804:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633808:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a061c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.633811:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633816:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633823:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8a00) 00010000:00010000:2.0:1746129822.633825:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.633827:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633831:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061c00/0x48868a4e439556e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.633879:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060e00/0x48868a4e439556db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356276 expref: 40 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.633890:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060c00/0x48868a4e439556f0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356276 expref: 39 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.633895:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.633897:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129822.633899:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060c00, rc 0) 00000100:00100000:2.0:1746129822.633948:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+39:31658:x1830949054424704:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1506us (1705us total) trans 8589945078 rc 0/0 00000100:00100000:2.0:1746129822.633954:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11060 00000100:00100000:0.0:1746129822.634006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.634352:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.634380:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.634411:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.634426:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054424960 00000100:00100000:1.0:1746129822.634430:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054424960 00000100:00100000:2.0:1746129822.634453:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054425216 00000100:00100000:2.0:1746129822.634456:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054425216 00002000:00100000:1.0:1746129822.634457:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b8e5180 x1830949054424960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.634465:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5180 with x1830949054424960 ext(2097152->3145727) 00002000:00100000:2.0:1746129822.634466:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4136959) req@ffff880091fa4e00 x1830949054425216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746129822.634469:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5180 00002000:00100000:2.0:1746129822.634472:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4e00 with x1830949054425216 ext(3145728->4136959) 00002000:00010000:2.0:1746129822.634474:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa4e00 00000100:00100000:1.0:1746129822.634479:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054425472 00000100:00100000:1.0:1746129822.634481:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054425472 00000100:00100000:2.0:1746129822.634486:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054425728 00000100:00100000:2.0:1746129822.634487:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054425728 00002000:00100000:1.0:1746129822.634490:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880091fa6680 x1830949054425472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.634496:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3543040->4194303) req@ffff880091fa4380 x1830949054425728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.634496:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6680 with x1830949054425472 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.634498:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6680 00002000:00100000:2.0:1746129822.634502:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4380 with x1830949054425728 ext(3543040->4194303) 00002000:00010000:2.0:1746129822.634504:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa4380 00000100:00100000:1.0:1746129822.634507:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7002 00000100:00100000:2.0:1746129822.634825:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7003 00000100:00100000:2.0:1746129822.634831:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054425216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.634874:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7004 00000100:00100000:3.0:1746129822.634881:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054425472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.635230:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7005 00000100:00100000:2.0:1746129822.635235:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054425728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129822.635315:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054424960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129822.638381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.638541:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054425856 00000100:00100000:2.0:1746129822.638548:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054425856 00000100:00100000:2.0:1746129822.638591:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 738 00000100:00100000:2.0:1746129822.638597:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+39:1961:x1830949054425856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.638611:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.638631:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060c00/0x48868a4e439556f0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356276 expref: 39 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.638645:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.638649:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.638685:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+38:1961:x1830949054425856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.638691:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 738 00000100:00100000:1.0:1746129822.651600:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054424960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17077us (17587us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.651612:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7002 00002000:00100000:1.0:1746129822.651622:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b8e5180 x1830949054424960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.651631:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5180 with x1830949054424960 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.651636:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5180 00000100:00100000:2.0:1746129822.654770:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054425216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19930us (20409us total) trans 0 rc 991232/991232 00000100:00100000:2.0:1746129822.654781:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7003 00002000:00100000:2.0:1746129822.654790:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4136959) req@ffff880091fa4e00 x1830949054425216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.654799:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4e00 with x1830949054425216 ext(3145728->4136959) 00002000:00010000:2.0:1746129822.654804:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091fa4e00 00000100:00100000:3.0:1746129822.657361:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054425472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22473us (22971us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.657372:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7004 00002000:00100000:3.0:1746129822.657381:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880091fa6680 x1830949054425472/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.657420:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa6680 with x1830949054425472 ext(2097152->3145727) 00002000:00010000:3.0:1746129822.657425:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa6680 00000100:00100000:2.0:1746129822.657575:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054425728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22338us (23161us total) trans 0 rc 651264/651264 00000100:00100000:2.0:1746129822.657582:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7005 00002000:00100000:2.0:1746129822.657587:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3543040->4194303) req@ffff880091fa4380 x1830949054425728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 651264/651264 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.657593:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4380 with x1830949054425728 ext(3543040->4194303) 00002000:00010000:2.0:1746129822.657596:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091fa4380 00000100:00100000:0.0:1746129822.667770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.667836:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054426112 00000100:00100000:2.0:1746129822.667844:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054426112 00002000:00100000:2.0:1746129822.667905:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b8e5f80 x1830949054426112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.667914:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5f80 with x1830949054426112 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.667918:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5f80 00000100:00100000:2.0:1746129822.667943:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7006 00000100:00100000:2.0:1746129822.667950:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054426112:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.681344:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054426112:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13385us (13572us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129822.681355:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7006 00002000:00100000:2.0:1746129822.681365:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b8e5f80 x1830949054426112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.681373:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5f80 with x1830949054426112 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.681377:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e5f80 00000100:00100000:0.0:1746129822.689353:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.690232:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.690312:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054426240 00000100:00100000:1.0:1746129822.690321:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054426240 00000100:00100000:1.0:1746129822.690369:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15584 00000100:00100000:1.0:1746129822.690375:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31658:x1830949054426240:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.690391:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.690407:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35627d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.690435:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.690443:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.690450:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.690452:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.690454:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1691648->2097151] (req 1691648->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.690480:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.690490:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.690501:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054048768:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.690586:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.690598:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 31 pid: 7975 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.690605:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054048896:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.690623:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.691793:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054426496 00000100:00100000:2.0:1746129822.691800:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054426496 00000100:00100000:2.0:1746129822.691833:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4632 00000100:00100000:2.0:1746129822.691838:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+311:31655:x1830949054426496:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129822.692033:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:31655:x1830949054426496:12345-192.168.204.31@tcp:35:cat.0 Request processed in 193us (1801us total) trans 8589945079 rc 0/0 00000100:00100000:2.0:1746129822.692039:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4632 00000100:00100000:0.0:1746129822.693971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.694029:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054426752 00000100:00100000:3.0:1746129822.694035:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054426752 00000100:00100000:3.0:1746129822.694068:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11061 00000100:00100000:3.0:1746129822.694074:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+38:31661:x1830949054426752:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.694099:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.694113:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093361a00/0x48868a4e43955705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356284 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.694197:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054048768:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.694200:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129822.694208:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054048896:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.694212:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694222:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.694227:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1691648->2097151] (req 1691648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.694232:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694240:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.694244:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68400, rc 0) 00010000:00010000:3.0:1746129822.694245:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129822.694275:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31658:x1830949054426240:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3900us (4930us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.694281:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15584 00010000:00010000:3.0:1746129822.694338:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093361200/0x48868a4e4395571a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694346:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093361200/0x48868a4e4395571a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694352:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093361200/0x48868a4e4395571a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.694360:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.694423:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694429:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694434:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694439:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093360e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.694442:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694446:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694455:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.694457:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.694460:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694464:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093360e00/0x48868a4e4395570c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694490:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694495:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694500:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694504:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093360800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.694507:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694511:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694517:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244900) 00010000:00010000:3.0:1746129822.694519:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.694521:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694525:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093360800/0x48868a4e43955713 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.694555:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093361a00/0x48868a4e43955705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356284 expref: 41 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.694568:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093361200/0x48868a4e4395571a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356284 expref: 40 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.694572:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.694574:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129822.694575:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093361200, rc 0) 00000100:00100000:3.0:1746129822.694607:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+40:31661:x1830949054426752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 533us (641us total) trans 8589945080 rc 0/0 00000100:00100000:3.0:1746129822.694613:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11061 00000100:00100000:0.0:1746129822.695063:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.695617:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054426880 00000100:00100000:2.0:1746129822.695622:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054426880 00010000:00010000:2.0:1746129822.695641:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 32 pid: 7975 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.695676:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7797 00000100:00100000:2.0:1746129822.695682:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054426880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.695692:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.695707:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 32 pid: 7975 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.695715:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 32 pid: 7975 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.695729:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e439555bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561d5 expref: 32 pid: 7975 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.695738:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.695770:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949054426880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.695775:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7797 00000100:00100000:0.0:1746129822.700206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.700239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.700272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.700304:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054427008 00000100:00100000:1.0:1746129822.700313:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054427008 00010000:00010000:1.0:1746129822.700342:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746129822.700360:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054427264 00000100:00100000:2.0:1746129822.700364:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054427264 00000100:00100000:1.0:1746129822.700364:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054427392 00000100:00100000:1.0:1746129822.700366:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054427392 00000100:00100000:1.0:1746129822.700388:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7798 00000100:00100000:2.0:1746129822.700389:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4633 00000100:00100000:2.0:1746129822.700394:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+41:31661:x1830949054427264:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129822.700394:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054427008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.700407:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.700426:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.700436:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.700455:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d08c000/0x48868a4e43955609 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561f8 expref: 18 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.700468:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.700470:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.700476:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.700482:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.700509:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.700520:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054049024:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.700549:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+42:31661:x1830949054427264:12345-192.168.204.31@tcp:35:cat.0 Request processed in 154us (350us total) trans 8589945081 rc 0/0 00000100:00100000:2.0:1746129822.700555:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4633 00000100:00100000:1.0:1746129822.700569:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.700585:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 739 00000100:00100000:1.0:1746129822.700591:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+41:1962:x1830949054427392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.700598:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.700886:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093361200/0x48868a4e4395571a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356284 expref: 41 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.700901:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129822.700905:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.701159:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+40:1962:x1830949054427392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 567us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.701165:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 739 00000100:00100000:0.0:1746129822.702836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.703128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.703155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.703168:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054427520 00000100:00100000:0.0:1746129822.703169:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054427776 00000100:00100000:3.0:1746129822.703173:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054427520 00000100:00100000:0.0:1746129822.703173:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054427776 00000100:00100000:3.0:1746129822.703395:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054427648 00000100:00100000:3.0:1746129822.703397:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054427648 00000100:00100000:1.0:1746129822.703521:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15585 00000100:00100000:1.0:1746129822.703528:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054427520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.703541:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129822.703546:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15586 00000100:00100000:0.0:1746129822.703551:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054427776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.703553:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c69800/0x48868a4e43955728 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35628b expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.703557:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.703564:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b538a000/0x48868a4e4395572f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356299 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.703590:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054049152:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.703590:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054049280:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.703635:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15587 00000100:00100000:3.0:1746129822.703640:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054427648:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.703647:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.703655:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955736 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356292 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.703674:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054049408:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.703835:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.703949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.704051:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054428032 00000100:00100000:2.0:1746129822.704056:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054428032 00002000:00100000:2.0:1746129822.704079:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1691648->1695743) req@ffff88012b8e5500 x1830949054428032/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.704098:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5500 with x1830949054428032 ext(1691648->1695743) 00002000:00010000:2.0:1746129822.704102:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e5500 00000100:00100000:2.0:1746129822.704115:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7007 00000100:00100000:2.0:1746129822.704121:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054428032:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129822.704233:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054428032:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 111us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129822.704238:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7007 00002000:00100000:2.0:1746129822.704244:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1691648->1695743) req@ffff88012b8e5500 x1830949054428032/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.704251:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e5500 with x1830949054428032 ext(1691648->1695743) 00002000:00010000:2.0:1746129822.704253:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e5500 00000100:00100000:1.0:1746129822.704878:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.704902:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054049024:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129822.704915:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129822.704932:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054427008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4538us (4692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.704938:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7798 00000100:00100000:3.0:1746129822.705019:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00002000:00010000:2.0:1746129822.709297:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129821 -> 1746129823 00000100:00100000:2.0:1746129822.709322:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054049280:192.168.204.31@tcp:106: 00002000:00010000:1.0:1746129822.709329:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129822 -> 1746129823 00002000:00010000:1.0:1746129822.709333:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129822 -> 1746129823 00002000:00010000:1.0:1746129822.709335:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129822 -> 1746129823 00000100:00100000:1.0:1746129822.709344:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054049152:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129822.709350:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b538a000/0x48868a4e4395572f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356299 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.709359:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c69800/0x48868a4e43955728 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35628b expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.709362:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b538a000/0x48868a4e4395572f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356299 expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.709368:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c69800/0x48868a4e43955728 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35628b expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.709370:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538a000, rc 0) 00010000:00010000:1.0:1746129822.709389:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c69800, rc 0) 00000100:00100000:2.0:1746129822.710122:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054427776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6568us (6992us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.710131:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15586 00000100:00100000:1.0:1746129822.710141:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054427520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6611us (7308us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.710146:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15585 00000100:00100000:0.0:1746129822.711267:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.711313:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054428160 00000100:00100000:1.0:1746129822.711319:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054428160 00000100:00100000:1.0:1746129822.711358:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15588 00000100:00100000:1.0:1746129822.711364:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31658:x1830949054428160:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129822.711377:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.711389:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562a0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.711417:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.711425:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.711434:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.711436:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.711441:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129822.711462:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129822 -> 1746129823 00010000:00010000:1.0:1746129822.711463:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.711472:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746129822.711476:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054049408:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129822.711486:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054049536:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.711493:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955736 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356292 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.711505:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955736 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356292 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.711997:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093360800, rc 0) 00000100:00100000:3.0:1746129822.712143:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054427648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8500us (8985us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.712149:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15587 00010000:00010000:1.0:1746129822.712183:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 30 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.712191:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 30 pid: 7975 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.712199:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054049664:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.712217:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.714938:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054049536:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129822.714949:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054049664:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129822.714972:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.714986:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091c68e00, rc 0) 00000100:00100000:1.0:1746129822.715032:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31658:x1830949054428160:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3667us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.715039:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15588 00000100:00100000:0.0:1746129822.715865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.715913:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054428416 00000100:00100000:1.0:1746129822.715919:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054428416 00010000:00010000:1.0:1746129822.715941:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.716016:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7799 00000100:00100000:1.0:1746129822.716024:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054428416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.716035:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.716053:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.716062:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.716081:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0600/0x48868a4e439555c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561dc expref: 31 pid: 7975 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.716262:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.716330:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054428416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 306us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.716336:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7799 00000100:00100000:0.0:1746129822.716921:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.716996:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054428288 00000100:00100000:1.0:1746129822.716999:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054428288 00010000:00010000:1.0:1746129822.717011:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746129822.717032:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7800 00000100:00100000:1.0:1746129822.717037:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054428288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.717043:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.717050:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.717063:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.717073:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a4e7f200/0x48868a4e43955610 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561ff expref: 18 pid: 1140 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.717082:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.717084:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.717102:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.717108:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.717131:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.717141:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054049792:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.717201:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.719668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.721061:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.721181:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054428672 00000100:00100000:2.0:1746129822.721187:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054428672 00002000:00100000:2.0:1746129822.721221:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1691647) req@ffff88012b8e4000 x1830949054428672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.721230:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4000 with x1830949054428672 ext(1048576->1691647) 00002000:00010000:2.0:1746129822.721234:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4000 00000100:00100000:3.0:1746129822.721243:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054428928 00000100:00100000:3.0:1746129822.721247:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054428928 00000100:00100000:2.0:1746129822.721258:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7008 00002000:00100000:3.0:1746129822.721265:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1150976->1155071) req@ffff88009476ad80 x1830949054428928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129822.721265:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054428672:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:3.0:1746129822.721274:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949054428928 ext(1150976->1155071) 00002000:00010000:3.0:1746129822.721277:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:3.0:1746129822.721291:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7009 00000100:00100000:3.0:1746129822.721296:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054428928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.721409:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054428928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 111us (348us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129822.721415:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7009 00002000:00100000:3.0:1746129822.721419:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1150976->1155071) req@ffff88009476ad80 x1830949054428928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.721426:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476ad80 with x1830949054428928 ext(1150976->1155071) 00002000:00010000:3.0:1746129822.721429:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476ad80 00000100:00100000:1.0:1746129822.721915:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054049792:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.721929:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.721951:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054428288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4914us (5032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.721958:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7800 00000100:00100000:1.0:1746129822.724653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.724727:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054429184 00000100:00100000:2.0:1746129822.724734:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054429184 00000100:00100000:2.0:1746129822.724777:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4634 00000100:00100000:2.0:1746129822.724784:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+40:31658:x1830949054429184:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129822.724961:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+41:31658:x1830949054429184:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 177us (313us total) trans 8589945082 rc 0/0 00000100:00100000:2.0:1746129822.724967:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4634 00000100:00100000:2.0:1746129822.727683:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054428672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6410us (8012us total) trans 0 rc 643072/643072 00000100:00100000:2.0:1746129822.727695:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7008 00002000:00100000:2.0:1746129822.727704:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1691647) req@ffff88012b8e4000 x1830949054428672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 643072/643072 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.727713:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4000 with x1830949054428672 ext(1048576->1691647) 00002000:00010000:2.0:1746129822.727718:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4000 00000100:00100000:0.0:1746129822.735296:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.735384:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054429440 00000100:00100000:2.0:1746129822.735391:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054429440 00002000:00100000:2.0:1746129822.735425:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1155072->2097151) req@ffff880094769c00 x1830949054429440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.735434:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949054429440 ext(1155072->2097151) 00002000:00010000:2.0:1746129822.735439:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:2.0:1746129822.735456:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7010 00000100:00100000:2.0:1746129822.735468:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054429440:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.742519:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054429440:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7044us (7223us total) trans 0 rc 942080/942080 00000100:00100000:2.0:1746129822.742530:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7010 00002000:00100000:2.0:1746129822.742538:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1155072->2097151) req@ffff880094769c00 x1830949054429440/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.742547:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094769c00 with x1830949054429440 ext(1155072->2097151) 00002000:00010000:2.0:1746129822.742553:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094769c00 00000100:00100000:0.0:1746129822.747474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.747526:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054429568 00000100:00100000:1.0:1746129822.747533:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054429568 00000100:00100000:1.0:1746129822.747577:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15589 00000100:00100000:1.0:1746129822.747583:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054429568:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.747597:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.747611:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3000/0x48868a4e43955744 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562a7 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.747653:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054049920:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.747702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.747725:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.747789:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054429696 00000100:00100000:3.0:1746129822.747793:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054429696 00000100:00100000:3.0:1746129822.747813:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15590 00000100:00100000:3.0:1746129822.747819:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054429696:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.747826:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.747836:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e4395574b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562ae expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.747882:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054050048:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.747921:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.748902:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054049920:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.748921:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3000/0x48868a4e43955744 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a7 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.748931:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3000/0x48868a4e43955744 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a7 expref: 23 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.748948:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3000, rc 0) 00000100:00100000:1.0:1746129822.749226:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054429568:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1520us (1635us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.749232:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15589 00000100:00100000:3.0:1746129822.749312:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054050048:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.749327:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e4395574b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ae expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.749335:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858600/0x48868a4e4395574b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ae expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.749357:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858600, rc 0) 00000100:00100000:3.0:1746129822.749379:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054429696:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1560us (1677us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.749384:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15590 00000100:00100000:1.0:1746129822.755030:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.755155:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054429824 00000100:00100000:3.0:1746129822.755164:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054429824 00000100:00100000:3.0:1746129822.755206:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15591 00000100:00100000:3.0:1746129822.755213:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31661:x1830949054429824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.755231:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.755245:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562b5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.755270:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.755277:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.755278:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.755281:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.755305:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 20 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.755315:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.755324:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054050176:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.755412:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.760378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.760541:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054050176:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.760565:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.760580:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858200, rc 0) 00000100:00100000:3.0:1746129822.760618:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31661:x1830949054429824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5405us (5595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.760625:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15591 00000100:00100000:2.0:1746129822.760669:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054429952 00000100:00100000:2.0:1746129822.760676:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054429952 00002000:00100000:2.0:1746129822.760706:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4136960->4194303) req@ffff880091fa4a80 x1830949054429952/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.760714:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4a80 with x1830949054429952 ext(4136960->4194303) 00010000:00010000:2.0:1746129822.760720:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 21 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.760731:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 21 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.760741:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa4a80 00000100:00100000:2.0:1746129822.760766:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1891 00000100:00100000:2.0:1746129822.760772:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054429952:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129822.765623:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054429952:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4843us (5243us total) trans 21474841332 rc 0/0 00000100:00100000:2.0:1746129822.765634:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1891 00002000:00100000:2.0:1746129822.765644:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4136960->4194303) req@ffff880091fa4a80 x1830949054429952/t21474841332(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.765652:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091fa4a80 with x1830949054429952 ext(4136960->4194303) 00010000:00010000:2.0:1746129822.765660:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.765671:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.765677:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091fa4a80 00000100:00100000:0.0:1746129822.774047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.774842:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054430080 00000100:00100000:1.0:1746129822.774875:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054430080 00010000:00010000:1.0:1746129822.774905:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.774945:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7801 00000100:00100000:1.0:1746129822.774953:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054430080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.774963:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129822.775004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129822.775065:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.775104:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.775114:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054430208 00000100:00100000:3.0:1746129822.775118:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054430208 00010000:00010000:1.0:1746129822.775125:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3200/0x48868a4e439556a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4136960->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35625a expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.775142:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129822.775154:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11062 00000100:00100000:3.0:1746129822.775160:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31664:x1830949054430208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.775178:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.775190:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858a00/0x48868a4e43955759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562bc expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.775241:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775252:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775260:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775271:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775275:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775281:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775376:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775385:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 311 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.775391:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.775419:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 311 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.775429:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 311 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.775439:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054050304:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.775507:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00010000:00010000:1.0:1746129822.775673:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.775680:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.775687:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.775707:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.775715:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054050432:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.775746:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.778504:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054050432:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129822.778521:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.778553:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054430080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3600us (4512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.778562:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7801 00000100:00100000:2.0:1746129822.778774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.778986:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054430464 00000100:00100000:0.0:1746129822.778992:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054430464 00000100:00100000:0.0:1746129822.779028:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4635 00000100:00100000:0.0:1746129822.779035:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:7659:x1830949054430464:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129822.779293:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054050304:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.779308:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129822.779574:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:7659:x1830949054430464:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 539us (801us total) trans 8589945083 rc 0/0 00000100:00100000:0.0:1746129822.779580:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4635 00000100:00100000:0.0:1746129822.780750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.780810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.780868:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054430720 00000100:00100000:2.0:1746129822.780872:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054430720 00000100:00100000:1.0:1746129822.780891:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054430848 00000100:00100000:1.0:1746129822.780895:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054430848 00002000:00100000:2.0:1746129822.780897:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a645df80 x1830949054430720/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.780907:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645df80 with x1830949054430720 ext(2097152->3145727) 00002000:00010000:2.0:1746129822.780910:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645df80 00010000:00010000:1.0:1746129822.780910:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 313 pid: 1851 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.780922:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7011 00000100:00100000:2.0:1746129822.780927:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054430720:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129822.780939:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7802 00000100:00100000:1.0:1746129822.780943:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:1963:x1830949054430848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.780951:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.780956:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 313 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.780965:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 313 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.780981:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e055800/0x48868a4e439555d1 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3561e3 expref: 313 pid: 1851 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.780994:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129822.780999:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.781007:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.781016:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.781040:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.781063:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:1963:x1830949054430848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.781068:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7802 00010000:00010000:3.0:1746129822.781549:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781556:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.781594:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129822.781599:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129822.781611:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781620:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781627:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781633:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781639:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781644:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f859800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.781648:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781652:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781660:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.781662:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.781665:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781669:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43955760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781683:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781688:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781693:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781696:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f858e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.781697:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781701:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781710:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244500) 00010000:00010000:3.0:1746129822.781711:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.781713:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781717:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e43955767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.781744:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858a00/0x48868a4e43955759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.781753:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.781758:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.781760:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129822.781762:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859400, rc 0) 00000100:00100000:3.0:1746129822.781789:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31664:x1830949054430208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6629us (6786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.781794:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11062 00000100:00100000:0.0:1746129822.786355:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.786386:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.786943:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.787667:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054430976 00000100:00100000:1.0:1746129822.787667:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054431104 00000100:00100000:3.0:1746129822.787674:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054430976 00000100:00100000:1.0:1746129822.787674:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054431104 00000100:00100000:3.0:1746129822.788055:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054431360 00000100:00100000:3.0:1746129822.788058:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054431360 00000100:00100000:3.0:1746129822.788074:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15592 00000100:00100000:3.0:1746129822.788081:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054431104:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.788105:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.788119:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f859a00/0x48868a4e43955775 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562ca expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.788144:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15593 00000100:00100000:0.0:1746129822.788152:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054430976:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129822.788159:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.788167:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562c3 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.788176:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054050560:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129822.788176:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.788178:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.788184:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.788196:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.788204:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093360e00, rc 0) 00000100:00100000:0.0:1746129822.788228:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054430976:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 77us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.788233:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15593 00000100:00100000:3.0:1746129822.788234:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.788249:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15594 00000100:00100000:0.0:1746129822.788254:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054431360:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129822.788259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:0.0:1746129822.788259:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.788264:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562d8 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.788273:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129822.788274:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054431616 00010000:00010000:0.0:1746129822.788275:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129822.788276:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054431616 00010000:00010000:0.0:1746129822.788278:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129822.788291:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15595 00010000:00010000:0.0:1746129822.788291:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129822.788295:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054431616:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129822.788298:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093361a00, rc 0) 00010000:00010000:3.0:1746129822.788299:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.788305:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e4395578a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562e6 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.788310:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054431360:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 57us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.788314:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15594 00000100:00100000:3.0:1746129822.788323:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054050688:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.788335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.788340:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.788344:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054431232 00000100:00100000:0.0:1746129822.788347:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054431232 00000100:00100000:0.0:1746129822.788838:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15596 00000100:00100000:0.0:1746129822.788845:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054431232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129822.788867:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.788874:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093361600/0x48868a4e43955791 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562d1 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129822.788893:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095240700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054050816:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.788917:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.789037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.789069:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054431488 00000100:00100000:1.0:1746129822.789071:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054431488 00000100:00100000:1.0:1746129822.789101:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15597 00000100:00100000:1.0:1746129822.789105:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054431488:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129822.789111:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.789117:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562df expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.789126:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.789127:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.789131:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.789141:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.789148:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3400, rc 0) 00000100:00100000:1.0:1746129822.789162:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054431488:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.789170:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15597 00000100:00100000:2.0:1746129822.789437:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054430720:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8508us (8688us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.789444:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7011 00002000:00100000:2.0:1746129822.789452:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a645df80 x1830949054430720/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.789460:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645df80 with x1830949054430720 ext(2097152->3145727) 00002000:00010000:2.0:1746129822.789463:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645df80 00002000:00010000:1.0:1746129822.791141:0:3624:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129822 -> 1746129823 00002000:00010000:1.0:1746129822.791157:0:3624:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129822 -> 1746129823 00002000:00010000:1.0:1746129822.791158:0:3624:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129822 -> 1746129823 00000100:00100000:1.0:1746129822.791174:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095240700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054050816:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.791196:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093361600/0x48868a4e43955791 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d1 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.791211:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093361600/0x48868a4e43955791 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d1 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.791236:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093361600, rc 0) 00000100:00100000:2.0:1746129822.791248:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054050560:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129822.791265:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f859a00/0x48868a4e43955775 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ca expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129822.791267:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054431232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2423us (2930us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.791273:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15596 00010000:00010000:2.0:1746129822.791274:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f859a00/0x48868a4e43955775 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ca expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.791286:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859a00, rc 0) 00000100:00100000:2.0:1746129822.791303:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054431104:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3223us (4916us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.791308:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15592 00000100:00100000:3.0:1746129822.791401:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054050688:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.791419:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e4395578a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562e6 expref: 6 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.791426:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa01000/0x48868a4e4395578a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562e6 expref: 6 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.791448:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01000, rc 0) 00000100:00100000:3.0:1746129822.791467:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054431616:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3172us (3207us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.791475:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15595 00000100:00100000:0.0:1746129822.794290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.794506:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054431744 00000100:00100000:3.0:1746129822.794514:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054431744 00000100:00100000:3.0:1746129822.794597:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15598 00000100:00100000:3.0:1746129822.794604:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31661:x1830949054431744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.794616:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.794628:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562ed expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.794652:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.794659:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.794661:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.794663:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.794692:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.794702:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 29 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.794713:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054050944:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.794794:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.796681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.796706:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432000 00000100:00100000:2.0:1746129822.796718:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432000 00000100:00100000:2.0:1746129822.796766:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11063 00000100:00100000:2.0:1746129822.796777:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31664:x1830949054432000:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129822.796792:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.796805:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e439557a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562f4 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.796910:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.796922:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.796928:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.796953:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.796962:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 12 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.796970:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054051072:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.797037:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.797141:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054050944:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.797163:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 18 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.797174:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00a00, rc 0) 00000100:00100000:3.0:1746129822.797195:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31661:x1830949054431744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2592us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.797201:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15598 00000100:00100000:0.0:1746129822.797804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.797889:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432128 00000100:00100000:2.0:1746129822.797893:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432128 00002000:00100000:2.0:1746129822.797914:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3543039) req@ffff880095240700 x1830949054432128/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.797922:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240700 with x1830949054432128 ext(3145728->3543039) 00010000:00010000:2.0:1746129822.797991:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 30 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.798006:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 30 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.798012:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240700 00000100:00100000:2.0:1746129822.798170:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1892 00000100:00100000:2.0:1746129822.798177:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054432128:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.801661:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054051072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.801681:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129822.802262:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.802881:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432256 00000100:00100000:1.0:1746129822.802887:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432256 00010000:00010000:1.0:1746129822.802917:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 13 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746129822.802942:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7803 00000100:00100000:1.0:1746129822.802948:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1962:x1830949054432256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.802959:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.802963:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 13 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.802976:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 13 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.802993:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e4395576e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562bc expref: 13 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.803020:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129822.803025:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.803032:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.803038:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129822.803057:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129822.803061:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.803067:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.803082:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:1.0:1746129822.803100:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054432256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 153us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.803106:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7803 00010000:00010000:3.0:1746129822.803278:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e439557a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.803303:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.803309:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.803311:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129822.803313:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05600, rc 0) 00000100:00100000:3.0:1746129822.803769:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31664:x1830949054432000:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 6996us (7093us total) trans 8589945084 rc 0/0 00000100:00100000:3.0:1746129822.803778:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11063 00000100:00100000:3.0:1746129822.806117:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054432128:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7933us (8307us total) trans 17179874136 rc 0/0 00000100:00100000:3.0:1746129822.806126:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1892 00002000:00100000:3.0:1746129822.806134:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3543039) req@ffff880095240700 x1830949054432128/t17179874136(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.806142:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240700 with x1830949054432128 ext(3145728->3543039) 00010000:00010000:3.0:1746129822.806149:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.806162:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.806168:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095240700 00000100:00100000:1.0:1746129822.806587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.807093:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432384 00000100:00100000:3.0:1746129822.807099:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432384 00000100:00100000:3.0:1746129822.807138:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11064 00000100:00100000:3.0:1746129822.807148:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31664:x1830949054432384:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129822.807165:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.807178:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093abb800/0x48868a4e439557bb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3562fb expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.807238:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.807250:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.807257:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.807281:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.807290:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 13 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.807305:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054051200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.807552:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.811730:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.811752:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432640 00000100:00100000:0.0:1746129822.811758:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432640 00000100:00100000:0.0:1746129822.811791:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11065 00000100:00100000:0.0:1746129822.811798:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+312:31666:x1830949054432640:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129822.811815:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.811830:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e439557c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356302 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.811945:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.811956:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.811965:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.811976:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.811981:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.811986:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812076:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e439557de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812093:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e439557de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812100:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e439557de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:0.0:1746129822.812107:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129822.812181:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812188:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812193:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812198:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f859e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129822.812202:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812208:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812216:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129822.812220:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129822.812223:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812228:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859e00/0x48868a4e439557d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812256:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812261:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812265:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812269:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f858600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129822.812271:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812279:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812284:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880134a2da00) 00010000:00010000:0.0:1746129822.812286:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129822.812288:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812293:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858600/0x48868a4e439557d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129822.812322:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e439557c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356302 expref: 315 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.812332:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e439557de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356302 expref: 314 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.812338:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129822.812340:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746129822.812343:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.812348:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129822.812353:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859400, rc 0) 00000100:00100000:0.0:1746129822.812392:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+314:31666:x1830949054432640:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 594us (669us total) trans 8589945085 rc 0/0 00000100:00100000:0.0:1746129822.812398:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11065 00000100:00100000:3.0:1746129822.812595:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054051200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.812693:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129822.813727:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.813836:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432768 00000100:00100000:3.0:1746129822.813840:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432768 00010000:00010000:3.0:1746129822.813879:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 14 pid: 14313 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.814758:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7804 00000100:00100000:3.0:1746129822.814766:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1963:x1830949054432768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.814777:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.814783:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 14 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.814792:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 14 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.814810:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05600/0x48868a4e439557ad lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562f4 expref: 14 pid: 14313 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.814877:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.814882:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.814891:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.814897:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.814924:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129822.814951:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.814956:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129822.814959:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054432768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 195us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.814964:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7804 00000004:00200000:2.0:1746129822.814985:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129822.814989:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129822.814999:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.815022:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093abb800/0x48868a4e439557bb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.815036:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.815041:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.815049:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129822.815051:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093abba00, rc 0) 00000100:00100000:2.0:1746129822.815075:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31664:x1830949054432384:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7931us (8488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.815080:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11064 00000100:00100000:0.0:1746129822.816576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.816642:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054432896 00000100:00100000:3.0:1746129822.816649:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054432896 00010000:00010000:3.0:1746129822.816670:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746129822.816807:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.817012:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054433024 00000100:00100000:3.0:1746129822.817016:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054433024 00000100:00100000:3.0:1746129822.817035:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7805 00000100:00100000:3.0:1746129822.817041:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054432896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129822.817063:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 740 00000100:00100000:1.0:1746129822.817069:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+314:1964:x1830949054433024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.817078:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.817102:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859400/0x48868a4e439557de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356302 expref: 314 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.817126:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129822.817130:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129822.817231:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.817250:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.817261:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.817274:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3e00/0x48868a4e439556aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3543039) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356261 expref: 32 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.817284:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.817285:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.817291:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.817298:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.817323:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.817333:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054051328:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.817397:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.817454:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:1964:x1830949054433024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 88us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.817460:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 740 00000100:00100000:0.0:1746129822.819278:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.819301:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.819318:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.819348:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054433152 00000100:00100000:2.0:1746129822.819354:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054433152 00000100:00100000:2.0:1746129822.819380:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054433280 00000100:00100000:2.0:1746129822.819382:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054433280 00000100:00100000:2.0:1746129822.819391:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054433408 00000100:00100000:2.0:1746129822.819392:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054433408 00000100:00100000:2.0:1746129822.819406:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15599 00000100:00100000:2.0:1746129822.819412:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054433152:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:1.0:1746129822.819412:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15600 00000100:00100000:1.0:1746129822.819417:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054433280:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129822.819428:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129822.819432:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15601 00000100:00100000:3.0:1746129822.819441:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054433408:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129822.819441:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e439557ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356309 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.819448:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.819455:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356317 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.819470:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.819471:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.819477:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129822.819478:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054051456:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.819490:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.819498:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02de200, rc 0) 00000100:00100000:3.0:1746129822.819519:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054433408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 80us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.819521:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.819581:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15601 00010000:00010000:1.0:1746129822.819587:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.819594:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e439557fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356310 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.819612:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054051328:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.819615:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054051584:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.819626:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.819634:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.819642:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1964:x1830949054432896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2601us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.819648:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7805 00000100:00100000:0.0:1746129822.820548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.820566:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054433664 00000100:00100000:2.0:1746129822.820569:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054433664 00000100:00100000:3.0:1746129822.820593:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054051456:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129822.820593:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11066 00000100:00100000:2.0:1746129822.820599:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+313:31669:x1830949054433664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.820605:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e439557ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356309 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.820611:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04e00/0x48868a4e439557ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356309 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.820611:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.820617:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04e00, rc 0) 00010000:00010000:2.0:1746129822.820620:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04000/0x48868a4e43955801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35631e expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.820644:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054433152:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1232us (1371us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.820649:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15599 00010000:00010000:2.0:1746129822.820701:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820711:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820722:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820733:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820739:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820743:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820831:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820839:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820844:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129822.820874:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129822.820944:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820950:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820955:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820960:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.820964:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820970:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820977:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129822.820979:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.820982:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820986:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04600/0x48868a4e43955808 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820992:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.820996:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.821001:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.821004:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.821006:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.821011:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.821015:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8e00) 00010000:00010000:2.0:1746129822.821017:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129822.821019:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.821023:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04800/0x48868a4e4395580f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.821052:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04000/0x48868a4e43955801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 316 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.821060:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 315 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.821065:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.821067:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129822.821068:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05c00, rc 0) 00000100:00100000:2.0:1746129822.821083:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+315:31669:x1830949054433664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 485us (537us total) trans 8589945086 rc 0/0 00000100:00100000:2.0:1746129822.821099:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11066 00000100:00100000:1.0:1746129822.821321:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054051584:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129822.821335:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e439557fa lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356310 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.821344:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e439557fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356310 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.821351:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3c00, rc 0) 00000100:00100000:1.0:1746129822.821367:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054433280:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1949us (2064us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129822.821371:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15600 00000100:00100000:0.0:1746129822.822547:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.822607:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054433920 00000100:00100000:2.0:1746129822.822612:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054433920 00000100:00100000:2.0:1746129822.822642:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11067 00000100:00100000:2.0:1746129822.822647:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31664:x1830949054433920:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129822.822657:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.822664:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43955824 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356325 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.822718:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.822726:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.822732:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129822.822786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.822809:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054434048 00000100:00100000:1.0:1746129822.822810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.822812:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054434048 00000100:00100000:0.0:1746129822.822828:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054434176 00000100:00100000:0.0:1746129822.822830:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054434176 00000100:00100000:0.0:1746129822.822874:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15602 00000100:00100000:3.0:1746129822.822879:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15603 00000100:00100000:1.0:1746129822.822881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.822881:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054434048:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129822.822886:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054434176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129822.822888:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.822892:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129822.822894:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054434304 00010000:00010000:0.0:1746129822.822895:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f859e00/0x48868a4e43955832 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35632c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.822896:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054434304 00010000:00010000:3.0:1746129822.822897:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02de000/0x48868a4e43955839 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356333 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.822918:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15604 00000100:00100000:3.0:1746129822.822919:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054051712:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129822.822920:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009be65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054051840:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129822.822922:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054434304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129822.822928:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129822.822935:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35633a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.822948:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.822950:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129822.822951:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129822.822955:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 23 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.822965:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 23 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129822.822972:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3a00, rc 0) 00000100:00100000:1.0:1746129822.823029:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054434304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 105us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.823029:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129822.823034:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15604 00010000:00010000:2.0:1746129822.823098:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823104:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823109:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823113:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129822.823116:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823166:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823174:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129822.823176:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129822.823179:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823187:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395582b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129822.823207:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43955824 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356325 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.823213:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43955824 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356325 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.823219:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04400, rc 0) 00000100:00100000:2.0:1746129822.823248:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31664:x1830949054433920:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 601us (703us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129822.823252:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11067 00000100:00100000:0.0:1746129822.823761:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.823820:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054434432 00000100:00100000:2.0:1746129822.823823:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054434432 00000100:00100000:2.0:1746129822.823837:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15605 00000100:00100000:2.0:1746129822.823841:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054434432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129822.823861:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.823868:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356341 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.823878:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.823879:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.823884:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 36 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.823892:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 36 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.823898:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05800, rc 0) 00000100:00100000:2.0:1746129822.824054:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054434432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 211us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.824059:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15605 00000100:00100000:0.0:1746129822.825524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.825556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.825583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.825608:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054434816 00000100:00100000:1.0:1746129822.825613:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054434816 00000100:00100000:0.0:1746129822.825670:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009be65180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054051840:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129822.825692:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f859e00/0x48868a4e43955832 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35632c expref: 35 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.825705:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f859e00/0x48868a4e43955832 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35632c expref: 35 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.825717:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859e00, rc 0) 00000100:00100000:0.0:1746129822.825740:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054434048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2860us (2954us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129822.825746:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15602 00000100:00100000:3.0:1746129822.825865:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054051712:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.825885:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02de000/0x48868a4e43955839 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356333 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129822.825890:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054434944 00010000:00010000:3.0:1746129822.825893:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de000/0x48868a4e43955839 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356333 expref: 33 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129822.825894:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054434944 00010000:00010000:3.0:1746129822.825900:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02de000, rc 0) 00002000:00100000:2.0:1746129822.825912:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009be65500 x1830949054434944/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.825924:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65500 with x1830949054434944 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.825928:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65500 00000100:00100000:3.0:1746129822.825933:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054434176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3046us (3120us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.825938:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15603 00000100:00100000:2.0:1746129822.825939:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054435200 00000100:00100000:2.0:1746129822.825942:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054435200 00002000:00100000:2.0:1746129822.825953:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009be65c00 x1830949054435200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.825958:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65c00 with x1830949054435200 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.825961:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be65c00 00000100:00100000:2.0:1746129822.825994:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7012 00000100:00100000:2.0:1746129822.826000:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054434944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129822.826000:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7013 00002000:00100000:1.0:1746129822.826003:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009be64380 x1830949054434816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129822.826006:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054435200:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:1.0:1746129822.826009:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64380 with x1830949054434816 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.826012:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be64380 00000100:00100000:3.0:1746129822.826029:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7014 00000100:00100000:3.0:1746129822.826033:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054434816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129822.827039:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.827058:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054435456 00000100:00100000:0.0:1746129822.827061:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054435456 00000100:00100000:0.0:1746129822.827105:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4636 00000100:00100000:0.0:1746129822.827111:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31664:x1830949054435456:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:0.0:1746129822.827241:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d63050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31664:x1830949054435456:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 130us (204us total) trans 8589945087 rc 0/0 00000100:00100000:0.0:1746129822.827248:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4636 00000100:00100000:0.0:1746129822.832993:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.833994:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054435584 00000100:00100000:3.0:1746129822.834007:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054435584 00000100:00100000:3.0:1746129822.834058:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15606 00000100:00100000:3.0:1746129822.834065:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31669:x1830949054435584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.834081:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.834110:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356348 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.834138:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.834144:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.834145:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.834148:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.834174:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 21 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.834184:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 21 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.834195:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054051968:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.834280:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.840130:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054434944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14121us (14565us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.840140:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7012 00002000:00100000:2.0:1746129822.840150:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009be65500 x1830949054434944/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.840158:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65500 with x1830949054434944 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.840163:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65500 00000100:00100000:3.0:1746129822.845037:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054051968:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.845073:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.845112:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02de600, rc 0) 00000100:00100000:3.0:1746129822.845173:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31669:x1830949054435584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11106us (12186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.845182:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15606 00000100:00100000:0.0:1746129822.845455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.845570:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054435712 00000100:00100000:3.0:1746129822.845575:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054435712 00002000:00100000:3.0:1746129822.845600:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1691648->2097151) req@ffff88009be66a00 x1830949054435712/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.845607:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66a00 with x1830949054435712 ext(1691648->2097151) 00010000:00010000:3.0:1746129822.845613:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.845622:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746129822.845627:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be66a00 00000100:00100000:2.0:1746129822.845827:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054435200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19820us (20241us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.845833:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7013 00002000:00100000:2.0:1746129822.845838:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009be65c00 x1830949054435200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.845844:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65c00 with x1830949054435200 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.845864:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be65c00 00000100:00100000:2.0:1746129822.845875:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1893 00000100:00100000:2.0:1746129822.845880:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054435712:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.847958:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054434816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21918us (22432us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129822.847966:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7014 00002000:00100000:3.0:1746129822.847974:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009be64380 x1830949054434816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.847982:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64380 with x1830949054434816 ext(2097152->3145727) 00002000:00010000:3.0:1746129822.847985:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be64380 00000100:00100000:2.0:1746129822.852782:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054435712:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6894us (7321us total) trans 17179874137 rc 0/0 00000100:00100000:2.0:1746129822.852793:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1893 00002000:00100000:2.0:1746129822.852802:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1691648->2097151) req@ffff88009be66a00 x1830949054435712/t17179874137(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.852810:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66a00 with x1830949054435712 ext(1691648->2097151) 00010000:00010000:2.0:1746129822.852819:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.852833:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.852838:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009be66a00 00000100:00100000:0.0:1746129822.856578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.856700:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054435840 00000100:00100000:3.0:1746129822.856708:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054435840 00000100:00100000:3.0:1746129822.856770:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15607 00000100:00100000:3.0:1746129822.856776:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054435840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.856789:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.856802:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02dea00/0x48868a4e43955855 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35634f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.856842:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054052096:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.857306:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.857615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.857656:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054435968 00000100:00100000:3.0:1746129822.857659:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054435968 00010000:00010000:3.0:1746129822.857675:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.857701:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7806 00000100:00100000:3.0:1746129822.857707:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054435968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.857714:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.857731:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.857742:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.857762:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.857764:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.857771:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.857782:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.857802:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.857811:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054052224:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.857863:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.861762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129822.861821:0:8437:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88009a04c000 x1830949054052096) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746129822.861874:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c68400/0x48868a4e439556fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1691648->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35627d expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.861903:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054052096:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.861930:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02dea00/0x48868a4e43955855 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35634f expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.861940:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dea00/0x48868a4e43955855 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35634f expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.861947:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02dea00, rc 0) 00000100:00100000:2.0:1746129822.862020:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054052224:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.862031:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.862063:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054435968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4355us (4448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.862071:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7806 00000100:00100000:1.0:1746129822.862340:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054436224 00000100:00100000:1.0:1746129822.862346:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054436224 00002000:00100000:1.0:1746129822.862372:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009be65f80 x1830949054436224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.862380:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65f80 with x1830949054436224 ext(1048576->2097151) 00002000:00010000:1.0:1746129822.862383:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65f80 00000100:00100000:1.0:1746129822.862397:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7015 00000100:00100000:1.0:1746129822.862402:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054436224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129822.862458:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054435840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5682us (5888us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.862466:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15607 00000100:00100000:3.0:1746129822.866251:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.866606:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054436480 00000100:00100000:2.0:1746129822.866614:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054436480 00002000:00100000:2.0:1746129822.866646:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009a04c000 x1830949054436480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.866660:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c000 with x1830949054436480 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.866665:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04c000 00000100:00100000:2.0:1746129822.866694:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7016 00000100:00100000:2.0:1746129822.866701:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054436480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129822.871796:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054436224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9384us (10033us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129822.871811:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7015 00002000:00100000:0.0:1746129822.871821:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009be65f80 x1830949054436224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129822.871829:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65f80 with x1830949054436224 ext(1048576->2097151) 00002000:00010000:0.0:1746129822.871835:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be65f80 00000100:00100000:2.0:1746129822.874997:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054436480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8289us (8744us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129822.875008:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7016 00002000:00100000:2.0:1746129822.875017:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009a04c000 x1830949054436480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.875024:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c000 with x1830949054436480 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.875029:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04c000 00000100:00100000:0.0:1746129822.877102:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.877216:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054436608 00000100:00100000:3.0:1746129822.877223:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054436608 00000100:00100000:3.0:1746129822.877253:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15608 00000100:00100000:3.0:1746129822.877258:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31669:x1830949054436608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.877271:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.877284:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356356 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.877305:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.877311:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.877312:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129822.877315:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.877334:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.877343:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 18 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746129822.877352:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054052352:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.877413:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.877581:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.877670:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054436736 00000100:00100000:0.0:1746129822.877673:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054436736 00000100:00100000:0.0:1746129822.877693:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15609 00000100:00100000:0.0:1746129822.877698:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054436736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129822.877710:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.877717:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35635d expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.877729:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.877731:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.877737:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.877753:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 20 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.877762:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009510c400, rc 0) 00000100:00100000:0.0:1746129822.877787:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054436736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.877792:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15609 00000100:00100000:3.0:1746129822.878522:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054052352:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.878537:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.878546:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02dee00, rc 0) 00000100:00100000:3.0:1746129822.878579:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31669:x1830949054436608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1320us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.878584:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15608 00000100:00100000:0.0:1746129822.879161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.879184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.879202:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054436864 00000100:00100000:2.0:1746129822.879206:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054436864 00002000:00100000:2.0:1746129822.879229:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1155071) req@ffff880094d8ce00 x1830949054436864/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.879237:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ce00 with x1830949054436864 ext(1048576->1155071) 00010000:00010000:2.0:1746129822.879243:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.879253:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 20 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.879258:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8ce00 00000100:00100000:2.0:1746129822.879278:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1894 00000100:00100000:2.0:1746129822.879283:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054436864:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129822.879310:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054436992 00000100:00100000:3.0:1746129822.879313:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054436992 00000100:00100000:3.0:1746129822.879333:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15610 00000100:00100000:3.0:1746129822.879338:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054436992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.879344:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.879350:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02df600/0x48868a4e4395586a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356364 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.879371:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054052480:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.879502:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.880963:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054052480:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.880978:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02df600/0x48868a4e4395586a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356364 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.880987:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02df600/0x48868a4e4395586a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356364 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.881004:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02df600, rc 0) 00000100:00100000:3.0:1746129822.881026:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054436992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1687us (1840us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.881031:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15610 00000100:00100000:2.0:1746129822.881610:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054436864:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2325us (2448us total) trans 17179874138 rc 0/0 00000100:00100000:2.0:1746129822.881616:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1894 00002000:00100000:2.0:1746129822.881622:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1155071) req@ffff880094d8ce00 x1830949054436864/t17179874138(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:563/0 lens 488/448 e 0 to 0 dl 1746129833 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.881629:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ce00 with x1830949054436864 ext(1048576->1155071) 00010000:00010000:2.0:1746129822.881634:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.881643:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746129822.881648:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8ce00 00000100:00100000:1.0:1746129822.885881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.886233:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054437120 00000100:00100000:2.0:1746129822.886241:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054437120 00010000:00010000:2.0:1746129822.886271:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746129822.886295:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7807 00000100:00100000:2.0:1746129822.886302:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054437120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129822.886314:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.886332:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.886348:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.886368:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091c68e00/0x48868a4e4395573d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562a0 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746129822.886396:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.886398:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.886405:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.886412:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.886521:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129822.886533:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054052608:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129822.886610:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.889050:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054052608:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129822.889068:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129822.889331:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054437120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3018us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.889340:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7807 00000100:00100000:0.0:1746129822.892229:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.892295:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054437376 00000100:00100000:2.0:1746129822.892305:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054437376 00002000:00100000:2.0:1746129822.892347:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094d8e300 x1830949054437376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.892356:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e300 with x1830949054437376 ext(1048576->2097151) 00002000:00010000:2.0:1746129822.892361:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8e300 00000100:00100000:2.0:1746129822.892390:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7017 00000100:00100000:2.0:1746129822.892397:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054437376:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129822.905750:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054437376:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13343us (13520us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.905762:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7017 00002000:00100000:2.0:1746129822.905772:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880094d8e300 x1830949054437376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.905781:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8e300 with x1830949054437376 ext(1048576->2097151) 00002000:00010000:2.0:1746129822.905786:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8e300 00000100:00100000:0.0:1746129822.916641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.917327:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054437504 00000100:00100000:3.0:1746129822.917338:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054437504 00000100:00100000:0.0:1746129822.917410:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15611 00000100:00100000:0.0:1746129822.917418:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31666:x1830949054437504:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129822.917434:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129822.917448:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35636b expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.917473:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.917481:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.917487:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.917492:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.917494:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129822.917497:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1974272->2097151] (req 1974272->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.917520:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 24 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.917531:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 24 pid: 4589 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746129822.917541:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054052736:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129822.918168:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 7 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129822.918176:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 7 pid: 3624 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746129822.918184:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054052864:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129822.918228:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 22 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129822.918236:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 22 pid: 4589 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746129822.918244:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054052992:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129822.918522:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.919899:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054052736:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.919909:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054052864:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.919915:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054052992:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129822.919950:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1974272->2097151] (req 1974272->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.919962:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538ba00, rc 0) 00000100:00100000:2.0:1746129822.920007:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31666:x1830949054437504:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2590us (3374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.920016:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15611 00000100:00100000:0.0:1746129822.924234:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.924271:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.924300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.924329:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.924331:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054437632 00000100:00100000:1.0:1746129822.924339:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054437632 00000100:00100000:0.0:1746129822.924356:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129822.924369:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 24 pid: 4589 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746129822.924374:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054438144 00000100:00100000:0.0:1746129822.924377:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054438144 00000100:00100000:1.0:1746129822.924393:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054437888 00000100:00100000:1.0:1746129822.924395:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054437888 00010000:00010000:1.0:1746129822.924404:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00002000:00100000:0.0:1746129822.924405:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094d8d880 x1830949054438144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129822.924414:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054437760 00000100:00100000:1.0:1746129822.924416:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054437760 00002000:00100000:0.0:1746129822.924421:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d880 with x1830949054438144 ext(2097152->3145727) 00010000:00010000:1.0:1746129822.924423:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 8 pid: 3624 timeout: 868 lvb_type: 1 00002000:00010000:0.0:1746129822.924425:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8d880 00000100:00100000:1.0:1746129822.924434:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7808 00000100:00100000:0.0:1746129822.924438:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054438400 00000100:00100000:1.0:1746129822.924440:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054437632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129822.924440:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054438400 00010000:00010000:1.0:1746129822.924451:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.924469:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 25 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.924478:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 25 pid: 4589 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.924495:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c2800/0x48868a4e439556d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35626f expref: 26 pid: 4589 timeout: 868 lvb_type: 1 00002000:00100000:0.0:1746129822.924504:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094d8ea00 x1830949054438400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746129822.924510:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746129822.924510:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ea00 with x1830949054438400 ext(3145728->4194303) 00002000:00010000:0.0:1746129822.924513:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8ea00 00000100:00100000:0.0:1746129822.924525:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7018 00000100:00100000:0.0:1746129822.924530:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054438144:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.924542:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054437632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 102us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.924547:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7808 00000100:00100000:1.0:1746129822.924560:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7809 00000100:00100000:1.0:1746129822.924564:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054437888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.924570:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.924577:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.924583:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.924593:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04c00/0x48868a4e43955641 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356230 expref: 23 pid: 4589 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746129822.924600:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.924612:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054437888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 48us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.924620:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7809 00000100:00100000:1.0:1746129822.924627:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7810 00000100:00100000:1.0:1746129822.924631:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054437760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.924636:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.924642:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 8 pid: 3624 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.924650:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 8 pid: 3624 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.924661:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955783 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562d8 expref: 8 pid: 3624 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746129822.924668:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.924670:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.924676:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.924682:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.924710:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.924720:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054053120:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.924772:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129822.925012:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7019 00000100:00100000:2.0:1746129822.925019:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054438400:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.926064:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.926115:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054438656 00000100:00100000:3.0:1746129822.926120:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054438656 00000100:00100000:1.0:1746129822.926133:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129822.926141:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a5492d80 x1830949054438656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.926149:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492d80 with x1830949054438656 ext(2097152->3145727) 00002000:00010000:3.0:1746129822.926153:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5492d80 00000100:00100000:3.0:1746129822.926176:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054438912 00000100:00100000:3.0:1746129822.926178:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054438912 00002000:00100000:3.0:1746129822.926188:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a5491f80 x1830949054438912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.926194:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491f80 with x1830949054438912 ext(3145728->4194303) 00002000:00010000:3.0:1746129822.926196:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491f80 00000100:00100000:3.0:1746129822.926216:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7020 00000100:00100000:3.0:1746129822.926221:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054438656:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.926404:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7021 00000100:00100000:1.0:1746129822.926411:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054438912:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129822.927675:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054053120:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129822.927691:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129822.927712:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054437760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3079us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.927719:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7810 00000100:00100000:3.0:1746129822.927815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.927990:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054439168 00000100:00100000:0.0:1746129822.927994:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054439168 00002000:00100000:0.0:1746129822.928012:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1974272->1978367) req@ffff88009a04f480 x1830949054439168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129822.928019:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f480 with x1830949054439168 ext(1974272->1978367) 00002000:00010000:0.0:1746129822.928022:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04f480 00000100:00100000:0.0:1746129822.928034:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7022 00000100:00100000:0.0:1746129822.928038:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054439168:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129822.928131:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054439168:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 91us (315us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129822.928137:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7022 00002000:00100000:0.0:1746129822.928141:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1974272->1978367) req@ffff88009a04f480 x1830949054439168/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129822.928229:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04f480 with x1830949054439168 ext(1974272->1978367) 00002000:00010000:0.0:1746129822.928232:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a04f480 00000100:00100000:2.0:1746129822.938028:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054438400:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12996us (13658us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.938039:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7019 00002000:00100000:2.0:1746129822.938050:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094d8ea00 x1830949054438400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.938059:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ea00 with x1830949054438400 ext(3145728->4194303) 00002000:00010000:2.0:1746129822.938064:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8ea00 00000100:00100000:1.0:1746129822.939128:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054438144:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14594us (14795us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.939135:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7018 00002000:00100000:1.0:1746129822.939141:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094d8d880 x1830949054438144/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.939147:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d880 with x1830949054438144 ext(2097152->3145727) 00002000:00010000:1.0:1746129822.939150:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8d880 00000100:00100000:2.0:1746129822.943969:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054438656:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17737us (17897us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129822.943982:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7020 00002000:00100000:2.0:1746129822.943991:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a5492d80 x1830949054438656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.943999:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492d80 with x1830949054438656 ext(2097152->3145727) 00002000:00010000:2.0:1746129822.944005:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5492d80 00000100:00100000:1.0:1746129822.945841:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054438912:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19422us (19699us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129822.945880:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7021 00002000:00100000:1.0:1746129822.945892:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a5491f80 x1830949054438912/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.945900:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491f80 with x1830949054438912 ext(3145728->4194303) 00002000:00010000:1.0:1746129822.945905:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5491f80 00000100:00100000:0.0:1746129822.951392:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.951548:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054439296 00000100:00100000:2.0:1746129822.951557:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054439296 00000100:00100000:2.0:1746129822.951657:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15612 00000100:00100000:2.0:1746129822.951664:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31666:x1830949054439296:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129822.951679:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129822.951694:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356372 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.951720:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.951727:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.951733:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 6 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.951738:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.951740:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129822.951743:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->2727935] (req 2097152->2727935) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.951768:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 6 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.951779:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 6 pid: 4589 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129822.951790:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053248:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129822.951984:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129822.951992:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 24 pid: 7975 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129822.952044:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053376:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129822.952234:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.952490:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 21 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129822.952499:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053504:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.952535:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.959952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.960240:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054439552 00000100:00100000:3.0:1746129822.960248:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054439552 00010000:00010000:3.0:1746129822.960279:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 25 pid: 7975 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129822.960304:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7811 00000100:00100000:3.0:1746129822.960311:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054439552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129822.960313:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053248:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.960322:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129822.960333:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053376:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.960340:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053504:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.960341:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 25 pid: 7975 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129822.960350:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 25 pid: 7975 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129822.960915:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955840 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35633a expref: 25 pid: 7975 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129822.961036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.961089:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054439424 00000100:00100000:0.0:1746129822.961093:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054439424 00010000:00010000:0.0:1746129822.961107:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 7 pid: 4589 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746129822.961124:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7812 00000100:00100000:0.0:1746129822.961130:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054439424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129822.961136:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129822.961473:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->2727935] (req 2097152->2727935) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129822.961518:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859200, rc 0) 00000100:00100000:2.0:1746129822.961611:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31666:x1830949054439296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9947us (10224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129822.961636:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15612 00010000:00010000:3.0:1746129822.962580:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129822.962586:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 7 pid: 4589 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129822.962596:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 7 pid: 4589 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129822.962612:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3400/0x48868a4e43955798 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562df expref: 7 pid: 4589 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129822.962615:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054439552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2303us (2767us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.962622:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7811 00010000:00010000:0.0:1746129822.962633:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129822.962651:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054439424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1521us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.962656:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7812 00000100:00100000:0.0:1746129822.967206:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.967238:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.967476:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054440064 00000100:00100000:3.0:1746129822.967485:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054440064 00000100:00100000:3.0:1746129822.967531:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11068 00000100:00100000:3.0:1746129822.967538:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+41:31674:x1830949054440064:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.967557:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.967572:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02dea00/0x48868a4e4395587f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356380 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.967670:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967682:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967693:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967706:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967711:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967716:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967806:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967814:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967820:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129822.967826:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129822.967923:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967929:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967937:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967942:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02df000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.967945:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967950:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967959:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129822.967962:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.967965:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967969:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df000/0x48868a4e43955886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967982:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967986:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967990:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.967994:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a02df200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129822.967996:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.968000:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.968008:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244400) 00010000:00010000:3.0:1746129822.968010:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129822.968012:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.968015:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df200/0x48868a4e4395588d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129822.968045:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02dea00/0x48868a4e4395587f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 44 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.968055:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 43 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.968060:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129822.968062:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129822.968064:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02df400, rc 0) 00000100:00100000:3.0:1746129822.968116:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+43:31674:x1830949054440064:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 579us (918us total) trans 8589945088 rc 0/0 00000100:00100000:3.0:1746129822.968123:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11068 00000100:00100000:0.0:1746129822.968295:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.968490:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054439680 00000100:00100000:1.0:1746129822.968495:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054439680 00010000:00010000:1.0:1746129822.968512:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129822.968529:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7813 00000100:00100000:1.0:1746129822.968535:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054439680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.968543:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.968555:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129822.968564:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129822.968576:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f858200/0x48868a4e43955752 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562b5 expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129822.968594:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.968595:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129822.968601:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.968607:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129822.968629:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129822.968640:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054053632:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129822.968687:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.969357:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054439808 00000100:00100000:3.0:1746129822.969361:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054439808 00000100:00100000:3.0:1746129822.970232:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15613 00000100:00100000:3.0:1746129822.970240:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054439808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.970251:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.970260:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a02de000/0x48868a4e439558a2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356379 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.970294:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053760:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.971419:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.971628:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054053632:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129822.971641:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129822.972005:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054439680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3468us (4764us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129822.972014:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7813 00000100:00100000:0.0:1746129822.974200:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.974317:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054440320 00000100:00100000:1.0:1746129822.974325:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054440320 00002000:00100000:1.0:1746129822.974358:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2723840->2727935) req@ffff880094d8c380 x1830949054440320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.974368:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c380 with x1830949054440320 ext(2723840->2727935) 00002000:00010000:1.0:1746129822.974372:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8c380 00000100:00100000:1.0:1746129822.974490:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7023 00000100:00100000:1.0:1746129822.974497:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054440320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129822.974653:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054440320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 156us (457us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129822.974659:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7023 00002000:00100000:1.0:1746129822.974664:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2723840->2727935) req@ffff880094d8c380 x1830949054440320/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/4536 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129822.974671:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c380 with x1830949054440320 ext(2723840->2727935) 00002000:00010000:1.0:1746129822.974675:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8c380 00000100:00100000:3.0:1746129822.975176:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054053760:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129822.975198:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a02de000/0x48868a4e439558a2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356379 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.975209:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a02de000/0x48868a4e439558a2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356379 expref: 24 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.975218:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02de000, rc 0) 00000100:00100000:3.0:1746129822.975236:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054439808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4998us (6942us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129822.975241:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15613 00000100:00100000:0.0:1746129822.982543:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.982656:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054440448 00000100:00100000:3.0:1746129822.982665:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054440448 00000100:00100000:3.0:1746129822.982700:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15614 00000100:00100000:3.0:1746129822.982706:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31674:x1830949054440448:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129822.982721:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.982735:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356387 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.982759:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.982771:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.982777:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 5 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129822.983297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129822.983359:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054440832 00000100:00100000:2.0:1746129822.983364:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054440832 00000100:00100000:2.0:1746129822.983401:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4637 00000100:00100000:2.0:1746129822.983407:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+315:31666:x1830949054440832:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129822.983493:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129822.983622:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.983624:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.983628:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2764800->2936831] (req 2764800->2936831) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.983807:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 5 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.983818:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 5 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129822.983830:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054053888:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.983948:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+316:31666:x1830949054440832:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 540us (651us total) trans 8589945089 rc 0/0 00000100:00100000:2.0:1746129822.983955:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4637 00000100:00100000:2.0:1746129822.983977:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054440960 00000100:00100000:2.0:1746129822.983980:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054440960 00002000:00100000:2.0:1746129822.984000:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a8fd3800 x1830949054440960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/0 e 0 to 0 dl 1746129833 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129822.984008:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3800 with x1830949054440960 ext(4194304->4931583) 00002000:00010000:2.0:1746129822.984011:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd3800 00010000:00010000:3.0:1746129822.984013:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129822.984021:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 33 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129822.984024:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7024 00000100:00100000:3.0:1746129822.984028:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129822.984030:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054440960:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129822.984053:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.984060:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129822.984066:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054144:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.984081:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129822.987400:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054053888:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.987453:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054016:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129822.989310:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054144:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129822.989340:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2764800->2936831] (req 2764800->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.989355:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02dec00, rc 0) 00000100:00100000:3.0:1746129822.989575:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31674:x1830949054440448:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6867us (7038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129822.989583:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15614 00000100:00100000:0.0:1746129822.991193:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129822.991228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129822.992458:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054441216 00000100:00100000:1.0:1746129822.992466:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054441216 00010000:00010000:1.0:1746129822.992494:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 6 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129822.992515:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054441344 00000100:00100000:1.0:1746129822.992517:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054441344 00010000:00010000:1.0:1746129822.992526:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 34 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129822.992538:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7814 00000100:00100000:1.0:1746129822.992543:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054441216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.992553:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.992571:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 6 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129822.992580:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 6 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129822.992598:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de200/0x48868a4e439557f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356317 expref: 6 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129822.992612:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.992657:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054441216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 114us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.992661:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7814 00000100:00100000:1.0:1746129822.992673:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7815 00000100:00100000:1.0:1746129822.992676:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054441344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129822.992682:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129822.992688:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 34 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129822.992694:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 34 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129822.992703:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf05800/0x48868a4e43955847 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356341 expref: 34 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129822.992709:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129822.992720:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054441344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 44us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129822.992724:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7815 00000100:00100000:3.0:1746129822.994812:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054440960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10774us (11312us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129822.994821:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7024 00002000:00100000:3.0:1746129822.994828:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a8fd3800 x1830949054440960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:563/0 lens 488/440 e 0 to 0 dl 1746129833 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129822.994836:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd3800 with x1830949054440960 ext(4194304->4931583) 00002000:00010000:3.0:1746129822.994841:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a8fd3800 00000100:00100000:0.0:1746129822.996885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.996954:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054441472 00000100:00100000:3.0:1746129822.996960:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054441472 00010000:00010000:3.0:1746129822.996987:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129822.997011:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7816 00000100:00100000:3.0:1746129822.997017:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054441472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129822.997030:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129822.997047:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129822.997058:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129822.997076:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00a00/0x48868a4e4395579f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562ed expref: 22 pid: 10930 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129822.997122:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.997124:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129822.997130:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.997138:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129822.997165:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.997176:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054054272:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129822.997245:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129822.998148:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129822.998226:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054441600 00000100:00100000:3.0:1746129822.998230:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054441600 00000100:00100000:3.0:1746129822.998249:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15615 00000100:00100000:3.0:1746129822.998254:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054441600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129822.998264:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129822.998273:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02de400/0x48868a4e439558b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35638e expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129822.998295:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054400:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129822.998350:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.000802:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.000877:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054441856 00000100:00100000:2.0:1746129823.000884:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054441856 00002000:00100000:2.0:1746129823.000918:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2764800->2768895) req@ffff8800a8fd2a00 x1830949054441856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.000927:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949054441856 ext(2764800->2768895) 00002000:00010000:2.0:1746129823.000931:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:2.0:1746129823.000949:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7025 00000100:00100000:2.0:1746129823.000955:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054441856:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129823.001036:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054054272:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129823.001051:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.001091:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054441472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4065us (4202us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.001098:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054441856:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 142us (300us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.001099:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7816 00000100:00100000:2.0:1746129823.001103:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7025 00002000:00100000:2.0:1746129823.001108:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2764800->2768895) req@ffff8800a8fd2a00 x1830949054441856/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.001119:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2a00 with x1830949054441856 ext(2764800->2768895) 00002000:00010000:2.0:1746129823.001122:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2a00 00000100:00100000:3.0:1746129823.001140:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054400:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.001159:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02de400/0x48868a4e439558b0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35638e expref: 34 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.001169:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de400/0x48868a4e439558b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35638e expref: 34 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.001181:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02de400, rc 0) 00000100:00100000:3.0:1746129823.001200:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054441600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2946us (3055us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.001205:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15615 00000100:00100000:0.0:1746129823.004537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.004577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.004626:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054442240 00000100:00100000:3.0:1746129823.004632:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054442240 00000100:00100000:3.0:1746129823.004672:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15616 00000100:00100000:3.0:1746129823.004678:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054442240:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.004691:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.004703:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a02dfc00/0x48868a4e439558b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356395 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.004743:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054528:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129823.004805:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.004892:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054442112 00000100:00100000:2.0:1746129823.004895:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054442112 00002000:00100000:2.0:1746129823.004914:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2932736->2936831) req@ffff8800a8fd2300 x1830949054442112/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.004922:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2300 with x1830949054442112 ext(2932736->2936831) 00002000:00010000:2.0:1746129823.004925:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2300 00000100:00100000:2.0:1746129823.004934:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7026 00000100:00100000:2.0:1746129823.004938:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054442112:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129823.005046:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054442112:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 107us (517us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129823.005052:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7026 00002000:00100000:2.0:1746129823.005057:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2932736->2936831) req@ffff8800a8fd2300 x1830949054442112/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.005063:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a8fd2300 with x1830949054442112 ext(2932736->2936831) 00002000:00010000:2.0:1746129823.005065:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a8fd2300 00000100:00100000:3.0:1746129823.007260:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054054528:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.007286:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a02dfc00/0x48868a4e439558b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356395 expref: 34 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.007298:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dfc00/0x48868a4e439558b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356395 expref: 34 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.007321:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a02dfc00, rc 0) 00000100:00100000:3.0:1746129823.007445:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054442240:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2764us (2866us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.007460:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15616 00000100:00100000:1.0:1746129823.007697:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.007735:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054442496 00000100:00100000:3.0:1746129823.007740:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054442496 00000100:00100000:3.0:1746129823.007774:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4638 00000100:00100000:3.0:1746129823.007779:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+43:31674:x1830949054442496:12345-192.168.204.31@tcp:35:multiop.0 00000100:00080000:0.0:1746129823.007781:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129823.007926:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+44:31674:x1830949054442496:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 146us (229us total) trans 8589945090 rc 0/0 00000100:00100000:3.0:1746129823.007931:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4638 00000100:00100000:0.0:1746129823.012003:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.012426:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054442752 00000100:00100000:1.0:1746129823.013169:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054442752 00000100:00100000:1.0:1746129823.013222:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4639 00000100:00100000:1.0:1746129823.013230:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+316:31669:x1830949054442752:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129823.013426:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+317:31669:x1830949054442752:12345-192.168.204.31@tcp:35:cat.0 Request processed in 196us (1430us total) trans 8589945091 rc 0/0 00000100:00100000:1.0:1746129823.013432:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4639 00000100:00100000:0.0:1746129823.109477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.109515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.109554:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.109641:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054442880 00000100:00100000:1.0:1746129823.109648:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054442880 00000100:00100000:1.0:1746129823.109678:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054443008 00000100:00100000:1.0:1746129823.109681:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054443008 00000100:00100000:1.0:1746129823.109692:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054443136 00000100:00100000:1.0:1746129823.109693:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054443136 00000100:00100000:1.0:1746129823.109705:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15617 00000100:00100000:1.0:1746129823.109710:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054442880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129823.109726:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.109740:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35639c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.109757:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.109759:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.109766:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.109778:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.109787:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd08a00, rc 0) 00000100:00100000:1.0:1746129823.109822:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054442880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.109827:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15617 00000100:00100000:1.0:1746129823.109839:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15618 00000100:00100000:1.0:1746129823.109844:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054443008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129823.109874:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.109883:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd08000/0x48868a4e439558c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563a3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.109914:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054054656:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129823.109963:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.109979:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15619 00000100:00100000:1.0:1746129823.109985:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054443136:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129823.109990:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.109995:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd08c00/0x48868a4e439558cc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563aa expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.110014:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054054784:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129823.110033:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.111226:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054054784:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.111246:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd08c00/0x48868a4e439558cc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563aa expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.111254:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd08c00/0x48868a4e439558cc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563aa expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.111311:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd08c00, rc 0) 00002000:00010000:1.0:1746129823.111529:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129822 -> 1746129823 00000100:00100000:1.0:1746129823.111540:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054054656:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129823.111553:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd08000/0x48868a4e439558c5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563a3 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.111562:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd08000/0x48868a4e439558c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563a3 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.111573:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd08000, rc 0) 00000100:00100000:2.0:1746129823.111603:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054443136:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1617us (2047us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.111609:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15619 00000100:00100000:1.0:1746129823.112285:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054443008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2438us (2766us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129823.112291:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15618 00000100:00100000:0.0:1746129823.113141:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.113285:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054443392 00000100:00100000:2.0:1746129823.113291:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054443392 00000100:00100000:2.0:1746129823.113642:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11069 00000100:00100000:2.0:1746129823.113649:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+317:31681:x1830949054443392:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129823.113664:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.113676:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e439558d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563b1 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113744:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.113754:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113761:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 318 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113766:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 43 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113771:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.113791:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 43 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113800:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 43 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.113809:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054054912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.113896:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 318 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113903:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 318 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.113910:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054055040:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.113932:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.113939:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 12 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.113946:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054055168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.113962:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.119772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.119810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.119908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.119946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.119964:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054444160 00000100:00100000:1.0:1746129823.119973:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054444160 00000100:00100000:0.0:1746129823.119976:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054444032 00000100:00100000:0.0:1746129823.119979:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054444032 00010000:00010000:1.0:1746129823.120010:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 319 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.120035:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7817 00000100:00100000:1.0:1746129823.120042:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:1964:x1830949054444160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.120055:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.120061:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 319 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.120071:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 319 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.120098:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129823.120102:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.120110:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.120116:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.120148:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:1964:x1830949054444160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.120154:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7817 00000100:00100000:1.0:1746129823.120272:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054054912:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.120281:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e43955816 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35631e expref: 318 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.120294:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054055040:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.120466:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054443648 00000100:00100000:3.0:1746129823.120470:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054443648 00002000:00100000:3.0:1746129823.120498:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012d635880 x1830949054443648/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.120506:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635880 with x1830949054443648 ext(1048576->2097151) 00002000:00010000:3.0:1746129823.120510:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635880 00000100:00100000:3.0:1746129823.120527:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054443904 00000100:00100000:3.0:1746129823.120530:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054443904 00002000:00100000:3.0:1746129823.120538:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d637b80 x1830949054443904/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.120544:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637b80 with x1830949054443904 ext(1048576->2097151) 00002000:00010000:3.0:1746129823.120547:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637b80 00000100:00100000:3.0:1746129823.120557:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7027 00000100:00100000:3.0:1746129823.120561:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054443648:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:0.0:1746129823.120704:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 44 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.120735:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7818 00000100:00100000:0.0:1746129823.120741:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+44:1964:x1830949054444032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.120748:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.120752:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 44 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.120760:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 44 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.120771:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a02df400/0x48868a4e43955894 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356380 expref: 44 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.120782:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.120785:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.120791:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.120795:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.120814:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+43:1964:x1830949054444032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.120819:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7818 00000100:00100000:0.0:1746129823.120838:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7028 00000100:00100000:0.0:1746129823.120843:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054443904:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.130387:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.130488:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054444544 00000100:00100000:1.0:1746129823.130562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.130579:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054444288 00000100:00100000:1.0:1746129823.130583:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054444288 00010000:00010000:1.0:1746129823.130611:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 13 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.130636:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7819 00000100:00100000:1.0:1746129823.130642:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054444288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.130653:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.130658:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 13 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.130669:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 13 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.130687:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129823.130692:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.130700:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.130706:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.130720:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.130768:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054444288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 126us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.130775:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7819 00000100:00100000:3.0:1746129823.130826:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054444544 00000100:00100000:3.0:1746129823.130867:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11070 00000100:00100000:3.0:1746129823.130872:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+318:31685:x1830949054444544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.130885:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.130895:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3600/0x48868a4e439558e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563b8 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.130970:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093abba00/0x48868a4e439557c2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562fb expref: 12 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.130971:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.130979:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.130986:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.130986:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054055168:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.130996:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131001:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.131004:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129823.131005:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.131011:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.131015:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129823.131027:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129823.131092:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e439558fd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131099:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e439558fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131104:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e439558fd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.131110:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129823.131129:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858e00/0x48868a4e439558d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 321 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.131139:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 321 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.131144:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.131146:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129823.131148:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.131148:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858200, rc 0) 00010000:00010000:3.0:1746129823.131154:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131159:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131163:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092aa3800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129823.131166:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.131167:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+321:31681:x1830949054443392:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 17519us (18033us total) trans 8589945092 rc 0/0 00010000:00010000:3.0:1746129823.131172:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.131172:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11069 00010000:00010000:3.0:1746129823.131178:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129823.131180:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129823.131183:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131187:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3800/0x48868a4e439558e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131198:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131202:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131206:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131210:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092aa3a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129823.131212:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131216:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131221:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244400) 00010000:00010000:3.0:1746129823.131223:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129823.131225:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131229:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3a00/0x48868a4e439558ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.131251:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3600/0x48868a4e439558e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b8 expref: 321 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.131259:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e439558fd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b8 expref: 320 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.131265:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.131266:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129823.131268:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092aa3c00, rc 0) 00000100:00100000:3.0:1746129823.131284:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:31685:x1830949054444544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 413us (907us total) trans 8589945093 rc 0/0 00000100:00100000:3.0:1746129823.131288:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11070 00000100:00100000:3.0:1746129823.138432:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054443648:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17861us (18661us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.138442:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7027 00002000:00100000:3.0:1746129823.138452:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012d635880 x1830949054443648/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.138465:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635880 with x1830949054443648 ext(1048576->2097151) 00002000:00010000:3.0:1746129823.138470:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635880 00000100:00100000:2.0:1746129823.141826:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054443904:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20975us (22008us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.141837:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7028 00002000:00100000:2.0:1746129823.141884:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d637b80 x1830949054443904/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.141897:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637b80 with x1830949054443904 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.141901:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637b80 00000100:00100000:0.0:1746129823.145348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.145444:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054444672 00000100:00100000:1.0:1746129823.145451:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054444672 00000100:00100000:1.0:1746129823.145491:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15620 00000100:00100000:1.0:1746129823.145498:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054444672:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129823.145510:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.145522:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd09000/0x48868a4e4395590b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563bf expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.145560:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054055296:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129823.145618:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.145787:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.146368:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054444800 00000100:00100000:2.0:1746129823.146372:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054444800 00000100:00100000:2.0:1746129823.146400:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 741 00000100:00100000:2.0:1746129823.146406:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:1963:x1830949054444800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.146414:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.146430:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e439558fd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b8 expref: 320 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.146446:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.146449:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.146471:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:1963:x1830949054444800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.146476:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 741 00000100:00100000:0.0:1746129823.149422:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.149468:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445056 00000100:00100000:2.0:1746129823.149474:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445056 00002000:00100000:2.0:1746129823.149505:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2961408->2965503) req@ffff88012d634e00 x1830949054445056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129823.150097:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054055296:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129823.150124:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd09000/0x48868a4e4395590b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563bf expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.150135:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd09000/0x48868a4e4395590b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563bf expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.150153:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd09000, rc 0) 00000100:00100000:1.0:1746129823.150185:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054444672:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4687us (4843us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129823.150192:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15620 00002000:00100000:2.0:1746129823.150572:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634e00 with x1830949054445056 ext(2961408->2965503) 00002000:00010000:2.0:1746129823.150577:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634e00 00000100:00100000:2.0:1746129823.150642:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7029 00000100:00100000:2.0:1746129823.150649:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054445056:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129823.150832:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054445056:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 183us (1415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129823.150838:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7029 00002000:00100000:2.0:1746129823.150843:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2961408->2965503) req@ffff88012d634e00 x1830949054445056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.150862:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634e00 with x1830949054445056 ext(2961408->2965503) 00002000:00010000:2.0:1746129823.150864:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634e00 00000100:00100000:0.0:1746129823.155026:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.155096:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445184 00000100:00100000:1.0:1746129823.155104:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445184 00000100:00100000:1.0:1746129823.155148:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15621 00000100:00100000:1.0:1746129823.155155:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31681:x1830949054445184:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.155169:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.155183:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563c6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.155207:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.155214:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129823.155215:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129823.155218:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.155243:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 21 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.155253:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 21 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.155267:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054055424:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.155345:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.159238:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.159577:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445312 00000100:00100000:2.0:1746129823.159585:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445312 00000100:00100000:2.0:1746129823.159633:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15622 00000100:00100000:2.0:1746129823.159640:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31682:x1830949054445312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.159654:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.159668:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563cd expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.159693:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.159700:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.159701:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.159705:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.159728:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 22 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.159737:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 22 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.159751:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054055552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.159939:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.159976:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445568 00000100:00100000:3.0:1746129823.159980:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445568 00000100:00100000:3.0:1746129823.160003:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11071 00000100:00100000:3.0:1746129823.160007:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+43:31687:x1830949054445568:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129823.160019:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.160027:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3e00/0x48868a4e43955920 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563d4 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.160105:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.160116:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.160124:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.160131:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129823.161223:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3e00/0x48868a4e43955920 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 46 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.161250:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 45 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.161258:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.161261:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129823.161264:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092aa3c00, rc 0) 00000100:00100000:3.0:1746129823.161301:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+45:31687:x1830949054445568:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1291us (1361us total) trans 8589945094 rc 0/0 00000100:00100000:3.0:1746129823.161308:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11071 00000100:00100000:2.0:1746129823.163242:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.164018:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054055424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.164040:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.164054:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd08e00, rc 0) 00000100:00100000:2.0:1746129823.164098:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31681:x1830949054445184:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 8941us (9077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.164104:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15621 00000100:00100000:3.0:1746129823.164174:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054055552:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.164187:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 22 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.164196:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0200, rc 0) 00000100:00100000:3.0:1746129823.164211:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31682:x1830949054445312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4572us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.164216:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15622 00000100:00100000:0.0:1746129823.164349:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.164382:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.164435:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.164519:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445952 00000100:00100000:3.0:1746129823.164525:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445952 00000100:00100000:3.0:1746129823.164551:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15623 00000100:00100000:3.0:1746129823.164557:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31685:x1830949054445952:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.164568:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.164578:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563db expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.164594:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129823.164599:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.164608:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.164619:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092aa3200, rc 0) 00000100:00100000:2.0:1746129823.164683:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445696 00000100:00100000:2.0:1746129823.164686:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445696 00002000:00100000:2.0:1746129823.164708:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f4:0x0] (2764800->2936831) req@ffff88012d636300 x1830949054445696/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.164716:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636300 with x1830949054445696 ext(2764800->2936831) 00010000:00010000:2.0:1746129823.164721:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 22 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.164730:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 22 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.164736:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d636300 00000100:00100000:2.0:1746129823.164750:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054445824 00000100:00100000:2.0:1746129823.164752:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054445824 00002000:00100000:2.0:1746129823.164764:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1974272->2097151) req@ffff88012d634380 x1830949054445824/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.164770:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634380 with x1830949054445824 ext(1974272->2097151) 00010000:00010000:2.0:1746129823.164773:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.164780:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.164784:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d634380 00000100:00100000:2.0:1746129823.164793:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1895 00000100:00100000:2.0:1746129823.164798:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054445696:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129823.165292:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31685:x1830949054445952:12345-192.168.204.31@tcp:101:cat.0 Request processed in 734us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.165298:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15623 00000100:00100000:3.0:1746129823.165322:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1896 00000100:00100000:3.0:1746129823.165327:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054445824:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129823.168050:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054445824:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 2717us (3608us total) trans 21474841333 rc 0/0 00000100:00100000:3.0:1746129823.168059:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1896 00002000:00100000:3.0:1746129823.168067:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1974272->2097151) req@ffff88012d634380 x1830949054445824/t21474841333(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.168075:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634380 with x1830949054445824 ext(1974272->2097151) 00010000:00010000:3.0:1746129823.168095:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.168104:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.168110:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d634380 00000100:00100000:2.0:1746129823.168547:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054445696:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3745us (4196us total) trans 17179874139 rc 0/0 00000100:00100000:2.0:1746129823.168554:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1895 00002000:00100000:2.0:1746129823.168559:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2764800->2936831) req@ffff88012d636300 x1830949054445696/t17179874139(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.168566:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636300 with x1830949054445696 ext(2764800->2936831) 00010000:00010000:2.0:1746129823.168572:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.168581:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.168586:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d636300 00000100:00100000:2.0:1746129823.172205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.172260:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054446080 00000100:00100000:0.0:1746129823.172267:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054446080 00010000:00010000:0.0:1746129823.172292:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.172320:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7820 00000100:00100000:0.0:1746129823.172326:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054446080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.172394:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.172412:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.172422:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.172438:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b538ba00/0x48868a4e43955871 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1974272->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35636b expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.172463:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.172465:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.172470:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.172477:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.172483:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.172484:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.172487:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.172492:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.172514:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 25 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.172524:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054055680:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129823.173112:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 21 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.173209:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054055808:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129823.173402:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.176262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.176390:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054446208 00000100:00100000:3.0:1746129823.176397:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054446208 00010000:00010000:3.0:1746129823.176423:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.176528:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7821 00000100:00100000:3.0:1746129823.176536:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054446208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.176547:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.176565:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.176576:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.176594:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dec00/0x48868a4e439558a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2764800->2936831) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356387 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.176762:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.176764:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.176770:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.176778:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.176805:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.176815:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054055936:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129823.177065:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.177946:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d635c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054055680:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.177957:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054055808:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.178094:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.178131:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054446080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5804us (5942us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.178138:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7820 00000100:00100000:0.0:1746129823.179053:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.179916:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.180208:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054446464 00000100:00100000:2.0:1746129823.180214:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054446464 00002000:00100000:2.0:1746129823.180248:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d635180 x1830949054446464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.180257:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635180 with x1830949054446464 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.180261:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635180 00000100:00100000:2.0:1746129823.180274:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054446720 00000100:00100000:2.0:1746129823.180276:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054446720 00002000:00100000:2.0:1746129823.180286:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d634700 x1830949054446720/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.180293:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634700 with x1830949054446720 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.180295:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634700 00000100:00100000:2.0:1746129823.180314:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7030 00000100:00100000:2.0:1746129823.180320:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054446464:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.180450:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7031 00000100:00100000:1.0:1746129823.180458:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054446720:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.180866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.180910:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054055936:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129823.180926:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.180969:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054446208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4434us (4713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.180975:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7821 00000100:00100000:3.0:1746129823.180997:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054446976 00000100:00100000:3.0:1746129823.181000:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054446976 00002000:00100000:3.0:1746129823.181011:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2117632->2121727) req@ffff88012d635c00 x1830949054446976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.181018:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949054446976 ext(2117632->2121727) 00002000:00010000:3.0:1746129823.181021:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00000100:00100000:3.0:1746129823.181034:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7032 00000100:00100000:3.0:1746129823.181038:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054446976:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.181347:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054446976:12345-192.168.204.31@tcp:3:cat.0 Request processed in 307us (481us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.181352:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7032 00002000:00100000:3.0:1746129823.181357:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2117632->2121727) req@ffff88012d635c00 x1830949054446976/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.181363:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635c00 with x1830949054446976 ext(2117632->2121727) 00002000:00010000:3.0:1746129823.181366:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d635c00 00000100:00100000:1.0:1746129823.191608:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054446720:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11141us (11684us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.191619:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7031 00002000:00100000:1.0:1746129823.191630:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d634700 x1830949054446720/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.191639:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634700 with x1830949054446720 ext(1048576->2097151) 00002000:00010000:1.0:1746129823.191644:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d634700 00000100:00100000:2.0:1746129823.194178:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054446464:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13850us (15119us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.194189:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7030 00002000:00100000:2.0:1746129823.194197:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d635180 x1830949054446464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.194207:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635180 with x1830949054446464 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.194212:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635180 00000100:00100000:0.0:1746129823.197660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.197995:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054447104 00000100:00100000:2.0:1746129823.198003:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054447104 00000100:00100000:2.0:1746129823.198052:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15624 00000100:00100000:2.0:1746129823.198059:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054447104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.198072:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.198094:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f881000/0x48868a4e4395593c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563e2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.198139:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054056064:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.198209:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.199834:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.200049:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054447232 00000100:00100000:3.0:1746129823.200054:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054447232 00000100:00100000:3.0:1746129823.200095:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15625 00000100:00100000:3.0:1746129823.200102:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054447232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.200113:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129823.200117:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054056064:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.200124:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092aa2e00/0x48868a4e43955943 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563e9 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.200137:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f881000/0x48868a4e4395593c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563e2 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.200149:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f881000/0x48868a4e4395593c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563e2 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129823.200156:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054056192:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.200162:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f881000, rc 0) 00000100:00100000:3.0:1746129823.200205:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.200307:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054447104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2247us (2652us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.200313:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15624 00000100:00100000:0.0:1746129823.201263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.201326:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054447360 00000100:00100000:2.0:1746129823.201331:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054447360 00000100:00100000:2.0:1746129823.201351:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15626 00000100:00100000:2.0:1746129823.201356:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31687:x1830949054447360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129823.201364:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.201371:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563f0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.201388:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.201395:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.201397:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.201400:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.201416:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.201426:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 24 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.201435:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054056320:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.201766:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.202129:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054056192:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.202235:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092aa2e00/0x48868a4e43955943 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563e9 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.202245:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092aa2e00/0x48868a4e43955943 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563e9 expref: 24 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.202257:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092aa2e00, rc 0) 00000100:00100000:3.0:1746129823.202518:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054447232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2416us (2688us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.202525:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15625 00000100:00100000:0.0:1746129823.204647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.204733:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054056320:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.204751:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.204767:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f881200, rc 0) 00000100:00100000:3.0:1746129823.204817:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054447616 00000100:00100000:3.0:1746129823.204822:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054447616 00000100:00100000:2.0:1746129823.204822:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31687:x1830949054447360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3465us (3560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.204829:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15626 00000100:00100000:2.0:1746129823.204843:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15627 00000100:00100000:2.0:1746129823.204866:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31682:x1830949054447616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.205089:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.205101:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563f7 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.205118:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.205122:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.205127:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746129823.205130:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.205155:0:4589:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3133440->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.205164:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.205171:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f880c00, rc 0) 00000100:00100000:2.0:1746129823.205198:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31682:x1830949054447616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 350us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.205202:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15627 00000100:00100000:0.0:1746129823.205520:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.205573:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054447488 00000100:00100000:2.0:1746129823.205577:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054447488 00002000:00100000:2.0:1746129823.205597:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880136318380 x1830949054447488/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 504/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.205604:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318380 with x1830949054447488 ext(2097152->3145727) 00010000:00010000:2.0:1746129823.205610:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.205619:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.205624:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136318380 00000100:00100000:2.0:1746129823.205692:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1897 00000100:00100000:2.0:1746129823.205697:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054447488:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129823.210959:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.210990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.211019:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.211038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.211059:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054448128 00000100:00100000:0.0:1746129823.211066:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054448128 00002000:00100000:0.0:1746129823.211129:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3960832->4194303) req@ffff880136319f80 x1830949054448128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129823.211138:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319f80 with x1830949054448128 ext(3960832->4194303) 00010000:00010000:0.0:1746129823.211147:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.211160:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746129823.211166:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136319f80 00000100:00100000:0.0:1746129823.211181:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054448384 00000100:00100000:0.0:1746129823.211183:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054448384 00002000:00100000:0.0:1746129823.211195:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2121728->3170303) req@ffff880136318a80 x1830949054448384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129823.211201:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318a80 with x1830949054448384 ext(2121728->3170303) 00002000:00010000:0.0:1746129823.211204:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136318a80 00000100:00100000:0.0:1746129823.211212:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054447872 00000100:00100000:0.0:1746129823.211215:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054447872 00002000:00100000:0.0:1746129823.211223:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2727936->3960831) req@ffff880136319500 x1830949054447872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 504/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129823.211230:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319500 with x1830949054447872 ext(2727936->3960831) 00010000:00010000:0.0:1746129823.211233:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.211241:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746129823.211246:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136319500 00000100:00100000:0.0:1746129823.211254:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054448512 00000100:00100000:0.0:1746129823.211256:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054448512 00002000:00100000:0.0:1746129823.211264:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3170304->4194303) req@ffff88013631aa00 x1830949054448512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129823.211270:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631aa00 with x1830949054448512 ext(3170304->4194303) 00002000:00010000:0.0:1746129823.211272:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631aa00 00000100:00100000:0.0:1746129823.211282:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1898 00000100:00100000:0.0:1746129823.211288:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054448128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.211599:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1899 00000100:00100000:0.0:1746129823.211605:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054447872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.212007:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7033 00000100:00100000:1.0:1746129823.212014:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949054448384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.212643:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7034 00000100:00100000:3.0:1746129823.212652:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054448512:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.216475:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054448128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5178us (5514us total) trans 0 rc 233472/233472 00000100:00100000:2.0:1746129823.216486:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1898 00002000:00100000:2.0:1746129823.216496:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3960832->4194303) req@ffff880136319f80 x1830949054448128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 233472/233472 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.216504:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319f80 with x1830949054448128 ext(3960832->4194303) 00010000:00010000:2.0:1746129823.216512:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.216528:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.216534:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136319f80 00010000:00010000:2.0:1746129823.216810:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129823.223325:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054448512:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10665us (12276us total) trans 0 rc 1024000/1024000 00000100:00100000:3.0:1746129823.223336:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7034 00002000:00100000:3.0:1746129823.223346:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3170304->4194303) req@ffff88013631aa00 x1830949054448512/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1024000/1024000 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.223360:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631aa00 with x1830949054448512 ext(3170304->4194303) 00002000:00010000:3.0:1746129823.223365:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631aa00 00000100:00100000:1.0:1746129823.223471:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054448384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11455us (12478us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.223481:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7033 00002000:00100000:1.0:1746129823.223486:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2121728->3170303) req@ffff880136318a80 x1830949054448384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.223493:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318a80 with x1830949054448384 ext(2121728->3170303) 00002000:00010000:1.0:1746129823.223496:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136318a80 00000100:00100000:2.0:1746129823.227478:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054447488:12345-192.168.204.31@tcp:4:cat.0 Request processed in 21772us (21949us total) trans 21474841334 rc 0/0 00000100:00100000:2.0:1746129823.227489:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1897 00002000:00100000:2.0:1746129823.227499:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880136318380 x1830949054447488/t21474841334(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 504/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.227507:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136318380 with x1830949054447488 ext(2097152->3145727) 00010000:00010000:2.0:1746129823.227515:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.227527:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.227533:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136318380 00000100:00100000:2.0:1746129823.230053:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054447872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18440us (19026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.230063:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1899 00002000:00100000:2.0:1746129823.230072:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2727936->3960831) req@ffff880136319500 x1830949054447872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 504/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.230093:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136319500 with x1830949054447872 ext(2727936->3960831) 00010000:00010000:2.0:1746129823.230103:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.230117:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.230123:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136319500 00000100:00100000:0.0:1746129823.235023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.235250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.235302:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054448896 00000100:00100000:3.0:1746129823.235310:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054448896 00000100:00100000:2.0:1746129823.235318:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054448768 00000100:00100000:2.0:1746129823.235321:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054448768 00010000:00010000:3.0:1746129823.235340:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.235353:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15628 00000100:00100000:3.0:1746129823.235359:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7822 00000100:00100000:2.0:1746129823.235360:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31685:x1830949054448768:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129823.235363:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054448896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.235372:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.235373:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.235384:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3563fe expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.235390:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.235400:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.235402:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.235409:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.235421:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.235467:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f859200/0x48868a4e43955878 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->2727935) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356372 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.235467:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 29 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.235475:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.235476:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.235481:0:4589:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.235488:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.235514:0:4589:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.235524:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.235534:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054056576:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.235585:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00010000:00010000:3.0:1746129823.235769:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.235794:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054448896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 429us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.235800:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7822 00000100:00100000:0.0:1746129823.237211:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.237233:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054056576:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.237277:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f881e00, rc 0) 00000100:00100000:2.0:1746129823.237549:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31685:x1830949054448768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2188us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.237556:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15628 00000100:00100000:3.0:1746129823.237679:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054449152 00000100:00100000:3.0:1746129823.237685:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054449152 00002000:00100000:3.0:1746129823.237717:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3133440->3137535) req@ffff88013631b480 x1830949054449152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.237725:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b480 with x1830949054449152 ext(3133440->3137535) 00010000:00010000:3.0:1746129823.237733:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.237744:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.237749:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013631b480 00000100:00100000:3.0:1746129823.237776:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1900 00000100:00100000:3.0:1746129823.237782:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054449152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.238770:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054449152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 984us (1558us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.238776:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1900 00002000:00100000:3.0:1746129823.238782:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3133440->3137535) req@ffff88013631b480 x1830949054449152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.238789:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b480 with x1830949054449152 ext(3133440->3137535) 00010000:00010000:3.0:1746129823.238795:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.238805:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.238810:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013631b480 00000100:00100000:2.0:1746129823.243237:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.243282:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.243300:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054449408 00000100:00100000:2.0:1746129823.243300:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054449536 00000100:00100000:3.0:1746129823.243306:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054449408 00000100:00100000:2.0:1746129823.243306:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054449536 00002000:00100000:3.0:1746129823.243338:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3133440->3145727) req@ffff88008f90aa00 x1830949054449408/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 12776/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129823.243346:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15629 00002000:00100000:3.0:1746129823.243348:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90aa00 with x1830949054449408 ext(3133440->3145727) 00000100:00100000:2.0:1746129823.243351:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31687:x1830949054449536:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129823.243355:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.243363:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.243365:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.243370:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f90aa00 00010000:00010000:2.0:1746129823.243373:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356405 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.243381:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1901 00000100:00100000:3.0:1746129823.243385:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054449408:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:2.0:1746129823.243394:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.243404:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.243405:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.243408:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2539519] (req 2097152->2539519) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.243432:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.243441:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 33 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.243450:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054056704:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.243507:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.243651:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054449408:12345-192.168.204.31@tcp:4:cat.0 Request processed in 264us (421us total) trans 21474841335 rc 0/0 00000100:00100000:3.0:1746129823.243658:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1901 00002000:00100000:3.0:1746129823.243664:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3133440->3145727) req@ffff88008f90aa00 x1830949054449408/t21474841335(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 12776/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.243671:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90aa00 with x1830949054449408 ext(3133440->3145727) 00010000:00010000:3.0:1746129823.243675:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.243683:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.243687:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f90aa00 00000100:00100000:0.0:1746129823.251981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.252088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.252566:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054056704:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.252590:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->2539519] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.252607:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f881c00, rc 0) 00000100:00100000:2.0:1746129823.252774:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31687:x1830949054449536:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 9421us (9491us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.252782:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15629 00000100:00100000:3.0:1746129823.252811:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054449664 00000100:00100000:3.0:1746129823.252816:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054449664 00010000:00010000:3.0:1746129823.252840:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.252905:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7823 00000100:00100000:3.0:1746129823.252911:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054449664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.252923:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.252942:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.252951:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.252970:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e4395594a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3133440->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f0 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.252993:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.252995:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.253001:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.253008:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.253014:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.253015:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.253018:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.253028:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.253050:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.253060:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054056832:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129823.253129:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 25 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.253137:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054056960:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129823.253153:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.253167:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054449792 00000100:00100000:3.0:1746129823.253503:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054449792 00002000:00100000:3.0:1746129823.253531:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2121727) req@ffff88009adad500 x1830949054449792/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.253539:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad500 with x1830949054449792 ext(2097152->2121727) 00010000:00010000:3.0:1746129823.253544:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 34 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.253552:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 34 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.253557:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adad500 00000100:00100000:3.0:1746129823.253581:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1902 00000100:00100000:3.0:1746129823.253586:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054449792:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129823.263807:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054449792:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10213us (11720us total) trans 17179874140 rc 0/0 00000100:00100000:3.0:1746129823.263819:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1902 00002000:00100000:3.0:1746129823.263829:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2121727) req@ffff88009adad500 x1830949054449792/t17179874140(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.263838:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad500 with x1830949054449792 ext(2097152->2121727) 00010000:00010000:3.0:1746129823.263876:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.263890:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.264203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.264235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.264261:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054450304 00000100:00100000:1.0:1746129823.264268:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054450304 00002000:00100000:1.0:1746129823.264296:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009adaed80 x1830949054450304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.264303:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaed80 with x1830949054450304 ext(2097152->3145727) 00002000:00010000:1.0:1746129823.264306:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaed80 00000100:00100000:1.0:1746129823.264325:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054450048 00000100:00100000:1.0:1746129823.264327:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054450048 00002000:00100000:1.0:1746129823.264337:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009adadc00 x1830949054450048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.264344:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadc00 with x1830949054450048 ext(3145728->4194303) 00002000:00010000:1.0:1746129823.264347:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadc00 00000100:00100000:1.0:1746129823.264374:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7035 00000100:00100000:1.0:1746129823.264380:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054450304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.264400:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054056832:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.264409:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054056960:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.264425:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.264445:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054449664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 11535us (12473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.264454:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7823 00000100:00100000:0.0:1746129823.264544:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7036 00000100:00100000:0.0:1746129823.264551:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054450048:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:3.0:1746129823.264749:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adad500 00000100:00100000:0.0:1746129823.272601:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.272959:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054450432 00000100:00100000:2.0:1746129823.272968:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054450432 00010000:00010000:2.0:1746129823.272997:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.273036:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7824 00000100:00100000:2.0:1746129823.273042:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054450432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.273054:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.273072:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.273095:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.273119:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08e00/0x48868a4e43955912 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563c6 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.273147:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.273149:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.273156:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.273163:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.273197:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.273207:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054057088:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.273479:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.274733:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054450304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10349us (10527us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.274741:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7035 00002000:00100000:1.0:1746129823.274749:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009adaed80 x1830949054450304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.274757:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaed80 with x1830949054450304 ext(2097152->3145727) 00002000:00010000:1.0:1746129823.274761:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adaed80 00000100:00100000:2.0:1746129823.275250:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054450048:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10698us (11013us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.275255:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7036 00002000:00100000:2.0:1746129823.275261:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009adadc00 x1830949054450048/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.275267:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadc00 with x1830949054450048 ext(3145728->4194303) 00002000:00010000:2.0:1746129823.275270:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadc00 00000100:00100000:2.0:1746129823.275774:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054057088:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.275788:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.275817:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054450432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2775us (3223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.275823:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7824 00000100:00100000:0.0:1746129823.279183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.279298:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054450688 00000100:00100000:2.0:1746129823.279305:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054450688 00002000:00100000:2.0:1746129823.279342:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2535424->2539519) req@ffff88009adafb80 x1830949054450688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.279351:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adafb80 with x1830949054450688 ext(2535424->2539519) 00002000:00010000:2.0:1746129823.279355:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adafb80 00000100:00100000:2.0:1746129823.279371:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7037 00000100:00100000:2.0:1746129823.279377:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054450688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.279538:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054450688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 160us (360us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129823.279544:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7037 00002000:00100000:2.0:1746129823.279550:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2535424->2539519) req@ffff88009adafb80 x1830949054450688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.279556:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adafb80 with x1830949054450688 ext(2535424->2539519) 00002000:00010000:2.0:1746129823.279559:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adafb80 00000100:00100000:0.0:1746129823.280793:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.280865:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054450816 00000100:00100000:2.0:1746129823.280869:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054450816 00000100:00100000:2.0:1746129823.280891:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15630 00000100:00100000:2.0:1746129823.280896:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31685:x1830949054450816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.280906:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.280918:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35640c expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.280938:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.280946:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.280947:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.280954:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 36 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.280979:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.280989:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.281000:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054057216:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.281087:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.281330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.281366:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054451072 00000100:00100000:2.0:1746129823.281369:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054451072 00002000:00100000:2.0:1746129823.281386:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2539520->3145727) req@ffff88009adad180 x1830949054451072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.281394:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad180 with x1830949054451072 ext(2539520->3145727) 00010000:00010000:2.0:1746129823.281398:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.281407:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.281412:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adad180 00000100:00100000:2.0:1746129823.281431:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1903 00000100:00100000:2.0:1746129823.281436:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054451072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.284277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.284387:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054451328 00000100:00100000:1.0:1746129823.284394:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054451328 00002000:00100000:1.0:1746129823.284427:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009adace00 x1830949054451328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.284435:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949054451328 ext(3145728->4194303) 00002000:00010000:1.0:1746129823.284440:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:1.0:1746129823.284471:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7038 00000100:00100000:1.0:1746129823.284477:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054451328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.289037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.289211:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054057216:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.289238:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 36 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.289261:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f984e00, rc 0) 00000100:00100000:2.0:1746129823.289305:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31685:x1830949054450816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8407us (8514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.289313:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15630 00000100:00100000:3.0:1746129823.289610:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054451072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8173us (8280us total) trans 0 rc 606208/606208 00000100:00100000:3.0:1746129823.289619:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1903 00002000:00100000:3.0:1746129823.289626:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2539520->3145727) req@ffff88009adad180 x1830949054451072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 606208/606208 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.289634:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adad180 with x1830949054451072 ext(2539520->3145727) 00010000:00010000:3.0:1746129823.289641:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.289653:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.289660:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adad180 00000100:00100000:3.0:1746129823.289673:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054451456 00000100:00100000:3.0:1746129823.289679:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054451456 00002000:00100000:3.0:1746129823.289704:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2539519) req@ffff88009adaf100 x1830949054451456/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.289711:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949054451456 ext(2097152->2539519) 00010000:00010000:3.0:1746129823.289715:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.289723:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 24 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.289728:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaf100 00000100:00100000:3.0:1746129823.289744:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1904 00000100:00100000:3.0:1746129823.289750:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054451456:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129823.292324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.292394:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054451712 00000100:00100000:2.0:1746129823.292401:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054451712 00002000:00100000:2.0:1746129823.292443:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009adaca80 x1830949054451712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.292451:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaca80 with x1830949054451712 ext(3145728->4194303) 00010000:00010000:2.0:1746129823.292458:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.292470:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.292476:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaca80 00000100:00100000:2.0:1746129823.292505:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1905 00000100:00100000:2.0:1746129823.292512:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054451712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.292715:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054451328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8237us (8443us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.292721:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7038 00002000:00100000:1.0:1746129823.292727:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009adace00 x1830949054451328/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.292733:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adace00 with x1830949054451328 ext(3145728->4194303) 00002000:00010000:1.0:1746129823.292736:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adace00 00000100:00100000:1.0:1746129823.294117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.294189:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054451840 00000100:00100000:3.0:1746129823.294194:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054451840 00000100:00100000:3.0:1746129823.294219:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15631 00000100:00100000:3.0:1746129823.294225:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31682:x1830949054451840:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.294236:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.294250:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356413 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.294268:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129823.294270:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129823.294274:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.294284:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 28 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.294293:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c11da00, rc 0) 00000100:00100000:3.0:1746129823.294316:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31682:x1830949054451840:12345-192.168.204.31@tcp:101:cat.0 Request processed in 91us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.294321:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15631 00000100:00100000:3.0:1746129823.298643:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054451456:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8887us (9607us total) trans 17179874141 rc 0/0 00000100:00100000:3.0:1746129823.298653:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1904 00002000:00100000:3.0:1746129823.298661:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2539519) req@ffff88009adaf100 x1830949054451456/t17179874141(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.298669:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaf100 with x1830949054451456 ext(2097152->2539519) 00010000:00010000:3.0:1746129823.298677:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 29 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.298690:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 29 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.298695:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaf100 00000100:00100000:2.0:1746129823.301115:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054451712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8595us (8789us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.301125:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1905 00002000:00100000:2.0:1746129823.301134:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009adaca80 x1830949054451712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.301147:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adaca80 with x1830949054451712 ext(3145728->4194303) 00010000:00010000:2.0:1746129823.301155:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.301168:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.301174:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009adaca80 00000100:00100000:0.0:1746129823.304044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.305146:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054451968 00000100:00100000:2.0:1746129823.305154:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054451968 00010000:00010000:2.0:1746129823.305185:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.305221:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7825 00000100:00100000:2.0:1746129823.305228:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054451968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.305240:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.305258:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.305269:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.305288:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f881c00/0x48868a4e4395595f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2539519) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356405 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.305318:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.305320:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.305326:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.305334:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.305341:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.305342:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.305345:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.305350:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.305375:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.305385:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054057344:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.305475:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.305483:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054057472:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.305501:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.309064:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054057344:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.309088:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054057472:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.309105:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.309157:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054451968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3928us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.309169:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7825 00000100:00100000:0.0:1746129823.310514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.312843:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.312910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.313969:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054452224 00000100:00100000:2.0:1746129823.313969:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054452608 00000100:00100000:3.0:1746129823.313977:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054452224 00000100:00100000:2.0:1746129823.313977:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054452608 00002000:00100000:2.0:1746129823.314016:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dc380 x1830949054452608/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.314025:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc380 with x1830949054452608 ext(3145728->4194303) 00002000:00010000:2.0:1746129823.314029:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc380 00002000:00100000:3.0:1746129823.314259:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dce00 x1830949054452224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.314265:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dce00 with x1830949054452224 ext(3145728->4194303) 00002000:00010000:3.0:1746129823.314268:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dce00 00000100:00100000:2.0:1746129823.314447:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054452480 00000100:00100000:2.0:1746129823.314451:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054452480 00000100:00100000:3.0:1746129823.314453:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7039 00000100:00100000:3.0:1746129823.314460:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054452608:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:2.0:1746129823.314464:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800936dd180 x1830949054452480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.314469:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830949054452480 ext(2097152->3145727) 00002000:00010000:2.0:1746129823.314472:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:2.0:1746129823.314487:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7040 00000100:00100000:2.0:1746129823.314491:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054452224:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.314515:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7041 00000100:00100000:2.0:1746129823.314526:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054452480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.328260:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054452608:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13791us (15414us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.328271:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7039 00002000:00100000:3.0:1746129823.328282:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dc380 x1830949054452608/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.328289:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc380 with x1830949054452608 ext(3145728->4194303) 00002000:00010000:3.0:1746129823.328294:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc380 00000100:00100000:2.0:1746129823.330465:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054452480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15937us (17547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.330474:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7041 00002000:00100000:2.0:1746129823.330484:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800936dd180 x1830949054452480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.330497:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd180 with x1830949054452480 ext(2097152->3145727) 00002000:00010000:2.0:1746129823.330501:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd180 00000100:00100000:3.0:1746129823.331926:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054452224:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17428us (21410us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.331935:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7040 00002000:00100000:3.0:1746129823.331943:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800936dce00 x1830949054452224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.331950:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dce00 with x1830949054452224 ext(3145728->4194303) 00002000:00010000:3.0:1746129823.331954:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dce00 00000100:00100000:0.0:1746129823.337332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.337442:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054452992 00000100:00100000:3.0:1746129823.337449:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054452992 00002000:00100000:3.0:1746129823.337485:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800936ddf80 x1830949054452992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.337494:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddf80 with x1830949054452992 ext(4194304->4931583) 00002000:00010000:3.0:1746129823.337499:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936ddf80 00000100:00100000:3.0:1746129823.337526:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7042 00000100:00100000:3.0:1746129823.337532:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054452992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.343122:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.343306:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054453248 00000100:00100000:2.0:1746129823.343314:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054453248 00002000:00100000:2.0:1746129823.343346:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800936dfb80 x1830949054453248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.343355:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949054453248 ext(4194304->4931583) 00002000:00010000:2.0:1746129823.343359:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:2.0:1746129823.343389:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7043 00000100:00100000:2.0:1746129823.343396:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054453248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.351699:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054452992:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14159us (14367us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129823.351710:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7042 00002000:00100000:2.0:1746129823.351770:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800936ddf80 x1830949054452992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.351779:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ddf80 with x1830949054452992 ext(4194304->4931583) 00002000:00010000:2.0:1746129823.351783:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936ddf80 00000100:00100000:3.0:1746129823.352086:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054453248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8679us (8960us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129823.352093:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7043 00002000:00100000:3.0:1746129823.352099:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800936dfb80 x1830949054453248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.352106:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dfb80 with x1830949054453248 ext(4194304->4931583) 00002000:00010000:3.0:1746129823.352109:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936dfb80 00000100:00100000:0.0:1746129823.363517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.363635:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054453504 00000100:00100000:1.0:1746129823.363643:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054453504 00000100:00100000:1.0:1746129823.363692:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4640 00000100:00100000:1.0:1746129823.363699:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+319:31685:x1830949054453504:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129823.363914:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:31685:x1830949054453504:12345-192.168.204.31@tcp:35:cat.0 Request processed in 215us (404us total) trans 8589945095 rc 0/0 00000100:00100000:1.0:1746129823.363920:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4640 00000100:00100000:0.0:1746129823.414836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.415226:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054453760 00000100:00100000:3.0:1746129823.415234:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054453760 00000100:00100000:3.0:1746129823.415328:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11072 00000100:00100000:3.0:1746129823.415336:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:31695:x1830949054453760:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129823.415358:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.415374:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955974 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35641a expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.415461:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415471:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415479:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415489:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415494:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415498:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415649:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955989 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415656:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955989 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415661:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955989 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.415668:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129823.415724:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415729:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415734:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415738:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129823.415741:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415746:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415753:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129823.415756:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129823.415759:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415763:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e4395597b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415780:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415784:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415787:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415791:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129823.415793:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415796:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415800:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244900) 00010000:00010000:3.0:1746129823.415802:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129823.415803:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415807:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e43955982 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.415832:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955974 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35641a expref: 323 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.415844:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955989 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35641a expref: 322 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.415867:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.415869:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129823.415871:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb5400, rc 0) 00000100:00100000:3.0:1746129823.417028:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+322:31695:x1830949054453760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1690us (2196us total) trans 8589945096 rc 0/0 00000100:00100000:3.0:1746129823.417035:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11072 00000100:00100000:0.0:1746129823.419944:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.419986:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.420083:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054454144 00000100:00100000:3.0:1746129823.420090:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054454144 00000100:00100000:3.0:1746129823.420147:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4641 00000100:00100000:3.0:1746129823.420153:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+322:31695:x1830949054454144:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129823.420208:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054453888 00000100:00100000:2.0:1746129823.420212:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054453888 00000100:00100000:2.0:1746129823.420250:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 742 00000100:00100000:2.0:1746129823.420255:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+323:1964:x1830949054453888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.420265:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.420283:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955989 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35641a expref: 323 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.420309:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.420313:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.420574:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+323:1964:x1830949054453888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 317us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.420581:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 742 00000100:00100000:3.0:1746129823.421099:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+322:31695:x1830949054454144:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 944us (1159us total) trans 8589945097 rc 0/0 00000100:00100000:3.0:1746129823.421105:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4641 00000100:00100000:0.0:1746129823.455027:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.456386:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054454272 00000100:00100000:1.0:1746129823.456395:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054454272 00000100:00100000:1.0:1746129823.456579:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15632 00000100:00100000:1.0:1746129823.456586:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31694:x1830949054454272:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.456601:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.456614:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356421 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.456641:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.456648:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.456653:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.456654:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.456657:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 27 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.456678:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.456686:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 27 pid: 3624 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.456695:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054057600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.457372:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.457381:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 35 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.457389:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054057728:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.457410:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.462553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.462645:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054454400 00000100:00100000:2.0:1746129823.462653:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054454400 00010000:00010000:2.0:1746129823.462680:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 28 pid: 3624 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129823.462704:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7826 00000100:00100000:2.0:1746129823.462710:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054454400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.462723:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.462741:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 28 pid: 3624 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.462751:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 28 pid: 3624 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.462772:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.462805:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054454400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.462811:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7826 00010000:00010000:1.0:1746129823.463444:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009510c400/0x48868a4e43955863 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35635d expref: 27 pid: 3624 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.463631:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054057600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.463644:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054057728:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.463672:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 26 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.463681:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538bc00, rc 0) 00000100:00100000:1.0:1746129823.463703:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31694:x1830949054454272:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7117us (8684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.463709:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15632 00000100:00100000:2.0:1746129823.463911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.464375:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054454528 00000100:00100000:1.0:1746129823.464379:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054454528 00010000:00010000:1.0:1746129823.464394:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.464421:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7827 00000100:00100000:1.0:1746129823.464427:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054454528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.464436:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.464638:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.464648:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.464664:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02de600/0x48868a4e4395584e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356348 expref: 36 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.464673:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.464675:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.464681:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.464688:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.464710:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.464721:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054057856:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129823.464777:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.466567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.466779:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054454784 00000100:00100000:3.0:1746129823.466785:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054454784 00002000:00100000:3.0:1746129823.466817:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (2031616->2035711) req@ffff8800936dc700 x1830949054454784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.466826:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830949054454784 ext(2031616->2035711) 00002000:00010000:3.0:1746129823.466830:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:1.0:1746129823.466913:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054057856:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129823.466932:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.466963:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054454528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2535us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.466970:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7827 00000100:00100000:3.0:1746129823.467312:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7044 00000100:00100000:3.0:1746129823.467319:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054454784:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129823.467610:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054454784:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 290us (1047us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.467616:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7044 00002000:00100000:3.0:1746129823.467621:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (2031616->2035711) req@ffff8800936dc700 x1830949054454784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.467629:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dc700 with x1830949054454784 ext(2031616->2035711) 00002000:00010000:3.0:1746129823.467631:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dc700 00000100:00100000:0.0:1746129823.469209:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.469319:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054454912 00000100:00100000:1.0:1746129823.469324:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054454912 00000100:00100000:1.0:1746129823.469358:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15633 00000100:00100000:1.0:1746129823.469363:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31694:x1830949054454912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.469374:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.469387:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356428 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.469409:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.469416:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.469427:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.469429:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.469432:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1499135] (req 1048576->1499135) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 27 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.469456:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.469466:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.469476:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054057984:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.469936:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.469944:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 34 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.469955:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054058112:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.470552:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.473041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.473092:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054057984:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.473105:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054058112:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.473132:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1499135] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 27 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.473782:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b538ba00, rc 0) 00000100:00100000:1.0:1746129823.473822:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31694:x1830949054454912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4457us (4616us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.473829:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15633 00000100:00100000:2.0:1746129823.473916:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054455040 00000100:00100000:2.0:1746129823.473922:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054455040 00010000:00010000:2.0:1746129823.473941:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129823.473969:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7828 00000100:00100000:2.0:1746129823.473979:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054455040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.473989:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.474006:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.474014:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.474037:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd08a00/0x48868a4e439558be lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35639c expref: 27 pid: 8437 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.474056:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.474071:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054455040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.474086:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7828 00000100:00100000:0.0:1746129823.474244:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.474425:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054455168 00000100:00100000:3.0:1746129823.474429:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054455168 00010000:00010000:3.0:1746129823.474442:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 35 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.474549:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7829 00000100:00100000:3.0:1746129823.474555:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054455168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.474561:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.474569:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 35 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.474577:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 35 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.474588:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a02dee00/0x48868a4e4395585c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356356 expref: 35 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.474779:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.474781:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.474786:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.474793:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.474816:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.474825:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054058240:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129823.475045:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.481233:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054058240:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129823.481253:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.481300:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054455168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6744us (7055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.481309:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7829 00000100:00100000:0.0:1746129823.481406:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.481504:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054455424 00000100:00100000:3.0:1746129823.481510:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054455424 00002000:00100000:3.0:1746129823.481539:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1495040->1499135) req@ffff8800936dd500 x1830949054455424/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.481548:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd500 with x1830949054455424 ext(1495040->1499135) 00002000:00010000:3.0:1746129823.481552:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd500 00000100:00100000:3.0:1746129823.481579:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7045 00000100:00100000:3.0:1746129823.481586:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054455424:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129823.481843:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054455424:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 257us (436us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.481864:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7045 00002000:00100000:3.0:1746129823.481869:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1495040->1499135) req@ffff8800936dd500 x1830949054455424/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.481876:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd500 with x1830949054455424 ext(1495040->1499135) 00002000:00010000:3.0:1746129823.481879:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936dd500 00000100:00100000:0.0:1746129823.492217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.492273:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054455552 00000100:00100000:1.0:1746129823.492279:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054455552 00000100:00100000:1.0:1746129823.492316:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15634 00000100:00100000:1.0:1746129823.492320:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31695:x1830949054455552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.492333:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.492345:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35642f expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.492365:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.492371:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 5 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.492378:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.492382:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.492383:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.492385:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [741376->1048575] (req 741376->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 28 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.492404:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.492410:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.492417:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054058368:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.492482:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 5 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.492487:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 5 pid: 3624 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.492492:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054058496:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.492504:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 24 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.492512:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 24 pid: 7975 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.492516:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054058624:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.492523:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.493497:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.493532:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.493595:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054455936 00000100:00100000:3.0:1746129823.493600:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054455936 00002000:00100000:3.0:1746129823.493627:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1499136->2097151) req@ffff8800936ded80 x1830949054455936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.493636:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830949054455936 ext(1499136->2097151) 00002000:00010000:3.0:1746129823.493640:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ded80 00000100:00100000:3.0:1746129823.493652:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054455808 00000100:00100000:3.0:1746129823.493654:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054455808 00002000:00100000:3.0:1746129823.493662:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2031615) req@ffff8800936df480 x1830949054455808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.493668:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df480 with x1830949054455808 ext(1048576->2031615) 00002000:00010000:3.0:1746129823.493670:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df480 00000100:00100000:3.0:1746129823.493778:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7046 00000100:00100000:3.0:1746129823.493784:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054455936:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.494683:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7047 00000100:00100000:0.0:1746129823.494691:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054455808:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.499640:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.499642:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054058368:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.499651:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054058496:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.499711:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:3624:1830949054058624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.499733:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129823.499742:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [741376->1048575] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 28 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.499761:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b1200, rc 0) 00000100:00100000:1.0:1746129823.499816:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31695:x1830949054455552:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7494us (7607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.499824:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15634 00000100:00100000:3.0:1746129823.499971:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054456192 00000100:00100000:3.0:1746129823.499977:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054456192 00010000:00010000:3.0:1746129823.500000:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 25 pid: 7975 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.500024:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054456320 00000100:00100000:3.0:1746129823.500026:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054456320 00010000:00010000:3.0:1746129823.500034:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 6 pid: 3624 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129823.500047:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7830 00000100:00100000:3.0:1746129823.500052:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054456192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129823.500053:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7831 00000100:00100000:0.0:1746129823.500060:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054456320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.500061:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.500068:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.500090:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 25 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.500098:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 25 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.500116:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a060000/0x48868a4e43955617 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356206 expref: 25 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.500128:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.500144:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054456192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 92us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.500149:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7830 00000100:00100000:1.0:1746129823.500377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.500394:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054456448 00000100:00100000:2.0:1746129823.500399:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054456448 00010000:00010000:2.0:1746129823.500412:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129823.500427:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7832 00000100:00100000:2.0:1746129823.500432:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054456448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.500440:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.500449:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.500457:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.500468:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d08dc00/0x48868a4e43955633 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356222 expref: 28 pid: 7975 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746129823.500527:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129823.500537:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 6 pid: 3624 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.500547:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 6 pid: 3624 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.500559:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093360e00/0x48868a4e4395577c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3562c3 expref: 6 pid: 3624 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.500571:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.500572:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.500577:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.500584:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.500595:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054456448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 162us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.500602:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7832 00010000:00010000:0.0:1746129823.500607:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.500616:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054058752:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129823.500667:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.501868:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054455808:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7176us (8332us total) trans 0 rc 983040/983040 00000100:00100000:1.0:1746129823.501875:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7047 00002000:00100000:1.0:1746129823.501882:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2031615) req@ffff8800936df480 x1830949054455808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.501890:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936df480 with x1830949054455808 ext(1048576->2031615) 00002000:00010000:1.0:1746129823.501894:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936df480 00000100:00100000:3.0:1746129823.502246:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054455936:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8462us (8751us total) trans 0 rc 598016/598016 00000100:00100000:3.0:1746129823.502252:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7046 00002000:00100000:3.0:1746129823.502256:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1499136->2097151) req@ffff8800936ded80 x1830949054455936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 598016/598016 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.502262:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936ded80 with x1830949054455936 ext(1499136->2097151) 00002000:00010000:3.0:1746129823.502265:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936ded80 00000100:00100000:2.0:1746129823.505097:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054058752:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129823.505097:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129823.505114:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.505226:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054456704 00000100:00100000:3.0:1746129823.505232:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054456704 00002000:00100000:3.0:1746129823.505268:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (741376->745471) req@ffff88012ba3a680 x1830949054456704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.505277:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3a680 with x1830949054456704 ext(741376->745471) 00002000:00010000:3.0:1746129823.505280:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3a680 00000100:00100000:2.0:1746129823.505462:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1961:x1830949054456320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5401us (5727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.505471:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7831 00000100:00100000:3.0:1746129823.505813:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7048 00000100:00100000:3.0:1746129823.505822:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054456704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129823.505987:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054456704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 167us (892us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.505993:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7048 00002000:00100000:3.0:1746129823.505999:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (741376->745471) req@ffff88012ba3a680 x1830949054456704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.506006:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3a680 with x1830949054456704 ext(741376->745471) 00002000:00010000:3.0:1746129823.506008:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3a680 00000100:00100000:0.0:1746129823.509412:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.509504:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054456832 00000100:00100000:1.0:1746129823.509511:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054456832 00000100:00100000:1.0:1746129823.509555:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15635 00000100:00100000:1.0:1746129823.509561:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31695:x1830949054456832:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.509575:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.509589:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356436 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.509618:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.509625:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129823.509626:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129823.509629:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.509653:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 25 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.509662:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.509672:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054058880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.509758:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.513205:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.513272:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054456960 00000100:00100000:3.0:1746129823.513280:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054456960 00000100:00100000:3.0:1746129823.513318:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15636 00000100:00100000:3.0:1746129823.513325:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054456960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.513340:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.513355:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e439559b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35643d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.513397:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054059008:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129823.513753:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.514156:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054058880:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.514176:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->1396735] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 35 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.514187:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0400, rc 0) 00000100:00100000:2.0:1746129823.514211:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31695:x1830949054456832:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4650us (4807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.514220:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15635 00000100:00100000:0.0:1746129823.514588:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.514660:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457088 00000100:00100000:3.0:1746129823.514664:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457088 00002000:00100000:3.0:1746129823.514685:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (2031616->2097151) req@ffff88012ba39880 x1830949054457088/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.514694:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39880 with x1830949054457088 ext(2031616->2097151) 00010000:00010000:3.0:1746129823.514699:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.514709:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.514715:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39880 00000100:00100000:3.0:1746129823.515080:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1906 00000100:00100000:3.0:1746129823.515088:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054457088:12345-192.168.204.31@tcp:4:cat.0 00002000:00010000:2.0:1746129823.515252:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129822 -> 1746129824 00002000:00010000:2.0:1746129823.515256:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129822 -> 1746129824 00002000:00010000:2.0:1746129823.515258:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129822 -> 1746129824 00000100:00100000:2.0:1746129823.515272:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054059008:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.515290:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e439559b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35643d expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.515300:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e439559b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35643d expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.515313:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb5c00, rc 0) 00000100:00100000:2.0:1746129823.515332:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054456960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2008us (2136us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.515337:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15636 00000100:00100000:0.0:1746129823.517386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.517436:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.517508:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457216 00000100:00100000:2.0:1746129823.517513:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457216 00000100:00100000:2.0:1746129823.517546:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457344 00000100:00100000:2.0:1746129823.517548:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457344 00000100:00100000:2.0:1746129823.517560:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15637 00000100:00100000:2.0:1746129823.517565:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054457216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.517576:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.517588:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3c00/0x48868a4e439559ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356444 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.517625:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054059136:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.517684:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.518022:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054457088:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2934us (3433us total) trans 17179874142 rc 0/0 00000100:00100000:3.0:1746129823.518029:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1906 00002000:00100000:3.0:1746129823.518036:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (2031616->2097151) req@ffff88012ba39880 x1830949054457088/t17179874142(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.518044:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39880 with x1830949054457088 ext(2031616->2097151) 00010000:00010000:3.0:1746129823.518050:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.518060:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 29 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.518067:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ba39880 00000100:00100000:0.0:1746129823.518258:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15638 00000100:00100000:0.0:1746129823.518271:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054457344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129823.518278:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.518285:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f985600/0x48868a4e439559c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35644b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.518307:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054059264:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129823.518587:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.519200:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054059136:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.519217:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3c00/0x48868a4e439559ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356444 expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.519226:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3c00/0x48868a4e439559ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356444 expref: 25 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.519233:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c3c00, rc 0) 00000100:00100000:2.0:1746129823.519269:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054457216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1703us (1888us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.519273:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15637 00000100:00100000:0.0:1746129823.522689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.522757:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457472 00000100:00100000:3.0:1746129823.522763:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457472 00010000:00010000:3.0:1746129823.522790:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 30 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:1.0:1746129823.522860:0:7975:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129823 -> 1746129824 00002000:00010000:1.0:1746129823.522863:0:7975:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129823 -> 1746129824 00002000:00010000:1.0:1746129823.522866:0:7975:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129823 -> 1746129824 00000100:00100000:1.0:1746129823.522880:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054059264:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129823.522901:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f985600/0x48868a4e439559c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35644b expref: 30 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.522909:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f985600/0x48868a4e439559c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35644b expref: 30 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.522921:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f985600, rc 0) 00000100:00100000:1.0:1746129823.522950:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054457344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4681us (5513us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129823.522955:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15638 00000100:00100000:3.0:1746129823.523055:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7833 00000100:00100000:3.0:1746129823.523061:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054457472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.523070:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.523088:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.523096:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.523109:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b538bc00/0x48868a4e43955997 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356421 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.523124:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.523125:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.523130:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.523136:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.523161:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.523169:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054059392:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129823.523200:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.526456:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.526599:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457600 00000100:00100000:1.0:1746129823.526611:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457600 00000100:00100000:1.0:1746129823.526672:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15639 00000100:00100000:1.0:1746129823.526681:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054457600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129823.526704:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.526728:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e439559c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356452 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.526777:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054059520:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129823.526836:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b7b0cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.526925:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054059392:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129823.526939:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.526958:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054457472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3897us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.526965:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7833 00000100:00100000:0.0:1746129823.527569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.527617:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457728 00000100:00100000:2.0:1746129823.527621:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457728 00000100:00100000:2.0:1746129823.527651:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15640 00000100:00100000:2.0:1746129823.527657:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054457728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.527666:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.527675:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3800/0x48868a4e439559cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356459 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.527700:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054059648:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.527751:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.529869:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054059520:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129823.529896:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e439559c8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356452 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.529913:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0e00/0x48868a4e439559c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356452 expref: 25 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.529940:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0e00, rc 0) 00000100:00100000:1.0:1746129823.529973:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054457600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3294us (3532us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129823.529981:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15639 00000100:00100000:2.0:1746129823.530259:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054059648:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.530274:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3800/0x48868a4e439559cf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356459 expref: 28 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.530294:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3800/0x48868a4e439559cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356459 expref: 28 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.530305:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c3800, rc 0) 00000100:00100000:2.0:1746129823.530324:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054457728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2667us (2756us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.530329:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15640 00000100:00100000:0.0:1746129823.532340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.532392:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054457984 00000100:00100000:3.0:1746129823.532399:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054457984 00002000:00100000:3.0:1746129823.532435:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1392640->1396735) req@ffff88012ba3ad80 x1830949054457984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.532445:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3ad80 with x1830949054457984 ext(1392640->1396735) 00002000:00010000:3.0:1746129823.532449:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3ad80 00000100:00100000:3.0:1746129823.534026:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7049 00000100:00100000:3.0:1746129823.534038:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054457984:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129823.534208:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054457984:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 173us (1872us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.534215:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7049 00002000:00100000:3.0:1746129823.534222:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1392640->1396735) req@ffff88012ba3ad80 x1830949054457984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.534235:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3ad80 with x1830949054457984 ext(1392640->1396735) 00002000:00010000:3.0:1746129823.534239:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3ad80 00000100:00100000:0.0:1746129823.549287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.549361:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054458112 00000100:00100000:3.0:1746129823.549369:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054458112 00000100:00100000:3.0:1746129823.549951:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11073 00000100:00100000:3.0:1746129823.549960:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31702:x1830949054458112:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.549979:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.549993:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439559d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356460 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.550043:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550054:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550063:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550084:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550089:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550093:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550179:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550192:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 321 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.550199:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 44 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.550205:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.550229:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 44 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.550239:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 44 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.550249:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054059776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.550752:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 321 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.550760:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 321 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.550767:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054059904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.550785:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.553781:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.553926:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054059776:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.553935:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054059904:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.553955:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.554573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.554644:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054458368 00000100:00100000:1.0:1746129823.554650:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054458368 00000100:00100000:1.0:1746129823.554682:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054458624 00000100:00100000:1.0:1746129823.554684:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054458624 00000100:00100000:1.0:1746129823.554697:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4642 00000100:00100000:1.0:1746129823.554703:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+45:27194:x1830949054458368:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129823.554815:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4643 00000100:00100000:3.0:1746129823.554822:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+322:7658:x1830949054458624:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129823.554918:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d62450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+46:27194:x1830949054458368:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 215us (1143us total) trans 8589945098 rc 0/0 00000100:00100000:3.0:1746129823.554921:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+323:7658:x1830949054458624:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 100us (349us total) trans 8589945099 rc 0/0 00000100:00100000:1.0:1746129823.554925:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4642 00000100:00100000:3.0:1746129823.554928:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4643 00000100:00100000:0.0:1746129823.556970:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.557036:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.557789:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054458752 00000100:00100000:3.0:1746129823.557802:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054458752 00010000:00010000:3.0:1746129823.557833:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 46 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.557888:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054458880 00000100:00100000:3.0:1746129823.557891:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054458880 00010000:00010000:3.0:1746129823.557901:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 323 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.557916:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7834 00000100:00100000:3.0:1746129823.557923:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+46:1961:x1830949054458752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.557934:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.557939:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 46 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.557948:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 46 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.557963:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092aa3c00/0x48868a4e43955927 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563d4 expref: 46 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.557977:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00000100:00100000:0.0:1746129823.557978:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7835 00010000:00010000:3.0:1746129823.557981:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.557988:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.557989:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+323:1964:x1830949054458880:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.557992:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.557996:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129823.557997:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.558002:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 323 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.558011:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 323 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.558023:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858200/0x48868a4e439558da lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563b1 expref: 323 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.558029:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+45:1961:x1830949054458752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 106us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.558034:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7834 00010000:00010000:0.0:1746129823.558045:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.558049:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.558055:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.558061:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.558148:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.558166:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+322:1964:x1830949054458880:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 181us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.558171:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7835 00010000:00010000:3.0:1746129823.558308:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558315:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.558347:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129823.558351:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129823.558367:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558375:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558382:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558388:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558393:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558397:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129823.558401:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558406:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558413:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129823.558416:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129823.558419:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558423:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5200/0x48868a4e439559dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558431:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558435:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558439:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558443:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129823.558445:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558449:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558458:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244e00) 00010000:00010000:3.0:1746129823.558460:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129823.558462:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558466:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5000/0x48868a4e439559e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.558490:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439559d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.558499:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.558505:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.558507:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129823.558508:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4a00, rc 0) 00000100:00100000:3.0:1746129823.558530:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31702:x1830949054458112:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8573us (9255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.558535:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11073 00000100:00100000:0.0:1746129823.561638:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.561712:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.561803:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.562031:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459008 00000100:00100000:2.0:1746129823.562040:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459008 00000100:00100000:0.0:1746129823.562109:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459136 00000100:00100000:0.0:1746129823.562112:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459136 00000100:00080000:0.0:1746129823.562132:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129823.562166:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459264 00000100:00100000:1.0:1746129823.562169:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459264 00000100:00100000:2.0:1746129823.562204:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15641 00000100:00100000:2.0:1746129823.562211:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1964:x1830949054459008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.562224:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.562237:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3e00/0x48868a4e439559f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356467 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.562280:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054060032:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.562335:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.562525:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15642 00000100:00100000:0.0:1746129823.562531:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054459136:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129823.562538:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.562547:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e439559f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35646e expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.562571:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054060160:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129823.562590:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.562646:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15643 00000100:00100000:3.0:1746129823.562654:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054459264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.562660:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.562666:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fb5800/0x48868a4e43955a00 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356475 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.562688:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054060288:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129823.562708:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.562929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.563285:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459392 00000100:00100000:1.0:1746129823.563289:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459392 00000100:00100000:1.0:1746129823.563305:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15644 00000100:00100000:1.0:1746129823.563310:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054459392:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129823.563315:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.563323:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35647c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.563337:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.563339:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.563346:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.563502:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.563511:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a54b0a00, rc 0) 00000100:00100000:1.0:1746129823.563534:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054459392:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 224us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.563539:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15644 00000100:00100000:0.0:1746129823.565650:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.565693:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.565777:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459520 00000100:00100000:2.0:1746129823.565785:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459520 00000100:00100000:2.0:1746129823.565813:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459648 00000100:00100000:2.0:1746129823.565815:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459648 00000100:00100000:2.0:1746129823.565867:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15645 00000100:00100000:2.0:1746129823.565874:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054459520:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.565886:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.565899:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356483 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.565917:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.565919:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.565926:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.565938:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.565946:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c2c00, rc 0) 00000100:00100000:2.0:1746129823.565979:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054459520:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 106us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.565985:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15645 00000100:00100000:2.0:1746129823.565998:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15646 00000100:00100000:2.0:1746129823.566002:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054459648:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.566008:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.566142:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35648a expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.566153:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.566154:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.566158:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.566166:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.566176:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c3000, rc 0) 00000100:00100000:2.0:1746129823.566189:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054459648:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 187us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.566194:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15646 00000100:00100000:1.0:1746129823.567212:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054060160:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129823.567235:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e439559f9 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35646e expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.567245:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e439559f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35646e expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129823.567255:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054060032:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129823.567257:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f984400, rc 0) 00010000:00010000:3.0:1746129823.567269:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3e00/0x48868a4e439559f2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356467 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.567278:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3e00/0x48868a4e439559f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356467 expref: 8 pid: 4589 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129823.567278:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1964:x1830949054459136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4748us (5566us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129823.567283:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15642 00010000:00010000:3.0:1746129823.567286:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c3e00, rc 0) 00000100:00100000:3.0:1746129823.567304:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009468f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1964:x1830949054459008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5094us (5674us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.568005:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15641 00002000:00010000:3.0:1746129823.568033:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.568036:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.568038:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129823 -> 1746129824 00000100:00100000:3.0:1746129823.568046:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054060288:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.568060:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fb5800/0x48868a4e43955a00 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356475 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.568068:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fb5800/0x48868a4e43955a00 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356475 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.568087:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb5800, rc 0) 00000100:00100000:3.0:1746129823.568108:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054459264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5456us (6305us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.568113:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15643 00000100:00100000:0.0:1746129823.569447:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.569589:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054459904 00000100:00100000:3.0:1746129823.569595:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054459904 00000100:00100000:3.0:1746129823.569627:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11074 00000100:00100000:3.0:1746129823.569632:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31702:x1830949054459904:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.569645:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.569658:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356491 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.569731:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.569744:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.569749:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.569772:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.569781:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 14 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.569790:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054060416:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.569883:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.571441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.571514:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054060416:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.571528:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129823.571879:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460032 00000100:00100000:1.0:1746129823.571884:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460032 00010000:00010000:1.0:1746129823.571906:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 15 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.571934:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7836 00000100:00100000:1.0:1746129823.571939:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054460032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.571948:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.571953:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 15 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.571961:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 15 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.571978:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4a00/0x48868a4e439559eb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356460 expref: 15 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.571989:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129823.571993:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.572000:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.572005:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.572722:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129823.572799:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.572806:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129823.572821:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129823.572948:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.572975:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.572981:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.572983:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129823.572986:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb5c00, rc 0) 00000100:00100000:1.0:1746129823.573728:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054460032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1785us (2287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.573737:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7836 00000100:00100000:2.0:1746129823.574147:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31702:x1830949054459904:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4512us (4702us total) trans 8589945100 rc 0/0 00000100:00100000:2.0:1746129823.574154:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11074 00000100:00100000:0.0:1746129823.577556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.577675:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460160 00000100:00100000:3.0:1746129823.577683:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460160 00000100:00100000:3.0:1746129823.577719:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11075 00000100:00100000:3.0:1746129823.577726:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31702:x1830949054460160:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.577745:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.577760:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5600/0x48868a4e43955a31 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356498 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.577825:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.577837:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.577843:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.577890:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.577900:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 15 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.578136:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054060544:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.578662:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.580193:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.580275:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054060544:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.580291:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129823.580353:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460288 00000100:00100000:1.0:1746129823.580358:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460288 00010000:00010000:1.0:1746129823.580380:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 16 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.580399:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7837 00000100:00100000:1.0:1746129823.580411:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:1962:x1830949054460288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.580423:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.580429:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 16 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.580437:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 16 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.580455:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a23 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356491 expref: 16 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.580529:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129823.580533:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.580541:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.580547:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.580735:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129823.580810:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.580816:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.580867:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129823.580871:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129823.580883:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.580906:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5600/0x48868a4e43955a31 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356498 expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.580930:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356498 expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.580935:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.580937:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129823.580939:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4e00, rc 0) 00000100:00100000:1.0:1746129823.581028:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054460288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 617us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.581035:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7837 00000100:00100000:3.0:1746129823.581329:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31702:x1830949054460160:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3602us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.581335:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11075 00000100:00100000:0.0:1746129823.583193:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.583951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.583991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.584257:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460416 00000100:00100000:2.0:1746129823.584264:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460416 00000100:00100000:2.0:1746129823.584301:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460544 00000100:00100000:2.0:1746129823.584303:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460544 00000100:00100000:2.0:1746129823.584315:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460672 00000100:00100000:2.0:1746129823.584316:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460672 00000100:00100000:2.0:1746129823.584330:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15647 00000100:00100000:2.0:1746129823.584336:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054460416:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.584350:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.584364:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2400/0x48868a4e43955a3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35649f expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.584406:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054060672:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.584462:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.584476:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15648 00000100:00100000:2.0:1746129823.584480:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054460544:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.584486:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.584495:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c2e00/0x48868a4e43955a46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564a6 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.584515:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054060800:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.584532:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd900 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.584597:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15649 00000100:00100000:3.0:1746129823.584605:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054460672:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.584611:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.584617:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fb4a00/0x48868a4e43955a4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564ad expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.584637:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054060928:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129823.584657:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.588407:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054060672:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.588445:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2400/0x48868a4e43955a3f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35649f expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.588460:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2400/0x48868a4e43955a3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35649f expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.588473:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c2400, rc 0) 00000100:00100000:3.0:1746129823.588687:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054060800:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.588702:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c2e00/0x48868a4e43955a46 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564a6 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.588710:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c2e00/0x48868a4e43955a46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564a6 expref: 9 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.588717:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c2e00, rc 0) 00000100:00100000:0.0:1746129823.588939:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054060928:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129823.588954:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094fb4a00/0x48868a4e43955a4d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ad expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.588965:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fb4a00/0x48868a4e43955a4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ad expref: 8 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.588975:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4a00, rc 0) 00000100:00100000:2.0:1746129823.589198:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054460416:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4861us (6010us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.589206:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15647 00000100:00100000:3.0:1746129823.589273:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054460544:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4792us (5321us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.589278:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15648 00000100:00100000:0.0:1746129823.589437:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054460672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4833us (5445us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129823.589442:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15649 00000100:00100000:0.0:1746129823.592701:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.592817:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054460928 00000100:00100000:3.0:1746129823.592824:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054460928 00000100:00100000:3.0:1746129823.592885:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11076 00000100:00100000:3.0:1746129823.592892:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31702:x1830949054460928:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.592908:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.592921:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955a54 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564b4 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.592993:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43955a5b lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.593005:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43955a5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.593014:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43955a5b lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.593027:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129823.593128:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e43955a54 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564b4 expref: 17 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.593140:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43955a5b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564b4 expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.593148:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.593150:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129823.593153:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4c00, rc 0) 00000100:00100000:3.0:1746129823.593200:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31702:x1830949054460928:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 308us (505us total) trans 8589945101 rc 0/0 00000100:00100000:3.0:1746129823.593206:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11076 00000100:00100000:2.0:1746129823.595950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.596039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.596050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.596065:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461184 00000100:00100000:2.0:1746129823.596080:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461184 00000100:00100000:2.0:1746129823.596382:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461440 00000100:00100000:2.0:1746129823.596385:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461440 00000100:00100000:3.0:1746129823.596408:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461696 00000100:00100000:3.0:1746129823.596412:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461696 00000100:00100000:0.0:1746129823.596830:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15650 00000100:00100000:0.0:1746129823.596838:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054461184:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129823.596884:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.596900:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.596906:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129823.596908:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129823.596911:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.596935:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.596945:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.596956:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054061056:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.597159:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.597230:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15651 00000100:00100000:3.0:1746129823.597236:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054461440:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:1.0:1746129823.597237:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15652 00000100:00100000:1.0:1746129823.597242:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054461696:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129823.597253:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597254:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.597263:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597263:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 34 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.597269:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.597269:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.597275:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597279:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.597281:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 26 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597281:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.597282:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.597286:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.597287:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.597288:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597295:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.597299:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 26 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597302:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.597309:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054061184:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.597340:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 7 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.597347:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 7 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.597354:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054061440:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.597384:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 34 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.597391:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 34 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.597398:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054061568:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.597413:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4c8ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.597495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.597508:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461056 00000100:00100000:2.0:1746129823.597511:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461056 00000100:00100000:2.0:1746129823.597525:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15653 00000100:00100000:2.0:1746129823.597529:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054461056:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129823.597542:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.597550:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 26 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.597555:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.597556:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.597558:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.597570:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 26 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.597581:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.597589:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054061696:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.597606:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.597647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.597659:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461312 00000100:00100000:2.0:1746129823.597662:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461312 00000100:00100000:2.0:1746129823.597677:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15654 00000100:00100000:2.0:1746129823.597681:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054461312:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:0.0:1746129823.597930:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.597943:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461568 00000100:00100000:0.0:1746129823.597946:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461568 00000100:00100000:0.0:1746129823.597960:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15655 00000100:00100000:0.0:1746129823.597964:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054461568:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:0.0:1746129823.597977:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.597986:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.598067:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.598080:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.598085:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.598086:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.598088:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.598102:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.598113:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.598121:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054061824:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129823.598148:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.598154:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 9 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746129823.598161:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054061952:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129823.598177:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.598184:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.598189:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054062080:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.598200:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b198d900 going to sleep for 11 seconds 00010000:00010000:2.0:1746129823.598274:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.598287:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 26 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.598292:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.598293:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.598295:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.598311:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 26 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.598318:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.598330:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054062208:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.598346:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd180 going to sleep for 11 seconds 00010000:00010000:3.0:1746129823.599733:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 26 pid: 7975 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.599745:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054061312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.600151:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.600159:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 9 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129823.600166:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054062336:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.600188:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 23 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.600199:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 23 pid: 7975 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.600205:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054062464:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.600219:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.611669:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054061824:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.611670:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054061184:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.611681:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054061440:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.611688:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054061568:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.611705:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054061952:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.611717:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.611727:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054062080:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129823.611746:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.611786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.611816:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.611831:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054062336:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.611833:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.611838:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054062464:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.611844:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054061312:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.611844:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.611874:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129823.611877:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.611884:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.611893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.611896:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462336 00000100:00100000:3.0:1746129823.611901:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462336 00000100:00100000:0.0:1746129823.611901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.611909:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462976 00000100:00100000:0.0:1746129823.611911:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462976 00010000:00010000:0.0:1746129823.611923:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 27 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.611924:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 10 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746129823.611934:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462080 00000100:00100000:0.0:1746129823.611935:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462080 00000100:00100000:3.0:1746129823.611936:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462720 00000100:00100000:3.0:1746129823.611938:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462720 00010000:00010000:0.0:1746129823.611940:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.611944:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054463104 00000100:00100000:0.0:1746129823.611945:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054463104 00010000:00010000:3.0:1746129823.611947:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 11 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129823.611956:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461952 00000100:00100000:3.0:1746129823.611958:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461952 00010000:00010000:3.0:1746129823.611967:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 9 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129823.611981:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7838 00000100:00100000:3.0:1746129823.611987:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054462976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.611997:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.612013:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 27 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612022:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 27 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612038:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092aa3200/0x48868a4e43955935 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563db expref: 27 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612053:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.612094:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1963:x1830949054462976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.612100:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7838 00010000:00010000:0.0:1746129823.612106:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 24 pid: 7975 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.612112:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7839 00000100:00100000:3.0:1746129823.612117:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054462336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129823.612120:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7840 00010000:00010000:3.0:1746129823.612122:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129823.612126:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054462080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.612130:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 11 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.612133:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.612137:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 11 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.612145:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612151:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c2c00/0x48868a4e43955a0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356483 expref: 11 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.612153:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612159:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129823.612165:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c11da00/0x48868a4e4395596d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356413 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.612176:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054462336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 55us (354us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129823.612178:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.612181:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7839 00000100:00100000:0.0:1746129823.612193:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054462080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.612194:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7841 00000100:00100000:3.0:1746129823.612198:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054462720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129823.612199:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7840 00010000:00010000:3.0:1746129823.612204:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746129823.612209:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7842 00010000:00010000:3.0:1746129823.612210:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 9 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746129823.612213:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054461952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.612218:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 9 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.612218:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.612225:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 9 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129823.612227:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0a00/0x48868a4e43955a07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35647c expref: 9 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746129823.612231:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 9 pid: 10930 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129823.612234:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129823.612239:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3000/0x48868a4e43955a15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35648a expref: 9 pid: 10930 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746129823.612247:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054462720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 49us (361us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129823.612250:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129823.612251:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7841 00000100:00100000:3.0:1746129823.612259:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7843 00000100:00100000:3.0:1746129823.612263:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054463104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746129823.612263:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054461952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.612268:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7842 00010000:00010000:3.0:1746129823.612269:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.612274:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 24 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612280:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 24 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612288:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e43955919 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563cd expref: 24 pid: 7975 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612295:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.612296:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.612299:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.612307:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.612308:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.612318:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462208 00000100:00100000:0.0:1746129823.612321:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462208 00010000:00010000:3.0:1746129823.612322:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129823.612329:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.612335:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054463104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.612339:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7844 00000100:00100000:3.0:1746129823.612342:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7843 00000100:00100000:0.0:1746129823.612342:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054462208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.612348:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.612354:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.612360:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.612369:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f984e00/0x48868a4e43955966 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35640c expref: 35 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612371:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.612375:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.612377:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.612377:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.612379:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.612389:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.612397:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.612400:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129823.612403:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.612410:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.612414:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054462208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (106us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129823.612415:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129823.612418:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.612419:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7844 00010000:00010000:3.0:1746129823.612425:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.612434:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.612439:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fb5c00/0x48868a4e43955a70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.612461:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.612472:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054461440:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 15236us (16433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.612478:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15651 00000100:00100000:0.0:1746129823.612483:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.612491:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462848 00000100:00100000:0.0:1746129823.612493:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462848 00000100:00100000:3.0:1746129823.612501:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054061696:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129823.612502:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.612511:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.612513:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7845 00000100:00100000:0.0:1746129823.612517:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054462848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.612522:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129823.612527:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054461824 00010000:00010000:0.0:1746129823.612528:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.612530:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054461824 00010000:00010000:0.0:1746129823.612534:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.612543:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f881e00/0x48868a4e43955958 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563fe expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00002000:00100000:3.0:1746129823.612550:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1396735) req@ffff8800a00c4e00 x1830949054461824/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746129823.612555:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746129823.612557:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4e00 with x1830949054461824 ext(1048576->1396735) 00010000:00010000:3.0:1746129823.612563:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.612568:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054462848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (84us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129823.612571:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 34 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.612573:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7845 00002000:00010000:3.0:1746129823.612576:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a00c4e00 00000100:00100000:3.0:1746129823.612591:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462464 00000100:00100000:3.0:1746129823.612594:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462464 00002000:00100000:3.0:1746129823.612605:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (741376->1048575) req@ffff8800a00c4a80 x1830949054462464/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.612611:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949054462464 ext(741376->1048575) 00010000:00010000:3.0:1746129823.612616:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.612616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129823.612622:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 25 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.612626:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054463232 00002000:00010000:3.0:1746129823.612627:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a00c4a80 00000100:00100000:0.0:1746129823.612628:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054463232 00000100:00100000:3.0:1746129823.612636:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054462592 00000100:00100000:3.0:1746129823.612638:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054462592 00010000:00010000:0.0:1746129823.612638:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00002000:00100000:3.0:1746129823.612645:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1499135) req@ffff8801305be300 x1830949054462592/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.612651:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305be300 with x1830949054462592 ext(1048576->1499135) 00000100:00100000:0.0:1746129823.612651:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7846 00010000:00010000:3.0:1746129823.612655:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.612655:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054463232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.612660:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.612661:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 26 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.612666:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305be300 00010000:00010000:0.0:1746129823.612666:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.612674:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1907 00000100:00100000:3.0:1746129823.612678:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054461824:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129823.612965:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1908 00000100:00100000:3.0:1746129823.612971:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054462464:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:0.0:1746129823.613002:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.613016:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f880c00/0x48868a4e43955951 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3563f7 expref: 23 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.613024:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.613025:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.613027:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613037:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613050:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.613065:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054463232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 410us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.613080:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7846 00010000:00010000:0.0:1746129823.613095:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613100:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613112:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613118:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613123:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613128:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f984400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129823.613130:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613139:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613147:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613152:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f984400/0x48868a4e43955a8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.613176:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054461568:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 15211us (15246us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.613182:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15655 00000100:00100000:3.0:1746129823.613203:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1909 00000100:00100000:3.0:1746129823.613209:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054462592:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129823.613331:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054062208:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.613342:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.613370:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054061056:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.613379:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613600:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613608:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613620:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613626:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613631:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613641:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54b0c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129823.613643:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613649:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613657:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.613662:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0c00/0x48868a4e43955a77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.613708:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054461696:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 16464us (17655us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.613714:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15652 00000100:00100000:3.0:1746129823.621499:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1964:x1830949054461824:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 8811us (9706us total) trans 17179874143 rc 0/0 00000100:00100000:3.0:1746129823.621508:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1907 00002000:00100000:3.0:1746129823.621516:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1396735) req@ffff8800a00c4e00 x1830949054461824/t17179874143(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.621524:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4e00 with x1830949054461824 ext(1048576->1396735) 00010000:00010000:3.0:1746129823.621532:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 36 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.621542:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 36 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.621548:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a00c4e00 00000100:00100000:2.0:1746129823.623348:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054462464:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 10372us (11468us total) trans 21474841336 rc 0/0 00000100:00100000:2.0:1746129823.623358:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1908 00002000:00100000:2.0:1746129823.623366:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (741376->1048575) req@ffff8800a00c4a80 x1830949054462464/t21474841336(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.623373:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949054462464 ext(741376->1048575) 00010000:00010000:2.0:1746129823.623381:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.623392:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.623398:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a00c4a80 00000100:00100000:0.0:1746129823.629206:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.629236:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.630263:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054462592:12345-192.168.204.31@tcp:4:cat.0 Request processed in 17051us (17798us total) trans 17179874144 rc 0/0 00000100:00100000:3.0:1746129823.630273:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1909 00002000:00100000:3.0:1746129823.630282:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1499135) req@ffff8801305be300 x1830949054462592/t17179874144(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.630290:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305be300 with x1830949054462592 ext(1048576->1499135) 00010000:00010000:3.0:1746129823.630298:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.630308:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.630314:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801305be300 00000100:00100000:1.0:1746129823.630385:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054463488 00000100:00100000:1.0:1746129823.630392:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054463488 00010000:00010000:1.0:1746129823.630412:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.630432:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054463360 00000100:00100000:1.0:1746129823.630434:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054463360 00010000:00010000:1.0:1746129823.630441:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 36 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.630452:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7847 00000100:00100000:1.0:1746129823.630456:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054463488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.630465:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.630478:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.630487:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.630504:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b1200/0x48868a4e439559a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 741376->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35642f expref: 27 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.630518:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.630520:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.630524:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.630530:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.630547:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.630564:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054463488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.630569:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7847 00000100:00100000:1.0:1746129823.630581:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7848 00000100:00100000:1.0:1746129823.630585:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054463360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.630591:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.630600:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 36 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.630607:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 36 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.630617:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a54b0400/0x48868a4e439559ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1396735) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356436 expref: 36 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.630625:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.630627:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.630629:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.630636:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.630647:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.630661:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054463360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 75us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.630666:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7848 00010000:00010000:2.0:1746129823.630909:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630916:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630932:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630938:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630945:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630951:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f985c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129823.630955:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630961:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630970:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.630976:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f985c00/0x48868a4e43955a69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.631018:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054461184:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 34181us (35073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.631025:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15650 00010000:00010000:3.0:1746129823.631576:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631584:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631599:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631606:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631612:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631617:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6c3200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129823.631619:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631625:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631633:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.631638:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c3200/0x48868a4e43955a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.633206:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054461056:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 35669us (35705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.633215:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15653 00000100:00100000:0.0:1746129823.635841:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.636129:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054463616 00000100:00100000:3.0:1746129823.636137:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054463616 00010000:00010000:3.0:1746129823.636167:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.636197:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7849 00000100:00100000:3.0:1746129823.636202:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054463616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.636213:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.636230:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.636240:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.636257:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b538ba00/0x48868a4e4395599e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356428 expref: 28 pid: 3624 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.636272:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.636274:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.636277:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.636284:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.636456:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129823.636771:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636779:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636794:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636800:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636806:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636811:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6c3e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129823.636814:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636820:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636828:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.636834:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c3e00/0x48868a4e43955a85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.636965:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054463616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 761us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.636971:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7849 00000100:00100000:2.0:1746129823.637045:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054461312:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 39364us (39397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.637052:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15654 00000100:00100000:0.0:1746129823.638473:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.639022:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054463872 00000100:00100000:2.0:1746129823.639029:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054463872 00000100:00100000:2.0:1746129823.639084:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11077 00000100:00100000:2.0:1746129823.639090:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+16:31702:x1830949054463872:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129823.639128:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.639147:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e43955a38 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356498 expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639159:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.639163:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129823.639183:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.639192:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 44 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639198:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639203:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 44 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639214:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 44 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639219:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 321 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639224:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 44 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639229:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.639252:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 44 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639263:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 44 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.639274:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062592:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.639346:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 321 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639353:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 321 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.639359:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062720:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.639381:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 44 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639388:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 44 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.639393:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062848:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.639426:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 44 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639432:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 44 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.639439:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062976:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.639458:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639464:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.639470:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054063104:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.639489:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 44 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.639496:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 44 pid: 14315 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.639502:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054063232:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.639518:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.645244:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062592:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.645522:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.645595:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062720:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.645603:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062848:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.645609:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054062976:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.645712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.645725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.645793:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464512 00000100:00100000:3.0:1746129823.645800:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464512 00000100:00100000:1.0:1746129823.645917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.646029:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4644 00000100:00100000:3.0:1746129823.646037:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+45:27194:x1830949054464512:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129823.646227:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+46:27194:x1830949054464512:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 191us (706us total) trans 8589945102 rc 0/0 00000100:00100000:3.0:1746129823.646233:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4644 00000100:00100000:2.0:1746129823.646516:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464384 00000100:00100000:2.0:1746129823.646520:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464384 00010000:00010000:2.0:1746129823.646541:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 46 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.646558:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464000 00000100:00100000:2.0:1746129823.646560:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464000 00010000:00010000:2.0:1746129823.646568:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 47 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.646578:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464128 00000100:00100000:2.0:1746129823.646579:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464128 00010000:00010000:2.0:1746129823.646586:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 322 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.646604:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7850 00000100:00100000:2.0:1746129823.646608:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+47:1963:x1830949054464384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.646617:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.646621:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 47 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646630:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 47 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646647:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae0000/0x48868a4e43954faa lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e4e expref: 47 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646660:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.646664:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.646672:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.646689:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+46:1963:x1830949054464384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 81us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.646695:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7850 00000100:00100000:2.0:1746129823.646725:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7851 00000100:00100000:2.0:1746129823.646730:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+45:1961:x1830949054464000:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.646736:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.646739:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 45 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646746:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 45 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646755:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f858800/0x48868a4e43955450 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560d9 expref: 45 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646762:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.646764:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.646772:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.646784:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+44:1961:x1830949054464000:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.646788:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7851 00000100:00100000:2.0:1746129823.646797:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7852 00000100:00100000:2.0:1746129823.646801:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+322:1961:x1830949054464128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.646806:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.646809:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 322 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646815:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 322 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646823:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f98e200/0x48868a4e439553f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3560b6 expref: 322 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.646830:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.646833:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.646837:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.646868:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+321:1961:x1830949054464128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.646872:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7852 00000100:00100000:1.0:1746129823.647936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.647963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.647989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.648055:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054063104:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.648063:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054063232:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.648096:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129823.648136:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464640 00000100:00100000:0.0:1746129823.648140:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464640 00010000:00010000:0.0:1746129823.648156:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.648169:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464768 00000100:00100000:0.0:1746129823.648171:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464768 00010000:00010000:0.0:1746129823.648178:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 44 pid: 14315 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.648188:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054464896 00000100:00100000:0.0:1746129823.648189:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054464896 00010000:00010000:0.0:1746129823.648196:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 45 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.648206:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7853 00000100:00100000:0.0:1746129823.648211:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+321:1963:x1830949054464640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.648218:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.648222:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648228:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648242:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094b09c00/0x48868a4e43954fa3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e47 expref: 321 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648252:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.648255:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129823.648260:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.648277:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+320:1963:x1830949054464640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 66us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.648282:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7853 00000100:00100000:0.0:1746129823.648291:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7854 00000100:00100000:0.0:1746129823.648295:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+45:1963:x1830949054464768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.648300:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.648303:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 45 pid: 14315 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648309:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 45 pid: 14315 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648317:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f0cc00/0x48868a4e43954f9c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf355e2b expref: 45 pid: 14315 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648324:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.648327:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129823.648331:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.648342:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+44:1963:x1830949054464768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 47us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.648346:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7854 00000100:00100000:0.0:1746129823.648353:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7855 00000100:00100000:0.0:1746129823.648357:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+43:1962:x1830949054464896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.648362:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.648366:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 43 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648373:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 43 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648381:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507fe00/0x48868a4e4395531c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356023 expref: 43 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.648388:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.648390:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129823.648396:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129823.648402:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129823.648416:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.648427:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+42:1962:x1830949054464896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.648432:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7855 00010000:00010000:2.0:1746129823.648610:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.648616:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000040:00080000:2.0:1746129823.649262:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3524, 88 off296848 00000004:00080000:2.0:1746129823.649269:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707420955ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649335:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3529, 88 off297200 00000004:00080000:2.0:1746129823.649339:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707491034ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649350:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3530, 88 off297288 00000004:00080000:2.0:1746129823.649352:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707504172ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649359:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3525, 88 off296936 00000004:00080000:2.0:1746129823.649361:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707512924ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649371:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3526, 88 off297024 00000004:00080000:2.0:1746129823.649373:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707525561ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649383:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3531, 88 off297376 00000004:00080000:2.0:1746129823.649385:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707536980ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649390:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3532, 88 off297464 00000004:00080000:2.0:1746129823.649392:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707544600ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649398:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3533, 88 off297552 00000004:00080000:2.0:1746129823.649401:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707552819ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649406:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3527, 88 off297112 00000004:00080000:2.0:1746129823.649408:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707560531ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649417:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3534, 88 off297640 00000004:00080000:2.0:1746129823.649419:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707570951ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649425:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3528, 88 off297200 00000004:00080000:2.0:1746129823.649428:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707579651ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649436:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3535, 88 off297728 00000004:00080000:2.0:1746129823.649438:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707590535ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.649444:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3529, 88 off297288 00000004:00080000:2.0:1746129823.649447:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707598960ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649456:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3530, 88 off297376 00000004:00080000:2.0:1746129823.649458:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707610281ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649468:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3531, 88 off297464 00000004:00080000:2.0:1746129823.649470:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707622525ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649479:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3532, 88 off297552 00000004:00080000:2.0:1746129823.649482:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769707634066ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.649492:0:1851:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3536, 88 off297816 00000004:00080000:2.0:1746129823.649494:0:1851:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769707646080ns, next at 716792379979ns, rc = 0 00000001:00080000:0.0:1746129823.674133:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945092 is committed 00000001:00080000:0.0:1746129823.674144:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945087 is committed 00000001:00080000:0.0:1746129823.674152:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945060 is committed 00000001:00080000:0.0:1746129823.674158:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945098 is committed 00000001:00080000:0.0:1746129823.674161:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945095 is committed 00000001:00080000:0.0:1746129823.674203:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945103 is committed 00000004:00080000:0.0:1746129823.674206:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2703 committed 00000004:00010000:3.0:1746129823.674429:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801305bd500 reply state ffff88013595c000 transno 8589945103 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129823.674441:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746129823.674521:0:1851:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129823.674545:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:31702:x1830949054463872:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 35451us (36073us total) trans 8589945103 rc 0/0 00000100:00100000:3.0:1746129823.674553:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11077 00000004:00080000:0.0:1746129823.674601:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2704 committed 00000004:00080000:0.0:1746129823.674607:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2703 committed 00000004:00080000:0.0:1746129823.674608:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2702 committed 00000004:00080000:0.0:1746129823.674610:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2701 committed 00000004:00080000:0.0:1746129823.674611:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2702 committed 00000004:00080000:0.0:1746129823.674614:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2700 committed 00000004:00080000:0.0:1746129823.674616:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2701 committed 00000004:00080000:0.0:1746129823.674617:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2699 committed 00000004:00080000:0.0:1746129823.674619:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2700 committed 00000004:00080000:0.0:1746129823.674621:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2699 committed 00000004:00080000:0.0:1746129823.674623:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2698 committed 00000004:00080000:0.0:1746129823.674625:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2698 committed 00000004:00080000:0.0:1746129823.674626:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2697 committed 00000004:00080000:0.0:1746129823.674627:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2697 committed 00000004:00080000:0.0:1746129823.674629:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2696 committed 00000004:00080000:0.0:1746129823.674630:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2696 committed 00000001:00080000:0.0:1746129823.674673:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945102 is committed 00000001:00080000:0.0:1746129823.674678:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945099 is committed 00010000:00010000:2.0:1746129823.674767:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.674774:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.674780:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.674785:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918ed600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129823.674788:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.674794:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.674806:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.674809:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129823.674813:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129823.674818:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ed600/0x48868a4e43955a93 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129823.674957:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054063360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.674997:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675018:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054063872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675031:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675044:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129823.675048:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054063744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675060:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675083:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054064256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675096:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675111:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054063616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675124:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675133:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054064128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675144:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675154:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129823.675158:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054063488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675169:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675177:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054064000:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675188:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.675204:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054063360 00000100:00100000:2.0:1746129823.675209:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054063360 00000100:00100000:2.0:1746129823.675236:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054063872 00000100:00100000:2.0:1746129823.675238:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054063872 00000100:00100000:2.0:1746129823.675246:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054063744 00000100:00100000:2.0:1746129823.675248:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054063744 00000100:00100000:2.0:1746129823.675254:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064256 00000100:00100000:2.0:1746129823.675256:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064256 00000100:00100000:2.0:1746129823.675264:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054063616 00000100:00100000:2.0:1746129823.675265:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054063616 00000100:00100000:2.0:1746129823.675270:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064128 00000100:00100000:2.0:1746129823.675272:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064128 00000100:00100000:2.0:1746129823.675277:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054063488 00000100:00100000:2.0:1746129823.675278:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054063488 00000100:00100000:2.0:1746129823.675282:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064000 00000100:00100000:2.0:1746129823.675284:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064000 00000100:00100000:2.0:1746129823.675291:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15656 00000100:00100000:2.0:1746129823.675297:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949054063360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675434:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949054063360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (435us total) trans 21474841337 rc 0/0 00000100:00100000:2.0:1746129823.675439:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15656 00000100:00100000:2.0:1746129823.675447:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15657 00000100:00100000:2.0:1746129823.675451:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949054063872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675529:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949054063872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (497us total) trans 21474841338 rc 0/0 00000100:00100000:2.0:1746129823.675534:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15657 00000100:00100000:2.0:1746129823.675542:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15658 00000100:00100000:2.0:1746129823.675546:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949054063744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675616:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949054063744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (555us total) trans 21474841339 rc 0/0 00000100:00100000:2.0:1746129823.675621:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15658 00000100:00100000:2.0:1746129823.675630:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15659 00000100:00100000:2.0:1746129823.675633:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3299:x1830949054064256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675697:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949054064256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (600us total) trans 21474841340 rc 0/0 00000100:00100000:2.0:1746129823.675702:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15659 00000100:00100000:2.0:1746129823.675710:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15660 00000100:00100000:2.0:1746129823.675713:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949054063616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675784:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949054063616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (659us total) trans 21474841341 rc 0/0 00000100:00100000:2.0:1746129823.675788:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15660 00000100:00100000:2.0:1746129823.675795:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15661 00000100:00100000:2.0:1746129823.675799:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949054064128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746129823.675876:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129823.675879:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129823.675880:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129823.675882:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129823.675884:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129823.675901:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949054064128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 101us (755us total) trans 21474841342 rc 0/0 00000100:00100000:2.0:1746129823.675905:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15661 00000100:00100000:2.0:1746129823.675914:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15662 00000100:00100000:2.0:1746129823.675917:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949054063488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.675979:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949054063488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (809us total) trans 21474841343 rc 0/0 00000100:00100000:2.0:1746129823.675984:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15662 00000100:00100000:2.0:1746129823.675992:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15663 00000100:00100000:2.0:1746129823.675996:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3297:x1830949054064000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.676064:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949054064000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (875us total) trans 21474841344 rc 0/0 00000100:00100000:2.0:1746129823.676079:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15663 00000100:00100000:2.0:1746129823.676112:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841319 gen 2 00000004:00080000:2.0:1746129823.676116:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaea00, transno 21474841208 00000004:00080000:2.0:1746129823.676121:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac000, transno 21474841209 00000004:00080000:2.0:1746129823.676122:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaf800, transno 21474841210 00000004:00080000:2.0:1746129823.676125:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaf480, transno 21474841211 00000004:00080000:2.0:1746129823.676127:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ada680, transno 21474841212 00000004:00080000:2.0:1746129823.676128:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac700, transno 21474841213 00000004:00080000:2.0:1746129823.676130:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac380, transno 21474841214 00000004:00080000:2.0:1746129823.676131:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad880, transno 21474841215 00000004:00080000:2.0:1746129823.676133:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adadf80, transno 21474841216 00000004:00080000:2.0:1746129823.676135:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631b800, transno 21474841217 00000004:00080000:2.0:1746129823.676137:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319c00, transno 21474841218 00000004:00080000:2.0:1746129823.676139:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631a300, transno 21474841219 00000004:00080000:2.0:1746129823.676140:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64a80, transno 21474841220 00000004:00080000:2.0:1746129823.676142:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319880, transno 21474841221 00000004:00080000:2.0:1746129823.676144:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009be64700, transno 21474841222 00000004:00080000:2.0:1746129823.676145:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013631a680, transno 21474841223 00000004:00080000:2.0:1746129823.676147:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136319180, transno 21474841224 00000004:00080000:2.0:1746129823.676149:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1bb80, transno 21474841225 00000004:00080000:2.0:1746129823.676150:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19180, transno 21474841226 00000004:00080000:2.0:1746129823.676152:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1a300, transno 21474841227 00000004:00080000:2.0:1746129823.676153:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18700, transno 21474841228 00000004:00080000:2.0:1746129823.676155:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18e00, transno 21474841229 00000004:00080000:2.0:1746129823.676157:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b800, transno 21474841230 00000004:00080000:2.0:1746129823.676159:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19f80, transno 21474841231 00000004:00080000:2.0:1746129823.676161:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b480, transno 21474841232 00000004:00080000:2.0:1746129823.676163:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18000, transno 21474841233 00000004:00080000:2.0:1746129823.676164:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad9500, transno 21474841234 00000004:00080000:2.0:1746129823.676166:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284fb80, transno 21474841237 00000004:00080000:2.0:1746129823.676168:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c043100, transno 21474841238 00000004:00080000:2.0:1746129823.676169:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c041c00, transno 21474841239 00000004:00080000:2.0:1746129823.676171:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39180, transno 21474841240 00000004:00080000:2.0:1746129823.676173:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d180, transno 21474841241 00000004:00080000:2.0:1746129823.676174:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5491500, transno 21474841242 00000004:00080000:2.0:1746129823.676176:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d880, transno 21474841243 00000004:00080000:2.0:1746129823.676178:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38a80, transno 21474841244 00000004:00080000:2.0:1746129823.676180:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130506680, transno 21474841245 00000004:00080000:2.0:1746129823.676181:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f100, transno 21474841249 00000004:00080000:2.0:1746129823.676184:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645d180, transno 21474841250 00000004:00080000:2.0:1746129823.676185:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04df80, transno 21474841251 00000004:00080000:2.0:1746129823.676187:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645ca80, transno 21474841252 00000004:00080000:2.0:1746129823.676189:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f800, transno 21474841253 00000004:00080000:2.0:1746129823.676190:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04ce00, transno 21474841254 00000004:00080000:2.0:1746129823.676192:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04c700, transno 21474841255 00000004:00080000:2.0:1746129823.676193:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04d880, transno 21474841256 00000004:00080000:2.0:1746129823.676195:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5490a80, transno 21474841257 00000004:00080000:2.0:1746129823.676197:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39f80, transno 21474841258 00000004:00080000:2.0:1746129823.676199:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130504e00, transno 21474841259 00000004:00080000:2.0:1746129823.676201:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38380, transno 21474841260 00000004:00080000:2.0:1746129823.676203:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39500, transno 21474841261 00000004:00080000:2.0:1746129823.676206:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39c00, transno 21474841262 00000004:00080000:2.0:1746129823.676207:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130504380, transno 21474841263 00000004:00080000:2.0:1746129823.676209:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b480, transno 21474841264 00000004:00080000:2.0:1746129823.676212:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130507800, transno 21474841265 00000004:00080000:2.0:1746129823.676214:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01b8000, transno 21474841266 00000004:00080000:2.0:1746129823.676216:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206c380, transno 21474841272 00000004:00080000:2.0:1746129823.676218:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009423c000, transno 21474841273 00000004:00080000:2.0:1746129823.676220:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130505c00, transno 21474841274 00000004:00080000:2.0:1746129823.676222:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206e680, transno 21474841275 00000004:00080000:2.0:1746129823.676223:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18380, transno 21474841276 00000004:00080000:2.0:1746129823.676225:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009206d500, transno 21474841277 00000004:00080000:2.0:1746129823.676227:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19500, transno 21474841278 00000004:00080000:2.0:1746129823.676229:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1ad80, transno 21474841279 00000004:00080000:2.0:1746129823.676231:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8792300, transno 21474841280 00000004:00080000:2.0:1746129823.676233:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad0e00, transno 21474841284 00000004:00080000:2.0:1746129823.676235:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4d880, transno 21474841285 00000004:00080000:2.0:1746129823.676237:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4ce00, transno 21474841286 00000004:00080000:2.0:1746129823.676239:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbed180, transno 21474841287 00000004:00080000:2.0:1746129823.676241:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbee300, transno 21474841288 00000004:00080000:2.0:1746129823.676243:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4f800, transno 21474841289 00000004:00080000:2.0:1746129823.676245:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094a4fb80, transno 21474841290 00000004:00080000:2.0:1746129823.676247:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5f80, transno 21474841291 00000004:00080000:2.0:1746129823.676249:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad0000, transno 21474841292 00000004:00080000:2.0:1746129823.676251:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468fb80, transno 21474841302 00000004:00080000:2.0:1746129823.676253:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468ca80, transno 21474841303 00000004:00080000:2.0:1746129823.676254:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468d880, transno 21474841304 00000004:00080000:2.0:1746129823.676256:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faa0380, transno 21474841305 00000004:00080000:2.0:1746129823.676258:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468f100, transno 21474841306 00000004:00080000:2.0:1746129823.676260:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468e680, transno 21474841307 00000004:00080000:2.0:1746129823.676301:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faa2d80, transno 21474841308 00000004:00080000:2.0:1746129823.676303:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468ea00, transno 21474841309 00000004:00080000:2.0:1746129823.676305:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faa0700, transno 21474841310 00000004:00080000:2.0:1746129823.676307:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbef480, transno 21474841311 00000004:00080000:2.0:1746129823.676309:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbed880, transno 21474841312 00000004:00080000:2.0:1746129823.676311:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645c700, transno 21474841313 00000004:00080000:2.0:1746129823.676312:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbef100, transno 21474841314 00000004:00080000:2.0:1746129823.676314:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbefb80, transno 21474841315 00000004:00080000:2.0:1746129823.676316:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7100, transno 21474841316 00000004:00080000:2.0:1746129823.676317:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645fb80, transno 21474841317 00000004:00080000:2.0:1746129823.676319:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbeed80, transno 21474841318 00000004:00080000:2.0:1746129823.676321:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fbef800, transno 21474841319 00000100:00100000:2.0:1746129823.676326:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88008f908700 x1830949054063488/t21474841343(21474841343) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129839 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746129823.676334:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f908700/2, rc 0, transno 21474841343 00000100:00100000:2.0:1746129823.676337:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054063488:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676348:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f909180/2, rc 0, transno 21474841344 00000100:00100000:2.0:1746129823.676350:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054064000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676355:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f909f80/2, rc 0, transno 21474841341 00000100:00100000:2.0:1746129823.676358:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054063616:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676363:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f908000/2, rc 0, transno 21474841342 00000100:00100000:2.0:1746129823.676365:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054064128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676706:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 90 done 00000100:00100000:2.0:1746129823.676730:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054064384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.676746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746129823.676768:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f909880/2, rc 0, transno 21474841339 00000100:00100000:2.0:1746129823.676770:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f909880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054063744:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676776:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f90b800/2, rc 0, transno 21474841340 00000100:00100000:2.0:1746129823.676777:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054064256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676782:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f90bb80/2, rc 0, transno 21474841337 00000100:00100000:2.0:1746129823.676784:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054063360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129823.676788:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f908380/2, rc 0, transno 21474841338 00000100:00100000:2.0:1746129823.676790:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054063872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.676800:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064384 00000100:00100000:2.0:1746129823.676803:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064384 00000100:00100000:2.0:1746129823.676815:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15664 00000100:00100000:2.0:1746129823.676819:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3299:x1830949054064384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.676913:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3299:x1830949054064384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (165us total) trans 21474841345 rc 0/0 00000100:00100000:2.0:1746129823.676918:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15664 00000004:00080000:2.0:1746129823.676934:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a5491500/2, rc 0, transno 21474841345 00000100:00100000:2.0:1746129823.676937:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5491500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054064384:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746129823.677180:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129823.677461:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054064768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677482:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129823.677518:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054065280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677532:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129823.677544:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1746129823.677548:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054064896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677560:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129823.677567:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054065408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677578:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129823.677594:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064768 00000100:00100000:3.0:1746129823.677596:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064768 00000100:00100000:3.0:1746129823.677612:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065280 00000100:00100000:3.0:1746129823.677613:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065280 00000100:00100000:3.0:1746129823.677621:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064896 00000100:00100000:3.0:1746129823.677623:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064896 00000100:00100000:3.0:1746129823.677629:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065408 00000100:00100000:3.0:1746129823.677630:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065408 00000100:00100000:3.0:1746129823.677637:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15665 00000100:00100000:3.0:1746129823.677641:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1830949054064768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677749:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3298:x1830949054064768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (266us total) trans 17179874145 rc 0/0 00000100:00100000:3.0:1746129823.677754:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15665 00000100:00100000:3.0:1746129823.677765:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15666 00000100:00100000:3.0:1746129823.677769:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1830949054065280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677841:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3298:x1830949054065280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (307us total) trans 17179874146 rc 0/0 00000100:00100000:3.0:1746129823.677865:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15666 00000100:00100000:3.0:1746129823.677874:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15667 00000100:00100000:3.0:1746129823.677878:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1830949054064896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.677944:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3298:x1830949054064896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (382us total) trans 17179874147 rc 0/0 00000100:00100000:3.0:1746129823.677949:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15667 00000100:00100000:3.0:1746129823.677958:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15668 00000100:00100000:3.0:1746129823.677961:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3298:x1830949054065408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129823.678031:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3298:x1830949054065408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (451us total) trans 17179874148 rc 0/0 00000100:00100000:3.0:1746129823.678035:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15668 00000100:00100000:3.0:1746129823.678063:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874123 gen 2 00000004:00080000:3.0:1746129823.678066:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040380, transno 17179874030 00000004:00080000:3.0:1746129823.678081:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c042300, transno 17179874031 00000004:00080000:3.0:1746129823.678084:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645ed80, transno 17179874032 00000004:00080000:3.0:1746129823.678086:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c040a80, transno 17179874033 00000004:00080000:3.0:1746129823.678087:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645c000, transno 17179874034 00000004:00080000:3.0:1746129823.678089:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645ce00, transno 17179874035 00000004:00080000:3.0:1746129823.678091:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c043b80, transno 17179874036 00000004:00080000:3.0:1746129823.678092:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a645c380, transno 17179874037 00000004:00080000:3.0:1746129823.678095:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87480, transno 17179874038 00000004:00080000:3.0:1746129823.678097:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dea00, transno 17179874039 00000004:00080000:3.0:1746129823.678099:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85880, transno 17179874040 00000004:00080000:3.0:1746129823.678101:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dc000, transno 17179874041 00000004:00080000:3.0:1746129823.678102:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85500, transno 17179874042 00000004:00080000:3.0:1746129823.678104:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84000, transno 17179874043 00000004:00080000:3.0:1746129823.678106:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84380, transno 17179874044 00000004:00080000:3.0:1746129823.678107:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86a00, transno 17179874045 00000004:00080000:3.0:1746129823.678110:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf6300, transno 17179874048 00000004:00080000:3.0:1746129823.678111:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf6a00, transno 17179874049 00000004:00080000:3.0:1746129823.678113:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf4380, transno 17179874050 00000004:00080000:3.0:1746129823.678115:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf6d80, transno 17179874051 00000004:00080000:3.0:1746129823.678117:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf4a80, transno 17179874052 00000004:00080000:3.0:1746129823.678118:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf7800, transno 17179874053 00000004:00080000:3.0:1746129823.678120:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf5880, transno 17179874054 00000004:00080000:3.0:1746129823.678122:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009faf5c00, transno 17179874055 00000004:00080000:3.0:1746129823.678124:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284df80, transno 17179874059 00000004:00080000:3.0:1746129823.678126:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061e680, transno 17179874060 00000004:00080000:3.0:1746129823.678128:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061c380, transno 17179874061 00000004:00080000:3.0:1746129823.678130:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061dc00, transno 17179874062 00000004:00080000:3.0:1746129823.678131:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061d180, transno 17179874063 00000004:00080000:3.0:1746129823.678133:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061c000, transno 17179874064 00000004:00080000:3.0:1746129823.678134:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013061ce00, transno 17179874065 00000004:00080000:3.0:1746129823.678137:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f800, transno 17179874066 00000004:00080000:3.0:1746129823.678139:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c700, transno 17179874067 00000004:00080000:3.0:1746129823.678141:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284f480, transno 17179874068 00000004:00080000:3.0:1746129823.678143:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c380, transno 17179874069 00000004:00080000:3.0:1746129823.678144:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad3100, transno 17179874070 00000004:00080000:3.0:1746129823.678146:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284e300, transno 17179874071 00000004:00080000:3.0:1746129823.678148:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284c000, transno 17179874072 00000004:00080000:3.0:1746129823.678150:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ca80, transno 17179874073 00000004:00080000:3.0:1746129823.678152:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ce00, transno 17179874074 00000004:00080000:3.0:1746129823.678154:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241f80, transno 17179874082 00000004:00080000:3.0:1746129823.678157:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242300, transno 17179874083 00000004:00080000:3.0:1746129823.678159:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adbb80, transno 17179874084 00000004:00080000:3.0:1746129823.678161:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241180, transno 17179874085 00000004:00080000:3.0:1746129823.678162:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adad80, transno 17179874086 00000004:00080000:3.0:1746129823.678164:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095242a00, transno 17179874087 00000004:00080000:3.0:1746129823.678166:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adb800, transno 17179874088 00000004:00080000:3.0:1746129823.678168:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095241c00, transno 17179874089 00000004:00080000:3.0:1746129823.678170:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468d180, transno 17179874093 00000004:00080000:3.0:1746129823.678172:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18a80, transno 17179874094 00000004:00080000:3.0:1746129823.678174:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d8ca80, transno 17179874095 00000004:00080000:3.0:1746129823.678176:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd3100, transno 17179874096 00000004:00080000:3.0:1746129823.678177:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094d8d500, transno 17179874097 00000004:00080000:3.0:1746129823.678179:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a8fd3b80, transno 17179874098 00000004:00080000:3.0:1746129823.678181:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009468e300, transno 17179874099 00000004:00080000:3.0:1746129823.678183:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19880, transno 17179874100 00000004:00080000:3.0:1746129823.678185:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85f80, transno 17179874108 00000004:00080000:3.0:1746129823.678187:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b025f80, transno 17179874109 00000004:00080000:3.0:1746129823.678189:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86300, transno 17179874110 00000004:00080000:3.0:1746129823.678190:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b024700, transno 17179874111 00000004:00080000:3.0:1746129823.678192:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87100, transno 17179874112 00000004:00080000:3.0:1746129823.678194:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86680, transno 17179874113 00000004:00080000:3.0:1746129823.678196:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85c00, transno 17179874114 00000004:00080000:3.0:1746129823.678199:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87b80, transno 17179874115 00000004:00080000:3.0:1746129823.678201:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288e00, transno 17179874116 00000004:00080000:3.0:1746129823.678202:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2e300, transno 17179874117 00000004:00080000:3.0:1746129823.678204:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328b480, transno 17179874118 00000004:00080000:3.0:1746129823.678206:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2f800, transno 17179874119 00000004:00080000:3.0:1746129823.678208:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093288700, transno 17179874120 00000004:00080000:3.0:1746129823.678209:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328b800, transno 17179874121 00000004:00080000:3.0:1746129823.678211:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009bb2c380, transno 17179874122 00000004:00080000:3.0:1746129823.678213:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093289c00, transno 17179874123 00000100:00100000:3.0:1746129823.678217:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012ba1bb80 x1830949054064896/t17179874147(17179874147) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129839 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746129823.678224:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1bb80/2, rc 0, transno 17179874147 00000100:00100000:3.0:1746129823.678227:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054064896:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129823.678236:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18e00/2, rc 0, transno 17179874148 00000100:00100000:3.0:1746129823.678239:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054065408:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129823.678244:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1aa00/2, rc 0, transno 17179874145 00000100:00100000:3.0:1746129823.678247:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054064768:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129823.678252:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18700/2, rc 0, transno 17179874146 00000100:00100000:3.0:1746129823.678254:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054065280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129823.678529:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 72 done 00000100:00080000:0.0:1746129823.678621:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129823.678630:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054064512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129823.678654:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.678673:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129823.678686:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.678696:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129823.678700:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054064640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129823.678712:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.678719:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129823.678729:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.678871:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064512 00000100:00100000:1.0:1746129823.678875:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064512 00000100:00100000:1.0:1746129823.678891:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065024 00000100:00100000:1.0:1746129823.678893:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065024 00000100:00100000:1.0:1746129823.678899:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054064640 00000100:00100000:1.0:1746129823.678901:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054064640 00000100:00100000:1.0:1746129823.678907:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065152 00000100:00100000:1.0:1746129823.678908:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065152 00000100:00100000:1.0:1746129823.678917:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15669 00000100:00100000:1.0:1746129823.678922:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054064512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.679012:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054064512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (357us total) trans 17179874149 rc 0/0 00000100:00100000:1.0:1746129823.679017:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15669 00000100:00100000:1.0:1746129823.679026:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15670 00000100:00100000:1.0:1746129823.679031:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054065024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.679114:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054065024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (426us total) trans 17179874150 rc 0/0 00000100:00100000:1.0:1746129823.679119:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15670 00000100:00100000:1.0:1746129823.679128:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15671 00000100:00100000:1.0:1746129823.679132:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054064640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.679207:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054064640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (492us total) trans 17179874151 rc 0/0 00000100:00100000:1.0:1746129823.679211:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15671 00000100:00100000:1.0:1746129823.679220:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15672 00000100:00100000:1.0:1746129823.679223:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054065152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.679290:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054065152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (560us total) trans 17179874152 rc 0/0 00000100:00100000:1.0:1746129823.679295:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15672 00000004:00080000:0.0:1746129823.679486:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b100/2, rc 0, transno 17179874151 00000100:00100000:0.0:1746129823.679491:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054064640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129823.679496:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1a300/2, rc 0, transno 17179874152 00000100:00100000:0.0:1746129823.679499:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129823.679504:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19c00/2, rc 0, transno 17179874149 00000100:00100000:0.0:1746129823.679507:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054064512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129823.679518:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19180/2, rc 0, transno 17179874150 00000100:00100000:0.0:1746129823.679521:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.679632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.679690:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465024 00000100:00100000:2.0:1746129823.679694:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465024 00000100:00100000:2.0:1746129823.679717:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11078 00000100:00100000:2.0:1746129823.679721:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31702:x1830949054465024:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.679734:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.679747:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564bb expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.679785:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.679795:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.679812:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.679815:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129823.679817:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb5200, rc 0) 00000100:00100000:2.0:1746129823.679842:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31702:x1830949054465024:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 121us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.679869:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11078 00000100:00100000:1.0:1746129823.685468:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.685551:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465152 00000100:00100000:2.0:1746129823.685559:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465152 00000100:00100000:2.0:1746129823.685598:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11079 00000100:00100000:2.0:1746129823.685605:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31702:x1830949054465152:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129823.685619:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.685632:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb4e00/0x48868a4e43955aa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564c2 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.685689:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5400/0x48868a4e43955aa8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.685698:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5400/0x48868a4e43955aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.685707:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5400/0x48868a4e43955aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129823.685724:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129823.685727:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129823.685761:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5400/0x48868a4e43955aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.685779:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb4e00/0x48868a4e43955aa1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c2 expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.685793:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5400/0x48868a4e43955aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c2 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.685799:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.685801:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129823.685803:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb5400, rc 0) 00000100:00100000:2.0:1746129823.686637:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31702:x1830949054465152:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1030us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.686643:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11079 00000100:00100000:0.0:1746129823.691459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.691512:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465280 00000100:00100000:3.0:1746129823.691520:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465280 00000100:00100000:3.0:1746129823.691561:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15673 00000100:00100000:3.0:1746129823.691567:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1961:x1830949054465280:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.691583:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.691596:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564c9 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129823.691616:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d3a0, atime: 0x6813d39e, ctime: 0x6813d3a0, blocks: 0x7e7 00010000:00010000:3.0:1746129823.691629:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.691631:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.691638:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 6 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.691650:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 6 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.691659:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6fe800, rc 0) 00000100:00100000:3.0:1746129823.691702:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054465280:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 136us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.691708:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15673 00000100:00100000:0.0:1746129823.693557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.693590:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.693613:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465408 00000100:00100000:2.0:1746129823.693618:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465408 00000100:00100000:0.0:1746129823.693618:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.693633:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.693655:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465536 00000100:00100000:3.0:1746129823.693657:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465792 00000100:00100000:2.0:1746129823.693657:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465536 00000100:00100000:3.0:1746129823.693661:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465792 00000100:00100000:2.0:1746129823.693669:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15674 00000100:00100000:2.0:1746129823.693674:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1961:x1830949054465408:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129823.693678:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465664 00000100:00100000:3.0:1746129823.693679:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465664 00000100:00100000:3.0:1746129823.693690:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15675 00010000:00010000:2.0:1746129823.693690:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129823.693695:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054465536:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.693701:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.693703:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564d0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.693708:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564d7 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.693712:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15676 00000100:00100000:1.0:1746129823.693719:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054465792:12345-192.168.204.31@tcp:101:lfs.0 00002000:00010000:3.0:1746129823.693720:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x821 00002000:00010000:2.0:1746129823.693720:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x821 00010000:00010000:1.0:1746129823.693726:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.693732:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.693732:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.693734:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.693734:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.693736:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564e5 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.693740:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.693740:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746129823.693749:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d39f, atime: 0x6813d39f, ctime: 0x6813d39f, blocks: 0x15e5 00010000:00010000:3.0:1746129823.693750:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 8 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.693750:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.693756:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.693758:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ff200, rc 0) 00010000:00010000:2.0:1746129823.693758:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb4e00, rc 0) 00010000:00010000:1.0:1746129823.693758:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.693762:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.693772:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.693778:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c552e00, rc 0) 00000100:00100000:3.0:1746129823.693958:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054465536:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 261us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.693963:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15675 00000100:00100000:3.0:1746129823.693976:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15677 00000100:00100000:3.0:1746129823.693981:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054465664:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.693987:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.693994:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564de expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129823.694003:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d39f, atime: 0x6813d39e, ctime: 0x6813d39f, blocks: 0x821 00010000:00010000:3.0:1746129823.694010:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.694011:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.694015:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129823.694021:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054465408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 345us (470us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129823.694023:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.694034:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ff600, rc 0) 00000100:00100000:3.0:1746129823.694048:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054465664:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 67us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.694053:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15677 00000100:00100000:2.0:1746129823.694105:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15674 00000100:00100000:1.0:1746129823.694152:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054465792:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 432us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.694158:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15676 00000100:00100000:0.0:1746129823.694293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.694512:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054465920 00000100:00100000:1.0:1746129823.694516:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054465920 00000100:00100000:1.0:1746129823.694533:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15678 00000100:00100000:1.0:1746129823.694538:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054465920:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129823.694544:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.694551:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564ec expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129823.694562:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d39f, atime: 0x6813d39f, ctime: 0x6813d39f, blocks: 0x1029 00010000:00010000:1.0:1746129823.694569:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.694570:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.694574:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.694583:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 8 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129823.694589:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c552800, rc 0) 00000100:00100000:1.0:1746129823.694604:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054465920:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 66us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.694609:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15678 00000100:00100000:0.0:1746129823.706105:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.706170:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054466304 00000100:00100000:3.0:1746129823.706177:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054466304 00000100:00100000:0.0:1746129823.706731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.706995:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054466432 00000100:00100000:3.0:1746129823.706998:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054466432 00000100:00100000:3.0:1746129823.707023:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7050 00000100:00100000:3.0:1746129823.707091:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054466304:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129823.707119:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.707132:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.707133:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.707137:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.707148:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.707182:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7051 00000100:00100000:2.0:1746129823.707190:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054466432:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129823.707204:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.707210:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.707211:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746129823.707212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129823.707213:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.707220:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.707267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.707543:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054466688 00000100:00100000:0.0:1746129823.707547:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054466688 00000100:00100000:0.0:1746129823.707584:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054466944 00000100:00100000:0.0:1746129823.707587:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054466944 00000100:00100000:0.0:1746129823.707606:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7052 00000100:00100000:0.0:1746129823.707612:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054466688:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129823.707627:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.707636:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.707637:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.707640:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.707648:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.707964:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7053 00000100:00100000:0.0:1746129823.707970:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054466944:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129823.707988:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.707995:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.707996:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.707999:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.708006:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.708280:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.708927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.708944:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.708964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.709317:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054467200 00000100:00100000:3.0:1746129823.709322:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054467200 00000100:00100000:3.0:1746129823.709352:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054467072 00000100:00100000:3.0:1746129823.709354:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054467072 00000100:00100000:3.0:1746129823.709375:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054467328 00000100:00100000:3.0:1746129823.709377:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054467328 00000100:00100000:3.0:1746129823.709387:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054466560 00000100:00100000:3.0:1746129823.709389:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054466560 00000100:00100000:3.0:1746129823.709402:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7054 00000100:00100000:3.0:1746129823.709407:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054467200:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129823.709428:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.709437:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.709439:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.709442:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.709451:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.709836:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7055 00000100:00100000:1.0:1746129823.709843:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054467072:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129823.709875:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.709883:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.709884:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.709887:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.709894:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.710477:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7056 00000100:00100000:3.0:1746129823.710483:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054467328:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129823.710496:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.710503:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.710504:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.710507:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.710514:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.710884:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7057 00000100:00100000:1.0:1746129823.710890:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054466560:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129823.710905:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.710912:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.710913:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129823.710917:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.710925:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726425:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726439:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726451:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726458:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb52400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129823.726462:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726469:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726486:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.726493:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb52400/0x48868a4e43955aee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.726554:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054466944:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 18579us (19282us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.726562:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7053 00010000:00010000:3.0:1746129823.726994:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.727007:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.727013:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.727017:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8fb5800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129823.727020:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.727025:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.727034:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.727038:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb5800/0x48868a4e43955ae0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.727080:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054466432:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 19891us (20350us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.727086:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7051 00010000:00010000:3.0:1746129823.728806:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.728819:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.728830:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.728835:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a54b0c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129823.728838:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.728844:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.729002:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.729007:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a54b0c00/0x48868a4e43955ad9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.729375:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054466304:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 22283us (23275us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.729382:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7050 00010000:00010000:3.0:1746129823.733265:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.733278:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.733285:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.733295:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095350a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129823.733298:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.733305:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.733320:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.733325:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095350a00/0x48868a4e43955af5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.733391:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054467200:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 23980us (25107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.733399:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7054 00010000:00010000:1.0:1746129823.737245:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.737265:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.737272:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.737279:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c552a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129823.737283:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.737290:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.737304:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.737310:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c552a00/0x48868a4e43955afc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.737380:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054467072:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 27534us (28449us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.737389:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7055 00010000:00010000:3.0:1746129823.740100:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.740115:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.740123:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.740129:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095350000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129823.740133:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.740140:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.740155:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.740160:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095350000/0x48868a4e43955b03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.740220:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054467328:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 29734us (31271us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.740229:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7056 00010000:00010000:1.0:1746129823.741110:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.741117:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.741121:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.741124:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c553400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129823.741126:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.741130:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.741138:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.741141:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c553400/0x48868a4e43955b0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.741174:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054466560:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 30283us (32208us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129823.741180:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7057 00010000:00010000:2.0:1746129823.743299:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.743311:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.743318:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.743327:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb52200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129823.743330:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.743336:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.743348:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.743353:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb52200/0x48868a4e43955ae7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.743824:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054466688:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 36208us (36608us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.743834:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7052 00000100:00100000:0.0:1746129823.749336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.749402:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054467712 00000100:00100000:2.0:1746129823.749409:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054467712 00000100:00100000:2.0:1746129823.749456:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11080 00000100:00100000:2.0:1746129823.749463:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31702:x1830949054467712:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129823.749504:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.749526:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5400/0x48868a4e43955aa8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c2 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.749541:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:2.0:1746129823.749544:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129823.749576:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.749587:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.749594:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00010000:2.0:1746129823.749730:0:14313:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009328b100 reply state ffff88009285e000 transno 8589945104 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129823.749736:0:14313:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129823.749803:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31702:x1830949054467712:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 340us (475us total) trans 8589945104 rc 0/0 00000100:00100000:2.0:1746129823.749809:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11080 00010000:00010000:0.0:1746129823.750801:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.750810:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.750815:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.750820:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6c3600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129823.750824:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.750830:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.750838:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:0.0:1746129823.750840:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129823.750843:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.750880:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c3600/0x48868a4e43955b11 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.751243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.751271:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.751299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.751312:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054467968 00000100:00100000:2.0:1746129823.751317:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054467968 00000100:00100000:2.0:1746129823.751339:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054467840 00000100:00100000:2.0:1746129823.751341:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054467840 00000100:00100000:3.0:1746129823.751342:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468224 00000100:00100000:3.0:1746129823.751346:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468224 00000100:00100000:2.0:1746129823.751357:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15679 00000100:00100000:2.0:1746129823.751362:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054467968:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:3.0:1746129823.751369:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15680 00000100:00100000:3.0:1746129823.751374:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054467840:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129823.751469:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746129823.751469:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129823.751472:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.751472:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129823.751474:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129822 -> 1746129824 00002000:00010000:2.0:1746129823.751474:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.751475:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129823.751476:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129823.751477:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00002000:00010000:2.0:1746129823.751477:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129823.751513:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054467968:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 151us (272us total) trans 17179874153 rc 0/0 00000100:00100000:3.0:1746129823.751518:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054467840:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 143us (246us total) trans 21474841346 rc 0/0 00000100:00100000:2.0:1746129823.751519:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15679 00000100:00100000:2.0:1746129823.751530:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15681 00000100:00100000:3.0:1746129823.751534:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15680 00000100:00100000:2.0:1746129823.751535:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054468224:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:2.0:1746129823.751597:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129823.751600:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129823 -> 1746129824 00002000:00010000:2.0:1746129823.751601:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129822 -> 1746129824 00002000:00010000:2.0:1746129823.751603:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129823 -> 1746129824 00002000:00010000:2.0:1746129823.751604:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129823.752360:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054468224:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 823us (1058us total) trans 21474841347 rc 0/0 00000100:00100000:2.0:1746129823.752366:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15681 00000100:00100000:1.0:1746129823.752514:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.752546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.752565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.752582:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468480 00000100:00100000:3.0:1746129823.752586:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468480 00000100:00100000:3.0:1746129823.752610:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468096 00000100:00100000:3.0:1746129823.752613:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468096 00000100:00100000:3.0:1746129823.752623:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468352 00000100:00100000:3.0:1746129823.752624:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468352 00000100:00100000:3.0:1746129823.752633:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15682 00000100:00100000:3.0:1746129823.752638:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054468480:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129823.752708:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129823.752711:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.752713:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.752714:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.752716:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129823.752747:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054468480:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 108us (301us total) trans 17179874154 rc 0/0 00000100:00100000:3.0:1746129823.752752:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15682 00000100:00100000:3.0:1746129823.752761:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15683 00000100:00100000:3.0:1746129823.752765:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054468096:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129823.752815:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129823.752817:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129823.752819:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129823.752820:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129823.752822:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129823.752838:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054468096:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 72us (292us total) trans 17179874155 rc 0/0 00000100:00100000:3.0:1746129823.752842:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15683 00000100:00100000:3.0:1746129823.752868:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15684 00000100:00100000:3.0:1746129823.752872:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054468352:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129823.752928:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:3.0:1746129823.752930:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.752931:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.752933:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129823 -> 1746129824 00002000:00010000:3.0:1746129823.752934:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:3.0:1746129823.752949:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054468352:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 76us (383us total) trans 21474841348 rc 0/0 00000100:00100000:3.0:1746129823.752954:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15684 00000100:00100000:0.0:1746129823.755943:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.756036:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468736 00000100:00100000:2.0:1746129823.756043:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468736 00000100:00100000:2.0:1746129823.756374:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4645 00000100:00100000:2.0:1746129823.756381:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31702:x1830949054468736:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:2.0:1746129823.756426:0:15740:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43955a5b lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564b4 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.756464:0:15740:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129823.756474:0:15740:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.756480:0:15740:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129823.756504:0:15740:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.756517:0:15740:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 9 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.756527:0:15740:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:15740:1830949054065536:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.756594:0:15740:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.758975:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.758997:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468864 00000100:00100000:1.0:1746129823.759003:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468864 00010000:00010000:1.0:1746129823.759026:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 10 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.759047:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7856 00000100:00100000:1.0:1746129823.759052:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054468864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.759061:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.759066:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 10 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.759091:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 10 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.759106:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129823.759110:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.759117:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129823.759121:0:15740:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb5200/0x48868a4e43955a9a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564bb expref: 10 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.759122:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15740 initiator: MDT0 00000100:00100000:2.0:1746129823.759133:0:15740:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5493100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:15740:1830949054065536:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.759134:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129823.759148:0:15740:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129823.759155:0:15740:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00010000:00010000:2.0:1746129823.759159:0:15740:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00000100:00100000:1.0:1746129823.759159:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054468864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.759165:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7856 00000040:00080000:2.0:1746129823.761771:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3533, 88 off297640 00000004:00080000:2.0:1746129823.761780:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769819931432ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.761817:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3537, 88 off297904 00000004:00080000:2.0:1746129823.761821:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769819973010ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763114:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3538, 88 off297992 00000004:00080000:2.0:1746129823.763120:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821272404ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763261:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3534, 88 off297728 00000004:00080000:2.0:1746129823.763265:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821417376ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763339:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3535, 88 off297816 00000004:00080000:2.0:1746129823.763344:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821495550ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763351:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3539, 88 off298080 00000004:00080000:2.0:1746129823.763354:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821505822ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763362:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3540, 88 off298168 00000004:00080000:2.0:1746129823.763364:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821516565ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763370:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3541, 88 off298256 00000004:00080000:2.0:1746129823.763373:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821525160ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763379:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3536, 88 off297904 00000004:00080000:2.0:1746129823.763382:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821533890ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763387:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3542, 88 off298344 00000004:00080000:2.0:1746129823.763391:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821542732ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763397:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3537, 88 off297992 00000004:00080000:2.0:1746129823.763400:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821551662ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763406:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3543, 88 off298432 00000004:00080000:2.0:1746129823.763410:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821561815ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129823.763416:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3538, 88 off298080 00000004:00080000:2.0:1746129823.763419:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821571020ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763425:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3539, 88 off298168 00000004:00080000:2.0:1746129823.763427:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821579274ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763433:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3540, 88 off298256 00000004:00080000:2.0:1746129823.763435:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821587511ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763441:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3541, 88 off298344 00000004:00080000:2.0:1746129823.763443:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769821595686ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129823.763450:0:15740:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3544, 88 off298520 00000004:00080000:2.0:1746129823.763452:0:15740:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769821604075ns, next at 716792379979ns, rc = 0 00000004:00010000:3.0:1746129823.783829:0:15740:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093288380 reply state ffff88009fadb400 transno 8589945105 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15740 initiator: MDT0 00000100:00100000:3.0:1746129823.783873:0:15740:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746129823.783882:0:15740:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:3.0:1746129823.783885:0:15740:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129823.783892:0:15740:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43955a5b lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564b4 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.783981:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31702:x1830949054468736:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 27599us (28042us total) trans 8589945105 rc 0/0 00000100:00100000:3.0:1746129823.783989:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4645 00000001:00080000:1.0:1746129823.784288:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945105 is committed 00000004:00080000:1.0:1746129823.784293:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2711 committed 00000004:00080000:1.0:1746129823.784298:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2713 committed 00000004:00080000:1.0:1746129823.784303:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2712 committed 00000004:00080000:1.0:1746129823.784304:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2711 committed 00000004:00080000:1.0:1746129823.784305:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746129823.784306:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2710 committed 00000004:00080000:1.0:1746129823.784308:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746129823.784310:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2709 committed 00000004:00080000:1.0:1746129823.784311:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746129823.784313:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2708 committed 00000004:00080000:1.0:1746129823.784314:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2707 committed 00000004:00080000:1.0:1746129823.784315:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746129823.784317:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2707 committed 00000004:00080000:1.0:1746129823.784318:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2706 committed 00000004:00080000:1.0:1746129823.784320:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2705 committed 00000004:00080000:1.0:1746129823.784321:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2704 committed 00000004:00080000:1.0:1746129823.784322:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2705 committed 00010000:00010000:1.0:1746129823.784341:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.784347:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.784353:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.784357:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6c2400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129823.784361:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.784367:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.784378:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f581400) 00010000:00010000:1.0:1746129823.784380:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129823.784382:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 00010000:00010000:1.0:1746129823.784386:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6c2400/0x48868a4e43955b18 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15740 initiator: MDT0 00000100:00100000:0.0:1746129823.784415:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784452:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.784467:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065664 00000100:00100000:1.0:1746129823.784473:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065664 00000100:00100000:0.0:1746129823.784475:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054066176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784486:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.784495:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066176 00000100:00100000:1.0:1746129823.784497:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066176 00000100:00100000:0.0:1746129823.784497:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746129823.784501:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.784508:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15685 00000100:00100000:0.0:1746129823.784512:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.784514:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3296:x1830949054065664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784521:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054066304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784531:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.784544:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054065920:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784556:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.784565:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054066432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784576:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.784584:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129823.784588:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054066048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784597:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.784606:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054066560:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784615:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746129823.784647:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129823.784650:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.784652:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.784653:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.784655:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746129823.784660:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065792 00000100:00100000:0.0:1746129823.784662:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065792 00000100:00100000:0.0:1746129823.784675:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066304 00000100:00100000:0.0:1746129823.784677:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066304 00000100:00100000:1.0:1746129823.784678:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1830949054065664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 164us (225us total) trans 21474841349 rc 0/0 00000100:00100000:1.0:1746129823.784683:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15685 00000100:00100000:0.0:1746129823.784684:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054065920 00000100:00100000:0.0:1746129823.784685:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054065920 00000100:00100000:1.0:1746129823.784690:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066432 00000100:00100000:0.0:1746129823.784690:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066048 00000100:00100000:1.0:1746129823.784691:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066432 00000100:00100000:0.0:1746129823.784691:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066048 00000100:00100000:0.0:1746129823.784697:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066560 00000100:00100000:1.0:1746129823.784698:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15686 00000100:00100000:0.0:1746129823.784698:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066560 00000100:00100000:1.0:1746129823.784702:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054066176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784704:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15687 00000100:00100000:0.0:1746129823.784708:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054065792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.784727:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15688 00000100:00100000:0.0:1746129823.784731:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054066304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.784761:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15689 00000100:00100000:1.0:1746129823.784766:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054065920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.784881:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15690 00000100:00100000:2.0:1746129823.784886:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054066048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.784896:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15691 00000100:00100000:2.0:1746129823.784898:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054066432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.785324:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054067072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785346:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785356:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054067584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785366:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785372:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129823.785375:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054066944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785384:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785389:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054067456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785399:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785409:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054066816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785420:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785426:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054067328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785436:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785441:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746129823.785444:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054066688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785454:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.785459:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054067200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785469:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.785685:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067072 00000100:00100000:1.0:1746129823.785689:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067072 00000100:00100000:1.0:1746129823.785702:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067584 00000100:00100000:1.0:1746129823.785703:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067584 00000100:00100000:1.0:1746129823.785709:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066944 00000100:00100000:1.0:1746129823.785710:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066944 00000100:00100000:1.0:1746129823.785715:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067456 00000100:00100000:1.0:1746129823.785717:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067456 00000100:00100000:1.0:1746129823.785722:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066816 00000100:00100000:1.0:1746129823.785724:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066816 00000100:00100000:1.0:1746129823.785728:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067328 00000100:00100000:1.0:1746129823.785730:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067328 00000100:00100000:1.0:1746129823.785734:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054066688 00000100:00100000:1.0:1746129823.785736:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054066688 00000100:00100000:1.0:1746129823.785740:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067200 00000100:00100000:1.0:1746129823.785741:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067200 00000100:00100000:1.0:1746129823.785749:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15692 00000100:00100000:1.0:1746129823.785754:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054066560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.785766:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15693 00000100:00100000:1.0:1746129823.785770:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3299:x1830949054067072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785878:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054066176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1174us (1389us total) trans 21474841350 rc 0/0 00000100:00100000:2.0:1746129823.785884:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15686 00000100:00100000:2.0:1746129823.785895:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15694 00000100:00100000:2.0:1746129823.785900:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949054067584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.785981:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054067584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (613us total) trans 17179874157 rc 0/0 00000100:00100000:2.0:1746129823.785986:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15694 00000100:00100000:2.0:1746129823.785995:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15695 00000100:00100000:2.0:1746129823.785999:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949054066944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129823.786066:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129823.786078:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786080:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786082:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786083:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129823.786100:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054066944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (715us total) trans 17179874158 rc 0/0 00000100:00100000:2.0:1746129823.786104:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15695 00000100:00100000:2.0:1746129823.786112:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15696 00000100:00100000:2.0:1746129823.786116:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949054067456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.786178:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054067456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (778us total) trans 17179874159 rc 0/0 00000100:00100000:2.0:1746129823.786182:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15696 00000100:00100000:2.0:1746129823.786190:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15697 00000100:00100000:2.0:1746129823.786193:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054066816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129823.786248:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129823.786250:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786252:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786254:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786256:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129823.786276:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949054066816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (854us total) trans 17179874160 rc 0/0 00000100:00100000:2.0:1746129823.786281:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15697 00000100:00100000:2.0:1746129823.786289:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15698 00000100:00100000:2.0:1746129823.786292:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054067328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.786356:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949054067328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (918us total) trans 17179874161 rc 0/0 00000100:00100000:2.0:1746129823.786360:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15698 00000100:00100000:2.0:1746129823.786368:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15699 00000100:00100000:2.0:1746129823.786371:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054066688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129823.786427:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129823.786429:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786431:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786433:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786434:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129823.786450:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949054066688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (995us total) trans 17179874162 rc 0/0 00000100:00100000:2.0:1746129823.786455:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15699 00000100:00100000:2.0:1746129823.786463:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15700 00000100:00100000:2.0:1746129823.786467:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054067200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.786533:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830949054067200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (1062us total) trans 17179874163 rc 0/0 00000100:00100000:2.0:1746129823.786538:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15700 00000004:00080000:2.0:1746129823.786567:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18a80/2, rc 0, transno 17179874162 00000100:00100000:2.0:1746129823.786572:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054066688:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.786580:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1ad80/2, rc 0, transno 17179874163 00000100:00100000:2.0:1746129823.786582:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054067200:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.786588:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19880/2, rc 0, transno 17179874160 00000100:00100000:2.0:1746129823.786590:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054066816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.786596:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b800/2, rc 0, transno 17179874161 00000100:00100000:2.0:1746129823.786598:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054067328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.786612:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18380/2, rc 0, transno 17179874158 00000100:00100000:2.0:1746129823.786615:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054066944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.786620:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19f80/2, rc 0, transno 17179874159 00000100:00100000:2.0:1746129823.786622:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054067456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.786628:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b480/2, rc 0, transno 17179874157 00000100:00100000:2.0:1746129823.786630:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054067584:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129823.786711:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:2.0:1746129823.786713:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786715:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786716:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.786717:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:2.0:1746129823.786736:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054065920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1970us (2179us total) trans 21474841351 rc 0/0 00000100:00100000:2.0:1746129823.786741:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15689 00000100:00100000:1.0:1746129823.786746:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949054067072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 976us (1399us total) trans 17179874156 rc 0/0 00000100:00100000:1.0:1746129823.786751:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15693 00002000:00010000:1.0:1746129823.786991:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129823.786998:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.787000:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.787002:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.787003:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129823.787023:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054065792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2315us (2509us total) trans 21474841352 rc 0/0 00000100:00100000:1.0:1746129823.787028:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15687 00000004:00080000:1.0:1746129823.787052:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4380/2, rc 0, transno 21474841351 00000100:00100000:1.0:1746129823.787058:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054065920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.787083:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb7480/2, rc 0, transno 21474841352 00000100:00100000:1.0:1746129823.787086:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065792:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.787093:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009328a300/2, rc 0, transno 21474841349 00000100:00100000:1.0:1746129823.787095:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054065664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.787101:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5f80/2, rc 0, transno 21474841350 00000100:00100000:1.0:1746129823.787104:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054066176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.787111:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054067712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.787131:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.787144:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054067712 00000100:00100000:0.0:1746129823.787147:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054067712 00000100:00100000:0.0:1746129823.787163:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15701 00000100:00100000:0.0:1746129823.787167:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054067712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.787203:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830949054066304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2471us (2670us total) trans 21474841353 rc 0/0 00000100:00100000:1.0:1746129823.787208:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15688 00000004:00080000:1.0:1746129823.787225:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5180/2, rc 0, transno 21474841353 00000100:00100000:1.0:1746129823.787228:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054066304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.787234:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4000/2, rc 0, transno 21474841354 00000100:00100000:1.0:1746129823.787236:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054067712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.787236:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3296:x1830949054067712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (105us total) trans 21474841354 rc 0/0 00000100:00100000:0.0:1746129823.787240:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15701 00000100:00100000:2.0:1746129823.787581:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949054066048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2694us (2981us total) trans 21474841355 rc 0/0 00000100:00100000:2.0:1746129823.787586:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15690 00002000:00010000:2.0:1746129823.787663:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746129823.787666:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746129823.787667:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746129823.787668:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746129823.787669:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746129823.787687:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949054066432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2787us (3110us total) trans 21474841356 rc 0/0 00000100:00100000:2.0:1746129823.787692:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15691 00000004:00080000:2.0:1746129823.787712:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19500/2, rc 0, transno 17179874156 00000100:00100000:2.0:1746129823.787715:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054067072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129823.787764:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5c00/2, rc 0, transno 21474841355 00000100:00100000:1.0:1746129823.787768:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054066048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.787774:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6d80/2, rc 0, transno 21474841356 00000100:00100000:1.0:1746129823.787776:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054066432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129823.787791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.788361:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949054066560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2606us (3744us total) trans 21474841357 rc 0/0 00000100:00100000:0.0:1746129823.788367:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15692 00000004:00080000:1.0:1746129823.788428:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb5880/2, rc 0, transno 21474841357 00000100:00100000:1.0:1746129823.788431:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054066560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129823.788746:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054468992 00000100:00100000:3.0:1746129823.788751:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054468992 00000100:00100000:3.0:1746129823.788785:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11081 00000100:00100000:3.0:1746129823.788790:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31702:x1830949054468992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129823.788802:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.788817:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564f3 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.788879:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.788890:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.788903:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129823.788906:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129823.788908:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009caa0000, rc 0) 00000100:00100000:3.0:1746129823.788938:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31702:x1830949054468992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 148us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.788943:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11081 00000100:00100000:0.0:1746129823.791317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.791399:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054469248 00000100:00100000:3.0:1746129823.791405:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054469248 00000100:00100000:3.0:1746129823.791436:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4646 00000100:00100000:3.0:1746129823.791441:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31702:x1830949054469248:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129823.792383:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31702:x1830949054469248:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 938us (1069us total) trans 8589945106 rc 0/0 00000100:00100000:3.0:1746129823.792391:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4646 00000100:00100000:0.0:1746129823.814773:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.816024:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054469504 00000100:00100000:2.0:1746129823.816033:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054469504 00000100:00100000:1.0:1746129823.816910:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.817074:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054469760 00000100:00100000:2.0:1746129823.817078:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054469760 00000100:00100000:0.0:1746129823.817091:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11082 00000100:00100000:0.0:1746129823.817100:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31709:x1830949054469504:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:2.0:1746129823.817111:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11083 00000100:00100000:2.0:1746129823.817116:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31715:x1830949054469760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129823.817120:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.817127:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.817136:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3000/0x48868a4e43955b2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356501 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.817136:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87a00/0x48868a4e43955b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3564fa expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.817225:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817233:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817235:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817243:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817243:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817249:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817253:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817256:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817258:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817413:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817415:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.817423:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.817521:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817521:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817528:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817534:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817535:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.817540:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:0.0:1746129823.817541:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129823.817546:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129823.817613:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.817620:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.817626:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817626:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817632:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817637:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c3600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129823.817637:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817640:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817641:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa86600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129823.817644:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817646:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817648:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.817656:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129823.817659:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129823.817662:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817663:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129823.817665:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129823.817666:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.817667:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817671:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86600/0x48868a4e43955b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817692:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817700:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817704:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817707:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa87e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129823.817709:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817713:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817719:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49400) 00010000:00010000:0.0:1746129823.817721:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129823.817723:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817728:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87e00/0x48868a4e43955b42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.817753:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87a00/0x48868a4e43955b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.817763:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.817768:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129823.817770:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129823.817772:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86e00, rc 0) 00000100:00100000:0.0:1746129823.817808:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31709:x1830949054469504:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 709us (3043us total) trans 8589945108 rc 0/0 00000100:00100000:0.0:1746129823.817814:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11082 00010000:00010000:2.0:1746129823.818054:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818059:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818063:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818076:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c3400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129823.818078:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818082:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818088:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fa49400) 00010000:00010000:2.0:1746129823.818090:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129823.818092:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818096:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955b49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.818121:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3000/0x48868a4e43955b2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.818134:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.818139:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129823.818141:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129823.818143:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3a00, rc 0) 00000100:00100000:2.0:1746129823.818174:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31715:x1830949054469760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1057us (1265us total) trans 8589945107 rc 0/0 00000100:00100000:2.0:1746129823.818180:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11083 00000100:00100000:0.0:1746129823.821351:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.821439:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054469888 00000100:00100000:2.0:1746129823.821447:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054469888 00000100:00100000:2.0:1746129823.821482:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15702 00000100:00100000:2.0:1746129823.821487:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31715:x1830949054469888:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.821501:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.821514:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356508 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.821535:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.821536:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.821542:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.821553:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 27 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.821562:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3600, rc 0) 00000100:00100000:2.0:1746129823.822426:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31715:x1830949054469888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 936us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.822432:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15702 00000100:00100000:1.0:1746129823.822942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.823043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.823148:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054470144 00000100:00100000:2.0:1746129823.823152:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054470144 00000100:00100000:2.0:1746129823.823181:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054470400 00000100:00100000:2.0:1746129823.823183:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054470400 00000100:00100000:2.0:1746129823.823195:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11084 00000100:00100000:2.0:1746129823.823200:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31710:x1830949054470144:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129823.823212:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.823221:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2c00/0x48868a4e43955b73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35650f expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.823399:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129823.823410:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.823417:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.823422:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129823.823428:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11085 00000100:00100000:0.0:1746129823.823435:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31714:x1830949054470400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.823444:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.823444:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.823451:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e43955b81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356516 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.823458:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 284 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.823472:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054067840:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129823.823485:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86a00/0x48868a4e43955b88 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.823492:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86a00/0x48868a4e43955b88 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:0.0:1746129823.823500:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86a00/0x48868a4e43955b88 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:0.0:1746129823.823508:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129823.823591:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa87000/0x48868a4e43955b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356516 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.823603:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86a00/0x48868a4e43955b88 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356516 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.823609:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129823.823612:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746129823.823613:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.823621:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.823625:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86a00, rc 0) 00010000:00010000:2.0:1746129823.823693:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.823701:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 10 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.823911:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31714:x1830949054470400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 476us (866us total) trans 8589945109 rc 0/0 00000100:00100000:0.0:1746129823.823917:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11085 00000100:00100000:2.0:1746129823.823929:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054067968:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.824082:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.826179:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.826285:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054470656 00000100:00100000:2.0:1746129823.826292:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054470656 00002000:00100000:2.0:1746129823.826325:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c1c7480 x1830949054470656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.826334:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7480 with x1830949054470656 ext(0->1048575) 00002000:00010000:2.0:1746129823.826338:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c7480 00000100:00100000:2.0:1746129823.826369:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7058 00000100:00100000:2.0:1746129823.826376:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054470656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.826898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.826921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.826936:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054470912 00000100:00100000:0.0:1746129823.826939:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054470912 00010000:00010000:0.0:1746129823.826956:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 285 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.826972:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054470784 00000100:00100000:0.0:1746129823.826973:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054470784 00010000:00010000:0.0:1746129823.826981:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 10 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.826992:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7857 00000100:00100000:0.0:1746129823.826997:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054470912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.827004:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.827009:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 285 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.827017:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 285 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.827032:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129823.827036:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.827042:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.827045:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.827083:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130565050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054470912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.827089:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7857 00000100:00100000:0.0:1746129823.827122:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7858 00000100:00100000:0.0:1746129823.827127:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054470784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.827132:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.827136:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 10 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.827144:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 10 pid: 15044 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.827153:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129823.827155:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.827160:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.827166:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129823.827177:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.827191:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054470784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.827197:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7858 00010000:00010000:3.0:1746129823.827295:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3a00/0x48868a4e43955b57 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356501 expref: 284 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.827308:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054067840:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.827317:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86e00/0x48868a4e43955b50 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564fa expref: 9 pid: 15044 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.827323:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054067968:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.827335:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.827341:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.827345:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.827357:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129823.827439:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2c00/0x48868a4e43955b73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.827448:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.827453:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129823.827455:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129823.827457:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c2400, rc 0) 00000100:00100000:3.0:1746129823.827477:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31710:x1830949054470144:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4277us (4536us total) trans 8589945110 rc 0/0 00000100:00100000:3.0:1746129823.827481:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11084 00000100:00100000:0.0:1746129823.827694:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.827839:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471040 00000100:00100000:3.0:1746129823.827843:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471040 00000100:00100000:3.0:1746129823.827877:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11086 00000100:00100000:3.0:1746129823.827882:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31714:x1830949054471040:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.827894:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.827904:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27e600/0x48868a4e43955b9d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35651d expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.827948:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.827956:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.827961:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.827979:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.827988:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 283 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.827996:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054068096:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.828039:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a49489c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129823.830136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.831714:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471296 00000100:00100000:1.0:1746129823.831725:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471296 00000100:00100000:1.0:1746129823.831787:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11087 00000100:00100000:1.0:1746129823.831796:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31709:x1830949054471296:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.831812:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.831816:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129823.831841:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa86a00/0x48868a4e43955b88 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356516 expref: 11 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.831895:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.831902:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.831908:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.831913:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.831917:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129823.831927:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53000/0x48868a4e43955bab lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356524 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.831971:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.831982:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.831988:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.831992:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.832007:0:15044:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.832029:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.832038:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 7 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.832049:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054068224:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129823.832153:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.834893:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054068096:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.834907:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129823.834917:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00000100:00100000:1.0:1746129823.834980:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471424 00000100:00100000:1.0:1746129823.834985:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471424 00010000:00010000:1.0:1746129823.835006:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 284 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.835028:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7859 00000100:00100000:1.0:1746129823.835034:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949054471424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.835045:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.835050:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 284 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.835059:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 284 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.835087:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c2400/0x48868a4e43955b7a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35650f expref: 284 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.835098:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.835101:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.835109:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.835115:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129823.835120:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.835125:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.835137:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.835183:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949054471424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 149us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.835189:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7859 00000100:00100000:1.0:1746129823.835218:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054068224:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129823.835227:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:2.0:1746129823.835253:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054470656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8876us (9077us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.835266:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7058 00002000:00100000:2.0:1746129823.835273:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c1c7480 x1830949054470656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.835282:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7480 with x1830949054470656 ext(0->1048575) 00002000:00010000:2.0:1746129823.835285:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c7480 00010000:00010000:3.0:1746129823.835386:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.835392:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129823.835428:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129823.835432:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129823.835444:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129823.835468:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27e600/0x48868a4e43955b9d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.835485:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 11 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.835492:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 11 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.835497:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27f000, rc 0) 00000100:00100000:3.0:1746129823.835532:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31714:x1830949054471040:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7649us (7837us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.835537:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11086 00000100:00100000:0.0:1746129823.836913:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.836971:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.837043:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471552 00000100:00100000:1.0:1746129823.837049:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471552 00010000:00010000:1.0:1746129823.837081:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 8 pid: 1851 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.837112:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471680 00000100:00100000:1.0:1746129823.837115:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471680 00010000:00010000:1.0:1746129823.837124:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 11 pid: 14313 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.837139:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7860 00000100:00100000:1.0:1746129823.837145:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054471552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.837153:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.837158:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 8 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.837166:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 8 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.837179:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009caa0000/0x48868a4e43955b1f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564f3 expref: 8 pid: 1851 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.837190:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.837193:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.837199:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.837203:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.837225:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054471552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.837229:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7860 00000100:00100000:1.0:1746129823.837239:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7861 00000100:00100000:1.0:1746129823.837243:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054471680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.837248:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.837251:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 11 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.837262:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 11 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.837270:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e43955ba4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35651d expref: 11 pid: 14313 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.837280:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.837283:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.837287:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.837292:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.837304:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.837314:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054471680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.837318:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7861 00010000:00010000:1.0:1746129823.837330:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129823.837334:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000040:00080000:1.0:1746129823.837820:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3542, 88 off298432 00000004:00080000:1.0:1746129823.837825:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769895976821ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.837877:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3545, 88 off298608 00000004:00080000:1.0:1746129823.837880:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896032276ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.837899:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3546, 88 off298696 00000004:00080000:1.0:1746129823.837901:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896053522ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.837908:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3543, 88 off298520 00000004:00080000:1.0:1746129823.837910:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896061881ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.837917:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3544, 88 off298608 00000004:00080000:1.0:1746129823.837919:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896070731ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.837924:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3547, 88 off298784 00000004:00080000:1.0:1746129823.837925:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896077665ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.837930:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3548, 88 off298872 00000004:00080000:1.0:1746129823.837932:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896084512ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.837966:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3549, 88 off298960 00000004:00080000:1.0:1746129823.837969:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896120720ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.837976:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3545, 88 off298696 00000004:00080000:1.0:1746129823.837978:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896129800ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.837983:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3550, 88 off299048 00000004:00080000:1.0:1746129823.837985:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896137080ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.837994:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3546, 88 off298784 00000004:00080000:1.0:1746129823.837997:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896148982ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.838002:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3551, 88 off299136 00000004:00080000:1.0:1746129823.838004:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896156356ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129823.838010:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3547, 88 off298872 00000004:00080000:1.0:1746129823.838012:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896164666ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.838017:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3548, 88 off298960 00000004:00080000:1.0:1746129823.838020:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896172064ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.838025:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3549, 88 off299048 00000004:00080000:1.0:1746129823.838027:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896179151ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.838032:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3550, 88 off299136 00000004:00080000:1.0:1746129823.838034:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 769896186619ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129823.838039:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3552, 88 off299224 00000004:00080000:1.0:1746129823.838042:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769896193970ns, next at 716792379979ns, rc = 0 00000100:00100000:2.0:1746129823.839708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.839733:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471808 00000100:00100000:2.0:1746129823.839738:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471808 00000100:00100000:2.0:1746129823.839765:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11088 00000100:00100000:2.0:1746129823.839772:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31714:x1830949054471808:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.839786:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.839797:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35652b expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.839835:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.839843:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.839889:0:14313:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129823.842390:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.842409:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129823.842412:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129823.842416:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.842423:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3400, rc 0) 00000100:00100000:2.0:1746129823.842488:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31714:x1830949054471808:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2715us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.842496:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11088 00000100:00100000:1.0:1746129823.845971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.846360:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054471936 00000100:00100000:0.0:1746129823.846368:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054471936 00000100:00100000:0.0:1746129823.846406:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15703 00000100:00100000:0.0:1746129823.846412:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31715:x1830949054471936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129823.846429:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.846443:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356532 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.846462:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.846464:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.846470:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 36 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.846482:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 36 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.846495:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20e00, rc 0) 00000100:00100000:0.0:1746129823.847082:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31715:x1830949054471936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 668us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.847089:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15703 00000100:00100000:0.0:1746129823.850430:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.850498:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472064 00000100:00100000:3.0:1746129823.850505:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472064 00000100:00100000:3.0:1746129823.850536:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11089 00000100:00100000:3.0:1746129823.850542:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31715:x1830949054472064:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.850559:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.850573:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356539 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.850617:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.850627:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.850636:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129823.850638:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129823.850641:0:14313:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.850647:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27fc00, rc 0) 00000100:00100000:3.0:1746129823.850688:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31715:x1830949054472064:12345-192.168.204.31@tcp:101:cat.0 Request processed in 146us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.850693:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11089 00010000:00010000:1.0:1746129823.860523:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 12 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860537:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.860540:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746129823.860543:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860553:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860558:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860564:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860570:0:15044:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860575:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.860604:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.860620:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054068352:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129823.860708:0:15044:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.860715:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054068480:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129823.860732:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2b40 going to sleep for 11 seconds 00000001:00080000:1.0:1746129823.860747:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945109 is committed 00000001:00080000:1.0:1746129823.860757:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945111 is committed 00000004:00080000:1.0:1746129823.860761:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2719 committed 00000004:00080000:1.0:1746129823.860766:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2722 committed 00000004:00080000:1.0:1746129823.860773:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2721 committed 00000004:00080000:1.0:1746129823.860774:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2720 committed 00000004:00080000:1.0:1746129823.860776:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2719 committed 00000004:00080000:1.0:1746129823.860778:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2718 committed 00000004:00080000:1.0:1746129823.860779:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2718 committed 00000004:00080000:1.0:1746129823.860780:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2717 committed 00000004:00080000:1.0:1746129823.860781:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2717 committed 00000004:00080000:1.0:1746129823.860783:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2716 committed 00000004:00080000:1.0:1746129823.860784:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2715 committed 00000004:00080000:1.0:1746129823.860785:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2714 committed 00000004:00080000:1.0:1746129823.860786:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2716 committed 00000004:00080000:1.0:1746129823.860788:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2715 committed 00000004:00080000:1.0:1746129823.860789:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2713 committed 00000004:00080000:1.0:1746129823.860790:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2712 committed 00000004:00080000:1.0:1746129823.860792:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2714 committed 00000001:00080000:1.0:1746129823.860796:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945107 is committed 00000001:00080000:1.0:1746129823.860800:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945110 is committed 00000001:00080000:1.0:1746129823.860804:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945106 is committed 00000100:00100000:1.0:1746129823.860933:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054068608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.860964:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.860981:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054069120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.860994:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861009:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746129823.861013:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054068992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861026:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861036:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054069504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861048:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861075:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054068736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861090:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861100:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054069248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861112:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861122:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129823.861125:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054068864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861136:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861144:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054069376:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861154:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.861171:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054068608 00000100:00100000:1.0:1746129823.861176:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054068608 00000100:00100000:1.0:1746129823.861197:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069120 00000100:00100000:1.0:1746129823.861198:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069120 00000100:00100000:1.0:1746129823.861205:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054068992 00000100:00100000:1.0:1746129823.861206:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054068992 00000100:00100000:1.0:1746129823.861212:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069504 00000100:00100000:1.0:1746129823.861214:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069504 00000100:00100000:1.0:1746129823.861220:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054068736 00000100:00100000:1.0:1746129823.861221:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054068736 00000100:00100000:1.0:1746129823.861225:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069248 00000100:00100000:1.0:1746129823.861226:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069248 00000100:00100000:1.0:1746129823.861230:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054068864 00000100:00100000:1.0:1746129823.861231:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054068864 00000100:00100000:1.0:1746129823.861235:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069376 00000100:00100000:1.0:1746129823.861236:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069376 00000100:00100000:1.0:1746129823.861243:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15704 00000100:00100000:1.0:1746129823.861248:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054068608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129823.861374:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129823.861377:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861378:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861380:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861382:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746129823.861402:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054068608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 155us (439us total) trans 21474841358 rc 0/0 00000100:00100000:1.0:1746129823.861408:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15704 00000100:00100000:1.0:1746129823.861419:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15705 00000100:00100000:1.0:1746129823.861422:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054069120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861478:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054069120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (483us total) trans 21474841359 rc 0/0 00000100:00100000:1.0:1746129823.861483:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15705 00000100:00100000:1.0:1746129823.861490:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15706 00000100:00100000:1.0:1746129823.861493:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054068992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861541:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054068992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (514us total) trans 21474841360 rc 0/0 00000100:00100000:1.0:1746129823.861548:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15706 00000100:00100000:1.0:1746129823.861554:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15707 00000100:00100000:1.0:1746129823.861558:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054069504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861611:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054069504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (561us total) trans 21474841361 rc 0/0 00000100:00100000:1.0:1746129823.861616:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15707 00000100:00100000:1.0:1746129823.861623:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15708 00000100:00100000:1.0:1746129823.861626:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949054068736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129823.861685:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129823.861687:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861689:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861690:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861692:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129823.861710:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949054068736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (620us total) trans 21474841362 rc 0/0 00000100:00100000:1.0:1746129823.861715:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15708 00000100:00100000:1.0:1746129823.861722:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15709 00000100:00100000:1.0:1746129823.861726:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949054069248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.861788:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949054069248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (675us total) trans 21474841363 rc 0/0 00000100:00100000:1.0:1746129823.861793:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15709 00000100:00100000:1.0:1746129823.861800:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15710 00000100:00100000:1.0:1746129823.861804:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949054068864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129823.861880:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:1.0:1746129823.861883:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861884:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861886:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:1.0:1746129823.861887:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00000100:00100000:1.0:1746129823.861903:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949054068864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (766us total) trans 21474841364 rc 0/0 00000100:00100000:1.0:1746129823.861907:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15710 00000100:00100000:1.0:1746129823.861916:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15711 00000100:00100000:1.0:1746129823.861919:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3298:x1830949054069376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129823.861974:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129823.861977:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129823.861978:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129823.861980:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129823.861981:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129823.861998:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3298:x1830949054069376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (842us total) trans 21474841365 rc 0/0 00000100:00100000:1.0:1746129823.862003:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15711 00000004:00080000:1.0:1746129823.862078:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bf100/2, rc 0, transno 21474841364 00000100:00100000:1.0:1746129823.862085:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054068864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862093:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b100/2, rc 0, transno 21474841365 00000100:00100000:1.0:1746129823.862096:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054069376:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862101:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bdf80/2, rc 0, transno 21474841362 00000100:00100000:1.0:1746129823.862103:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054068736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862108:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bca80/2, rc 0, transno 21474841363 00000100:00100000:1.0:1746129823.862110:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054069248:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.862135:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746129823.862140:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054069632:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.862158:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.862172:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069632 00000100:00100000:1.0:1746129823.862174:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069632 00000100:00100000:1.0:1746129823.862186:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15712 00000100:00100000:1.0:1746129823.862189:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3296:x1830949054069632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129823.862262:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3296:x1830949054069632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (103us total) trans 21474841366 rc 0/0 00000100:00100000:1.0:1746129823.862267:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15712 00000004:00080000:1.0:1746129823.862345:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3b800/2, rc 0, transno 21474841366 00000100:00100000:1.0:1746129823.862348:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054069632:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862359:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bf480/2, rc 0, transno 21474841360 00000100:00100000:1.0:1746129823.862361:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054068992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862366:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38000/2, rc 0, transno 21474841361 00000100:00100000:1.0:1746129823.862367:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054069504:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862373:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bce00/2, rc 0, transno 21474841358 00000100:00100000:1.0:1746129823.862374:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054068608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129823.862379:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bdc00/2, rc 0, transno 21474841359 00000100:00100000:1.0:1746129823.862381:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054069120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129823.862657:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054069888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.862678:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.862690:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054070400:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.862701:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.862710:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746129823.862714:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054069760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.862726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.862734:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054070272:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.862743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129823.862759:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069888 00000100:00100000:2.0:1746129823.862761:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069888 00000100:00100000:2.0:1746129823.862774:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070400 00000100:00100000:2.0:1746129823.862775:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070400 00000100:00100000:2.0:1746129823.862782:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054069760 00000100:00100000:2.0:1746129823.862783:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054069760 00000100:00100000:2.0:1746129823.862790:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070272 00000100:00100000:2.0:1746129823.862791:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070272 00000100:00100000:2.0:1746129823.862799:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15713 00000100:00100000:2.0:1746129823.862803:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3299:x1830949054069888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129823.862918:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129823.862920:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.862922:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.862924:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.862926:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129823.862946:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949054069888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (267us total) trans 17179874164 rc 0/0 00000100:00100000:2.0:1746129823.862952:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15713 00000100:00100000:2.0:1746129823.862961:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15714 00000100:00100000:2.0:1746129823.862965:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3299:x1830949054070400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.863032:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949054070400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (329us total) trans 17179874165 rc 0/0 00000100:00100000:2.0:1746129823.863037:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15714 00000100:00100000:2.0:1746129823.863045:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15715 00000100:00100000:2.0:1746129823.863049:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3299:x1830949054069760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746129823.863120:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129823.863122:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.863124:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.863125:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:2.0:1746129823.863127:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129823.863144:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949054069760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (416us total) trans 17179874166 rc 0/0 00000100:00100000:2.0:1746129823.863148:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15715 00000100:00100000:2.0:1746129823.863156:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15716 00000100:00100000:2.0:1746129823.863160:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3299:x1830949054070272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.863233:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949054070272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (489us total) trans 17179874167 rc 0/0 00000100:00100000:2.0:1746129823.863238:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15716 00000004:00080000:2.0:1746129823.863268:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18000/2, rc 0, transno 17179874166 00000100:00100000:2.0:1746129823.863272:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054069760:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.863277:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85880/2, rc 0, transno 17179874167 00000100:00100000:2.0:1746129823.863281:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054070272:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.863286:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85180/2, rc 0, transno 17179874164 00000100:00100000:2.0:1746129823.863288:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054069888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129823.863293:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85500/2, rc 0, transno 17179874165 00000100:00100000:2.0:1746129823.863295:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054070400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.864269:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.864296:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.864552:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.864569:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129823.865876:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129823.865884:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.865902:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.865933:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070016 00000100:00100000:0.0:1746129823.865938:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070016 00000100:00100000:0.0:1746129823.865962:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070528 00000100:00100000:0.0:1746129823.865963:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070528 00000100:00100000:1.0:1746129823.866731:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070656:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.866750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129823.866764:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070144 00000100:00100000:0.0:1746129823.866767:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070144 00000100:00100000:0.0:1746129823.866786:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15717 00000100:00100000:0.0:1746129823.866791:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3296:x1830949054070016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129823.866951:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129823.866955:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129823.866956:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129823.866958:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129823.866960:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129823.866988:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949054070016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (2691us total) trans 17179874168 rc 0/0 00000100:00100000:0.0:1746129823.866994:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15717 00000100:00100000:0.0:1746129823.867007:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15718 00000100:00100000:0.0:1746129823.867011:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3296:x1830949054070528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129823.867094:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949054070528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (2523us total) trans 17179874169 rc 0/0 00000100:00100000:0.0:1746129823.867099:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15718 00000100:00100000:0.0:1746129823.867108:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15719 00000100:00100000:0.0:1746129823.867111:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+27:3296:x1830949054070144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129823.867180:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949054070144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1276us total) trans 17179874170 rc 0/0 00000100:00100000:0.0:1746129823.867185:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15719 00000004:00080000:1.0:1746129823.867419:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84700/2, rc 0, transno 17179874168 00000100:00100000:1.0:1746129823.867424:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070016:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129823.867432:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84000/2, rc 0, transno 17179874169 00000100:00100000:1.0:1746129823.867435:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070528:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129823.867442:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87480/2, rc 0, transno 17179874170 00000100:00100000:1.0:1746129823.867445:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070144:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.867513:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054070656 00000100:00100000:1.0:1746129823.867517:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054070656 00000100:00100000:1.0:1746129823.867544:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15720 00000100:00100000:1.0:1746129823.867549:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3296:x1830949054070656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129823.867629:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949054070656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (878us total) trans 17179874171 rc 0/0 00000100:00100000:1.0:1746129823.867633:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15720 00000004:00080000:1.0:1746129823.867650:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba84380/2, rc 0, transno 17179874171 00000100:00100000:1.0:1746129823.867653:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054070656:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129823.869361:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.869439:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054068480:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.869615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.869929:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091fa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054068352:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129823.869962:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53000/0x48868a4e43955bab lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 9 pid: 15044 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746129823.869983:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.870010:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb53c00, rc 0) 00000100:00100000:1.0:1746129823.870044:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31709:x1830949054471296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 38250us (39913us total) trans 8589945111 rc 0/0 00000100:00100000:1.0:1746129823.870051:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11087 00000100:00100000:2.0:1746129823.870336:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.870397:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472192 00000100:00100000:0.0:1746129823.870402:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472192 00000100:00100000:0.0:1746129823.870424:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472320 00000100:00100000:0.0:1746129823.870426:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472320 00000100:00100000:0.0:1746129823.870438:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4647 00000100:00100000:0.0:1746129823.870442:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31714:x1830949054472192:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129823.870497:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31714:x1830949054472192:12345-192.168.204.31@tcp:49:cat.0 Request processed in 55us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.870501:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4647 00000100:00100000:0.0:1746129823.870528:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4648 00000100:00100000:0.0:1746129823.870754:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31715:x1830949054472320:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129823.870789:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31715:x1830949054472320:12345-192.168.204.31@tcp:49:cat.0 Request processed in 256us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.870793:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4648 00000100:00100000:1.0:1746129823.871188:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472448 00000100:00100000:1.0:1746129823.871192:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472448 00000100:00100000:1.0:1746129823.871221:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11090 00000100:00100000:1.0:1746129823.871226:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31710:x1830949054472448:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129823.871234:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.871244:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3000/0x48868a4e43955bce lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356540 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.874405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129823.874613:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3000/0x48868a4e43955bce lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356540 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.874629:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3000/0x48868a4e43955bce lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356540 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.874653:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.874656:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129823.874659:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3000, rc 0) 00000100:00100000:1.0:1746129823.874713:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31710:x1830949054472448:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3485us (4376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.874724:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11090 00000100:00100000:0.0:1746129823.874913:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472576 00000100:00100000:0.0:1746129823.874919:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472576 00000100:00100000:0.0:1746129823.874944:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4649 00000100:00100000:0.0:1746129823.874950:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31709:x1830949054472576:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:0.0:1746129823.875008:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31709:x1830949054472576:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 57us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.875013:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4649 00000100:00100000:2.0:1746129823.875834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.877127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.877189:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472704 00000100:00100000:0.0:1746129823.877194:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472704 00000100:00100000:0.0:1746129823.877836:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15721 00000100:00100000:0.0:1746129823.877844:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31714:x1830949054472704:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129823.877869:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.877882:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356547 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.877887:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.877902:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054473216 00010000:00010000:0.0:1746129823.877903:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.877904:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129823.877905:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054473216 00010000:00010000:0.0:1746129823.877911:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.877923:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746129823.877927:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009284e680 x1830949054473216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746129823.877931:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb21a00, rc 0) 00002000:00100000:2.0:1746129823.877935:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284e680 with x1830949054473216 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.877938:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284e680 00000100:00100000:2.0:1746129823.877949:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7059 00000100:00100000:2.0:1746129823.877954:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054473216:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129823.877959:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31714:x1830949054472704:12345-192.168.204.31@tcp:101:cat.0 Request processed in 117us (2128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.877964:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15721 00000100:00100000:3.0:1746129823.878105:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.878147:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472960 00000100:00100000:3.0:1746129823.878150:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472960 00000100:00100000:3.0:1746129823.878167:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15722 00000100:00100000:3.0:1746129823.878172:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31709:x1830949054472960:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129823.878178:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.878184:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35654e expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.878197:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.878204:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.878215:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.878220:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.878221:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.878224:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [999424->1048575] (req 999424->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.878245:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 26 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.878255:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 26 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.878265:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054070784:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.878312:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.878319:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746129823.878327:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054070912:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129823.878349:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129823.878357:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054472832 00010000:00010000:3.0:1746129823.878360:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 10 pid: 1140 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.878360:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054472832 00000100:00100000:3.0:1746129823.878367:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054071040:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129823.878382:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.878383:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 743 00000100:00100000:1.0:1746129823.878387:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1961:x1830949054472832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.878395:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.878409:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3000/0x48868a4e43955bce lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356540 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129823.878421:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129823.878424:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.878438:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1961:x1830949054472832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.878444:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 743 00000100:00100000:3.0:1746129823.880911:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.881109:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054473472 00000100:00100000:1.0:1746129823.881116:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054473472 00010000:00010000:1.0:1746129823.881138:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 11 pid: 1140 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746129823.881159:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7862 00000100:00100000:1.0:1746129823.881165:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054473472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.881174:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.881193:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 11 pid: 1140 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129823.881201:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 11 pid: 1140 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746129823.881219:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.881242:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054473472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.881248:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7862 00000100:00100000:2.0:1746129823.881531:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054070784:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.881541:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054070912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.881549:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe800/0x48868a4e43955aaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564c9 expref: 10 pid: 1140 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746129823.881568:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054071040:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.881591:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [999424->1048575] (req 999424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 24 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.881600:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1400, rc 0) 00000100:00100000:2.0:1746129823.881619:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31709:x1830949054472960:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3446us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.881624:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15722 00000100:00100000:3.0:1746129823.881707:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.882122:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054473344 00000100:00100000:1.0:1746129823.882126:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054473344 00010000:00010000:1.0:1746129823.882137:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.882155:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7863 00000100:00100000:1.0:1746129823.882160:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054473344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129823.882166:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129823.882174:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.882182:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.882194:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d6c3600/0x48868a4e43955b6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356508 expref: 27 pid: 4589 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.882202:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129823.882230:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054473344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129823.882235:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7863 00000100:00100000:0.0:1746129823.885723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.885767:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054473728 00000100:00100000:1.0:1746129823.885774:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054473728 00002000:00100000:1.0:1746129823.885806:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c1c7b80 x1830949054473728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129823.885815:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7b80 with x1830949054473728 ext(0->1048575) 00010000:00010000:1.0:1746129823.885822:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746129823.885832:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:1.0:1746129823.885838:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1c7b80 00000100:00100000:3.0:1746129823.886247:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1910 00000100:00100000:3.0:1746129823.886255:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054473728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.886335:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054473216:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8379us (8446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.886343:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7059 00002000:00100000:2.0:1746129823.886349:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009284e680 x1830949054473216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.886356:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284e680 with x1830949054473216 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.886359:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284e680 00000100:00100000:0.0:1746129823.891896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.892324:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054473728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6069us (6607us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.892334:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1910 00002000:00100000:3.0:1746129823.892342:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c1c7b80 x1830949054473728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.892350:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c7b80 with x1830949054473728 ext(0->1048575) 00010000:00010000:3.0:1746129823.892358:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.892369:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.892375:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c1c7b80 00000100:00100000:2.0:1746129823.892506:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054473856 00000100:00100000:2.0:1746129823.892513:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054473856 00000100:00100000:2.0:1746129823.892542:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15723 00000100:00100000:2.0:1746129823.892548:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31715:x1830949054473856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.892560:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.892572:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356555 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.892590:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.892591:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.892597:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 37 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.892609:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 37 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.892618:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f881400, rc 0) 00000100:00100000:2.0:1746129823.892632:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31715:x1830949054473856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 85us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.892636:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15723 00000100:00100000:1.0:1746129823.892868:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.892889:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054473984 00000100:00100000:0.0:1746129823.892892:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054473984 00000100:00100000:0.0:1746129823.892918:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15724 00000100:00100000:0.0:1746129823.892923:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31710:x1830949054473984:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129823.892929:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.892939:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35655c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.892957:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.892963:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.892968:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.892970:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.892972:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1429504->1789951] (req 1429504->1789951) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.892995:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.893003:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.893013:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054071168:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129823.893135:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.893144:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 10 pid: 8437 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746129823.893152:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054071296:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.893172:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.894506:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054071168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129823.894515:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054071296:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.894532:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1429504->1789951] (req 1429504->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.894542:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f984400, rc 0) 00000100:00100000:2.0:1746129823.894574:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31710:x1830949054473984:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1650us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.894580:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15724 00000100:00100000:1.0:1746129823.895905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.895975:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.896022:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054474112 00000100:00100000:0.0:1746129823.896028:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054474112 00010000:00010000:0.0:1746129823.896050:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 11 pid: 8437 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746129823.896084:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054474240 00000100:00100000:0.0:1746129823.896087:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054474240 00010000:00010000:0.0:1746129823.896095:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746129823.896267:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7864 00000100:00100000:3.0:1746129823.896271:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7865 00000100:00100000:0.0:1746129823.896272:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054474112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129823.896277:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949054474240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.896282:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129823.896282:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.896297:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.896297:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 11 pid: 8437 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129823.896305:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746129823.896313:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 11 pid: 8437 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129823.896328:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bb20e00/0x48868a4e43955bc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356532 expref: 38 pid: 3623 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.896366:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.896367:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb4e00/0x48868a4e43955ab6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d0 expref: 11 pid: 8437 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746129823.896368:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.896373:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.896380:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.896468:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129823.896493:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 37 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.896504:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054474112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 231us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.896509:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7864 00000100:00100000:3.0:1746129823.896553:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054071424:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129823.896619:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.900474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.900580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.900613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.900657:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054474752 00000100:00100000:0.0:1746129823.900664:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054474752 00010000:00010000:0.0:1746129823.900690:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.900692:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054071424:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.900708:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129823.900711:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7866 00000100:00100000:0.0:1746129823.900716:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054474752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129823.900725:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129823.900737:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949054474240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4460us (4762us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129823.900742:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.900743:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7865 00010000:00010000:0.0:1746129823.900751:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.900765:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054474624 00000100:00100000:2.0:1746129823.900769:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054474624 00010000:00010000:0.0:1746129823.900778:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bb21a00/0x48868a4e43955bd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356547 expref: 24 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.900784:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15725 00000100:00100000:2.0:1746129823.900788:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31714:x1830949054474624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129823.900791:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.900792:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.900799:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.900801:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.900807:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.900808:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356563 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.900823:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.900828:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129823.900829:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129823.900829:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.900831:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129823.900843:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054071552:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.900844:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 36 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.900867:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 36 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.900874:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054071680:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129823.900903:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.900907:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.901046:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054474496 00000100:00100000:3.0:1746129823.901051:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054474496 00002000:00100000:3.0:1746129823.901087:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012ba3b480 x1830949054474496/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.901096:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b480 with x1830949054474496 ext(1048576->2097151) 00002000:00010000:3.0:1746129823.901099:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b480 00000100:00100000:3.0:1746129823.901111:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7060 00000100:00100000:3.0:1746129823.901116:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054474496:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129823.903796:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.905509:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054475008 00000100:00100000:2.0:1746129823.905519:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054475008 00002000:00100000:2.0:1746129823.905555:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1785856->1789951) req@ffff8800a5492a00 x1830949054475008/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.905572:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492a00 with x1830949054475008 ext(1785856->1789951) 00010000:00010000:2.0:1746129823.905580:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.905593:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.905600:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5492a00 00000100:00100000:2.0:1746129823.905618:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1911 00000100:00100000:2.0:1746129823.905625:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054475008:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129823.905763:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5492a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054475008:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 138us (1973us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129823.905769:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1911 00002000:00100000:2.0:1746129823.905774:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1785856->1789951) req@ffff8800a5492a00 x1830949054475008/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.905781:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5492a00 with x1830949054475008 ext(1785856->1789951) 00010000:00010000:2.0:1746129823.905785:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.905793:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.905798:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a5492a00 00000100:00100000:2.0:1746129823.907301:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054071552:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.907317:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.907353:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054474752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6636us (6738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.907361:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7866 00000100:00100000:2.0:1746129823.907463:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054071680:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129823.907560:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.907575:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f881600, rc 0) 00000100:00100000:2.0:1746129823.908327:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31714:x1830949054474624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7535us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.908334:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15725 00000100:00100000:3.0:1746129823.908827:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054474496:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7709us (8362us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.908834:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7060 00002000:00100000:3.0:1746129823.908840:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012ba3b480 x1830949054474496/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.908867:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b480 with x1830949054474496 ext(1048576->2097151) 00002000:00010000:3.0:1746129823.908871:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b480 00000100:00100000:0.0:1746129823.911412:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.911678:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054475264 00000100:00100000:3.0:1746129823.911685:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054475264 00002000:00100000:3.0:1746129823.911721:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (999424->1003519) req@ffff88009c1c4000 x1830949054475264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.911730:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4000 with x1830949054475264 ext(999424->1003519) 00002000:00010000:3.0:1746129823.911734:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c4000 00000100:00100000:3.0:1746129823.911763:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7061 00000100:00100000:3.0:1746129823.911770:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054475264:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.911932:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054475264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 161us (525us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.911939:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7061 00002000:00100000:3.0:1746129823.911944:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (999424->1003519) req@ffff88009c1c4000 x1830949054475264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.911951:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c4000 with x1830949054475264 ext(999424->1003519) 00002000:00010000:3.0:1746129823.911954:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c1c4000 00000100:00100000:0.0:1746129823.913120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.913159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.913218:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054475520 00000100:00100000:3.0:1746129823.913222:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054475520 00002000:00100000:3.0:1746129823.913240:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1429504->1789951) req@ffff88009c1c5c00 x1830949054475520/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.913248:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5c00 with x1830949054475520 ext(1429504->1789951) 00010000:00010000:3.0:1746129823.913254:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 37 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746129823.913260:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054475776 00000100:00100000:1.0:1746129823.913263:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054475776 00010000:00010000:3.0:1746129823.913266:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 37 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.913271:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c5c00 00000100:00100000:3.0:1746129823.913282:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1912 00000100:00100000:1.0:1746129823.913282:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4650 00000100:00100000:3.0:1746129823.913287:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054475520:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129823.913287:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31710:x1830949054475776:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129823.913478:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31710:x1830949054475776:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 189us (358us total) trans 8589945112 rc 0/0 00000100:00100000:1.0:1746129823.913483:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4650 00000100:00100000:0.0:1746129823.915812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.918467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.918549:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054475904 00000100:00100000:3.0:1746129823.918556:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054475904 00000100:00100000:3.0:1746129823.918586:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054476032 00000100:00100000:3.0:1746129823.918588:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054476032 00000100:00100000:3.0:1746129823.918907:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15726 00000100:00100000:3.0:1746129823.918916:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31709:x1830949054475904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129823.918931:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.918946:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35656a expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.918967:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129823.918973:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.918978:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129823.918981:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.919010:0:1140:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.919020:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1048576->1282047] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.919028:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1c00, rc 0) 00000100:00100000:3.0:1746129823.919076:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31709:x1830949054475904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 161us (3268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.919081:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15726 00000100:00100000:3.0:1746129823.919098:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15727 00000100:00100000:3.0:1746129823.919102:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31715:x1830949054476032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.919109:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.919116:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356571 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.919126:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.919128:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.919133:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.919143:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 27 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.919149:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0800, rc 0) 00000100:00100000:3.0:1746129823.919162:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31715:x1830949054476032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 59us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.919166:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15727 00000100:00100000:3.0:1746129823.921216:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054475520:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 7922us (8050us total) trans 17179874172 rc 0/0 00000100:00100000:3.0:1746129823.921224:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1912 00002000:00100000:3.0:1746129823.921232:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1429504->1789951) req@ffff88009c1c5c00 x1830949054475520/t17179874172(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/448 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.921240:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c1c5c00 with x1830949054475520 ext(1429504->1789951) 00010000:00010000:3.0:1746129823.921247:0:21600:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.921258:0:21600:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746129823.921264:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c1c5c00 00000100:00100000:0.0:1746129823.923019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.923091:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054476160 00000100:00100000:2.0:1746129823.923097:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054476160 00010000:00010000:2.0:1746129823.923118:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.923137:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7867 00000100:00100000:2.0:1746129823.923142:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054476160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129823.923151:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129823.923165:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.923173:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.923194:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f984400/0x48868a4e43955bea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1429504->1789951) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35655c expref: 39 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.923302:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.923304:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.923310:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.923318:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.923344:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.923355:0:7107:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 28 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.923365:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054071936:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.924443:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.924683:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.924760:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054476416 00000100:00100000:3.0:1746129823.924764:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054476416 00002000:00100000:3.0:1746129823.924793:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a5491880 x1830949054476416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.924802:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491880 with x1830949054476416 ext(1048576->2097151) 00002000:00010000:3.0:1746129823.924805:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491880 00000100:00100000:3.0:1746129823.926016:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7062 00000100:00100000:3.0:1746129823.926025:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054476416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129823.927089:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054071936:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.927105:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129823.927136:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949054476160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3994us (4122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.927144:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7867 00000100:00100000:0.0:1746129823.930458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.931131:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054476672 00000100:00100000:2.0:1746129823.931139:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054476672 00002000:00100000:2.0:1746129823.931180:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094d8ed80 x1830949054476672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.931188:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949054476672 ext(1048576->2097151) 00010000:00010000:2.0:1746129823.931196:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 29 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.931208:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 29 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.931215:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8ed80 00000100:00100000:2.0:1746129823.931284:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1913 00000100:00100000:2.0:1746129823.931291:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054476672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.937055:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054476416:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11022us (12363us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.937075:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7062 00002000:00100000:2.0:1746129823.937084:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a5491880 x1830949054476416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.937094:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5491880 with x1830949054476416 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.937098:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5491880 00000100:00100000:2.0:1746129823.939910:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054476672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8610us (9449us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.939921:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1913 00002000:00100000:2.0:1746129823.939930:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094d8ed80 x1830949054476672/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.939943:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8ed80 with x1830949054476672 ext(1048576->2097151) 00010000:00010000:2.0:1746129823.939951:0:21602:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 29 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.939963:0:21602:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 29 pid: 8436 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746129823.939969:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094d8ed80 00000100:00100000:0.0:1746129823.944897:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.944946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.944953:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054476800 00000100:00100000:3.0:1746129823.944960:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054476800 00000100:00100000:3.0:1746129823.944994:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15728 00000100:00100000:3.0:1746129823.945000:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31714:x1830949054476800:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129823.945043:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054476928 00000100:00100000:2.0:1746129823.945047:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054476928 00010000:00010000:3.0:1746129823.945053:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.945074:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356578 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.945075:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 30 pid: 8436 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746129823.945093:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7868 00010000:00010000:3.0:1746129823.945095:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.945096:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129823.945097:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054476928:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129823.945102:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 31 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.945103:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129823.945115:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 31 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.945119:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 31 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746129823.945124:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1e00, rc 0) 00010000:00010000:2.0:1746129823.945128:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 31 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.945141:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f881600/0x48868a4e43955bf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356563 expref: 31 pid: 8436 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746129823.945152:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129823.945154:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129823.945155:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31714:x1830949054476800:12345-192.168.204.31@tcp:101:cat.0 Request processed in 156us (562us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129823.945158:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.945160:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15728 00010000:00010000:2.0:1746129823.945164:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129823.945185:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.945195:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054072064:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129823.945890:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.946229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.946288:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054477056 00000100:00100000:3.0:1746129823.946292:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054477056 00000100:00100000:3.0:1746129823.946313:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15729 00000100:00100000:3.0:1746129823.946318:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054477056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.946325:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.946334:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae1200/0x48868a4e43955c0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35657f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129823.946363:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054072192:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129823.946385:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129823.946462:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.946533:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054477312 00000100:00100000:0.0:1746129823.946536:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054477312 00000100:00100000:0.0:1746129823.946563:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15730 00000100:00100000:0.0:1746129823.946569:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054477312:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129823.946575:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129823.946582:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35658d expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129823.946592:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.946593:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129823.946598:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 30 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.946611:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 30 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129823.946623:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093360800, rc 0) 00000100:00100000:0.0:1746129823.946656:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054477312:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129823.946661:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15730 00000100:00100000:0.0:1746129823.947399:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.947647:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.947930:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054072192:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.947949:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1200/0x48868a4e43955c0d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35657f expref: 29 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.947957:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1200/0x48868a4e43955c0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35657f expref: 29 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.947975:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1200, rc 0) 00000100:00100000:3.0:1746129823.947996:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054477056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1677us (1767us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.948001:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15729 00000100:00100000:3.0:1746129823.948015:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054477184 00000100:00100000:3.0:1746129823.948017:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054477184 00000100:00100000:3.0:1746129823.948629:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054477440 00000100:00100000:3.0:1746129823.948632:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054477440 00000100:00100000:1.0:1746129823.948659:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15731 00000100:00100000:1.0:1746129823.948666:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054477184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129823.948675:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129823.948684:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0ce00/0x48868a4e43955c1b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356586 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129823.948713:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054072320:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129823.948864:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.948966:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15732 00000100:00100000:3.0:1746129823.948973:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054477440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.948983:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.948991:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356594 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.949034:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054072064:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129823.949043:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129823.949113:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.949114:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.949120:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 41 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.949132:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 41 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.949139:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0000, rc 0) 00000100:00100000:2.0:1746129823.949201:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054476928:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4102us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129823.949208:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7868 00000100:00100000:3.0:1746129823.949298:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949054477440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 325us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.949303:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15732 00000100:00100000:2.0:1746129823.954042:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a5490a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054072320:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129823.954087:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0ce00/0x48868a4e43955c1b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356586 expref: 40 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.954100:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8f0ce00/0x48868a4e43955c1b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356586 expref: 40 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.954121:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f0ce00, rc 0) 00000100:00100000:2.0:1746129823.954170:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054477184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5503us (6769us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.954177:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15731 00000100:00100000:0.0:1746129823.954776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.954816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.954883:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054477696 00000100:00100000:2.0:1746129823.954888:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054477696 00002000:00100000:2.0:1746129823.954919:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093288e00 x1830949054477696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.954927:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949054477696 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.954932:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:2.0:1746129823.954944:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054477952 00000100:00100000:2.0:1746129823.954946:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054477952 00002000:00100000:2.0:1746129823.954956:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f2:0x0] (1277952->1282047) req@ffff88009328b480 x1830949054477952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.954962:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b480 with x1830949054477952 ext(1277952->1282047) 00002000:00010000:2.0:1746129823.954965:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b480 00000100:00100000:2.0:1746129823.955299:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7063 00000100:00100000:2.0:1746129823.955305:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054477696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.956785:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7064 00000100:00100000:3.0:1746129823.956795:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054477952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129823.960279:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054477952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 3476us (5452us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129823.960290:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7064 00002000:00100000:3.0:1746129823.960300:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3f2:0x0] (1277952->1282047) req@ffff88009328b480 x1830949054477952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/4536 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.960308:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b480 with x1830949054477952 ext(1277952->1282047) 00002000:00010000:3.0:1746129823.960313:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b480 00000100:00100000:0.0:1746129823.965404:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129823.966443:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054478208 00000100:00100000:3.0:1746129823.966452:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054478208 00002000:00100000:3.0:1746129823.966488:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880093289180 x1830949054478208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.966497:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289180 with x1830949054478208 ext(2097152->3145727) 00002000:00010000:3.0:1746129823.966502:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093289180 00000100:00100000:3.0:1746129823.966519:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7065 00000100:00100000:3.0:1746129823.966525:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054478208:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.968891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129823.968935:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054478336 00000100:00100000:0.0:1746129823.968941:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054478336 00002000:00100000:0.0:1746129823.968968:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a5493100 x1830949054478336/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129823.968976:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493100 with x1830949054478336 ext(3145728->4194303) 00002000:00010000:0.0:1746129823.968979:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493100 00000100:00100000:0.0:1746129823.968994:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7066 00000100:00100000:0.0:1746129823.969000:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054478336:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129823.969201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.969227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.969538:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054477696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14232us (14762us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.969544:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7063 00002000:00100000:2.0:1746129823.969549:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880093288e00 x1830949054477696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.969556:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949054477696 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.969560:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:2.0:1746129823.969573:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054478720 00000100:00100000:2.0:1746129823.969575:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054478720 00002000:00100000:2.0:1746129823.969586:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009284df80 x1830949054478720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.969592:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284df80 with x1830949054478720 ext(2097152->3145727) 00002000:00010000:2.0:1746129823.969595:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284df80 00000100:00100000:2.0:1746129823.970350:0:21602:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054478848 00000100:00100000:2.0:1746129823.970354:0:21602:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054478848 00002000:00100000:2.0:1746129823.970366:0:21602:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009284f800 x1830949054478848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.970372:0:21602:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f800 with x1830949054478848 ext(3145728->4194303) 00002000:00010000:2.0:1746129823.970374:0:21602:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f800 00000100:00100000:3.0:1746129823.970405:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7067 00000100:00100000:3.0:1746129823.970412:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949054478720:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129823.970812:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7068 00000100:00100000:0.0:1746129823.970817:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1963:x1830949054478848:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.972194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.972223:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054479232 00000100:00100000:1.0:1746129823.972228:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054479232 00000100:00100000:1.0:1746129823.972258:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4651 00000100:00100000:1.0:1746129823.972264:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31709:x1830949054479232:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129823.972511:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31709:x1830949054479232:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 246us (319us total) trans 8589945113 rc 0/0 00000100:00100000:1.0:1746129823.972517:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4651 00000100:00100000:3.0:1746129823.980184:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054478208:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13650us (14779us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.980194:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7065 00002000:00100000:3.0:1746129823.980204:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880093289180 x1830949054478208/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.980213:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289180 with x1830949054478208 ext(2097152->3145727) 00002000:00010000:3.0:1746129823.980218:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093289180 00000100:00100000:0.0:1746129823.981463:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.982124:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5493100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054478336:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12539us (12653us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.982136:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7066 00002000:00100000:2.0:1746129823.982146:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a5493100 x1830949054478336/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.982153:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5493100 with x1830949054478336 ext(3145728->4194303) 00002000:00010000:2.0:1746129823.982158:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a5493100 00000100:00100000:3.0:1746129823.982626:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054479360 00000100:00100000:3.0:1746129823.982632:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054479360 00000100:00100000:3.0:1746129823.982868:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15733 00000100:00100000:3.0:1746129823.982874:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31714:x1830949054479360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129823.982887:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129823.982900:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35659b expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.982919:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.982921:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129823.982926:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.982938:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129823.982946:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1a00, rc 0) 00000100:00100000:3.0:1746129823.982970:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31714:x1830949054479360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 96us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129823.982974:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15733 00000100:00100000:3.0:1746129823.985547:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1964:x1830949054478720:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15125us (16336us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129823.985557:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7067 00002000:00100000:3.0:1746129823.985566:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009284df80 x1830949054478720/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129823.985574:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284df80 with x1830949054478720 ext(2097152->3145727) 00002000:00010000:3.0:1746129823.985579:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284df80 00000100:00100000:2.0:1746129823.989978:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054478848:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19151us (20741us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.989989:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7068 00002000:00100000:2.0:1746129823.989999:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009284f800 x1830949054478848/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.990014:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284f800 with x1830949054478848 ext(3145728->4194303) 00002000:00010000:2.0:1746129823.990018:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284f800 00000100:00100000:0.0:1746129823.991770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.991883:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054479616 00000100:00100000:2.0:1746129823.991891:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054479616 00002000:00100000:2.0:1746129823.991933:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009328aa00 x1830949054479616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/0 e 0 to 0 dl 1746129834 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.991941:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328aa00 with x1830949054479616 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.991945:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328aa00 00000100:00100000:2.0:1746129823.991976:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7069 00000100:00100000:2.0:1746129823.991983:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054479616:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129823.996332:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129823.996380:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129823.997147:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054479872 00000100:00100000:2.0:1746129823.997156:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054479872 00000100:00100000:2.0:1746129823.997196:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054479744 00000100:00100000:2.0:1746129823.997198:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054479744 00000100:00100000:2.0:1746129823.997215:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15734 00000100:00100000:2.0:1746129823.997221:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054479872:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.997236:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.997249:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305a6000/0x48868a4e43955c30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565a9 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.997292:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054072448:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.997355:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129823.997372:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15735 00000100:00100000:2.0:1746129823.997377:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054479744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129823.997385:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129823.997393:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013094be00/0x48868a4e43955c37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565a2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129823.997413:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054072576:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129823.997430:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129823.998988:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054072448:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.999010:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305a6000/0x48868a4e43955c30 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565a9 expref: 40 pid: 1140 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129823.999014:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054072576:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129823.999021:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305a6000/0x48868a4e43955c30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565a9 expref: 40 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.999025:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013094be00/0x48868a4e43955c37 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565a2 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129823.999032:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013094be00/0x48868a4e43955c37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565a2 expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129823.999044:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6000, rc 0) 00010000:00010000:2.0:1746129823.999046:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013094be00, rc 0) 00000100:00100000:3.0:1746129823.999082:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054479872:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1860us (2758us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129823.999089:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15734 00000100:00100000:2.0:1746129823.999154:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054479744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1776us (2773us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129823.999159:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15735 00000100:00100000:2.0:1746129823.999481:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054479616:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7497us (7717us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129823.999489:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7069 00002000:00100000:2.0:1746129823.999496:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009328aa00 x1830949054479616/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:564/0 lens 488/440 e 0 to 0 dl 1746129834 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129823.999504:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328aa00 with x1830949054479616 ext(1048576->2097151) 00002000:00010000:2.0:1746129823.999508:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328aa00 00000100:00100000:0.0:1746129824.004436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.004475:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.004512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.004656:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054480128 00000100:00100000:2.0:1746129824.004664:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054480128 00002000:00100000:2.0:1746129824.004705:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880093289500 x1830949054480128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.004712:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289500 with x1830949054480128 ext(4194304->4931583) 00002000:00010000:2.0:1746129824.004716:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093289500 00000100:00100000:2.0:1746129824.004739:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7070 00000100:00100000:2.0:1746129824.004744:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054480128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129824.005104:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054480256 00000100:00100000:3.0:1746129824.005108:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054480256 00000100:00100000:3.0:1746129824.005128:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054480384 00000100:00100000:3.0:1746129824.005130:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054480384 00000100:00100000:3.0:1746129824.005159:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15736 00000100:00100000:3.0:1746129824.005165:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054480256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129824.005173:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.005186:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565b0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.005203:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.005205:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.005211:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.005223:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 25 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.005231:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1600, rc 0) 00000100:00100000:3.0:1746129824.005267:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054480256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.005273:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15736 00000100:00100000:3.0:1746129824.005290:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15737 00000100:00100000:3.0:1746129824.005295:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054480384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129824.005304:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.005313:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565b7 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.005323:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.005324:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.005328:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 30 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.005416:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 30 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.005423:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1000, rc 0) 00000100:00100000:3.0:1746129824.005440:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054480384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 145us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.005445:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15737 00000100:00080000:0.0:1746129824.005573:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746129824.005576:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129824.014500:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054480128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9746us (10060us total) trans 0 rc 737280/737280 00000100:00100000:0.0:1746129824.014511:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7070 00002000:00100000:0.0:1746129824.014521:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880093289500 x1830949054480128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/440 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129824.014529:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289500 with x1830949054480128 ext(4194304->4931583) 00002000:00010000:0.0:1746129824.014535:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093289500 00000100:00100000:0.0:1746129824.024224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.024264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.024305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.024967:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054480640 00000100:00100000:2.0:1746129824.024968:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054480896 00000100:00100000:3.0:1746129824.024975:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054480640 00000100:00100000:2.0:1746129824.024975:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054480896 00002000:00100000:3.0:1746129824.025010:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880095241180 x1830949054480640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.025010:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095242a00 x1830949054480896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.025019:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241180 with x1830949054480640 ext(2097152->3145727) 00002000:00100000:2.0:1746129824.025019:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949054480896 ext(2097152->3145727) 00002000:00010000:2.0:1746129824.025023:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242a00 00002000:00010000:3.0:1746129824.025024:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241180 00000100:00100000:3.0:1746129824.025038:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054481152 00000100:00100000:3.0:1746129824.025040:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054481152 00002000:00100000:3.0:1746129824.025051:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880095241c00 x1830949054481152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129824.025056:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7071 00002000:00100000:3.0:1746129824.025057:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241c00 with x1830949054481152 ext(3145728->4194303) 00002000:00010000:3.0:1746129824.025060:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095241c00 00000100:00100000:2.0:1746129824.025072:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054480640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129824.025083:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7072 00000100:00100000:3.0:1746129824.025088:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054480896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129824.026050:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7073 00000100:00100000:2.0:1746129824.026056:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1962:x1830949054481152:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129824.026305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.026422:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054481280 00000100:00100000:0.0:1746129824.026427:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054481280 00002000:00100000:0.0:1746129824.026446:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008f908e00 x1830949054481280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129824.026454:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f908e00 with x1830949054481280 ext(3145728->4194303) 00002000:00010000:0.0:1746129824.026458:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f908e00 00000100:00100000:0.0:1746129824.026469:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7074 00000100:00100000:0.0:1746129824.026475:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054481280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129824.035338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.035373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.036825:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054481536 00000100:00100000:3.0:1746129824.036833:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054481536 00000100:00100000:3.0:1746129824.036900:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054481664 00000100:00100000:3.0:1746129824.036903:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054481664 00000100:00100000:3.0:1746129824.036932:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15738 00000100:00100000:2.0:1746129824.036933:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054480640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11867us (12714us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129824.036937:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054481536:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129824.036942:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7071 00010000:00010000:3.0:1746129824.036949:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:2.0:1746129824.036950:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880095241180 x1830949054480640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/440 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.036959:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241180 with x1830949054480640 ext(2097152->3145727) 00010000:00010000:3.0:1746129824.036964:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305a6000/0x48868a4e43955c4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565be expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129824.036964:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241180 00000100:00100000:3.0:1746129824.037002:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054072704:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129824.037052:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129824.037084:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15739 00000100:00100000:3.0:1746129824.037090:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054481664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129824.037096:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.037105:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305a7600/0x48868a4e43955c53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565c5 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.037125:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054072832:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129824.037143:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8f00 going to sleep for 11 seconds 00000100:00080000:0.0:1746129824.037489:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129824.044408:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054481280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17925us (18096us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129824.044420:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7074 00002000:00100000:2.0:1746129824.044430:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008f908e00 x1830949054481280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/440 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.044438:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f908e00 with x1830949054481280 ext(3145728->4194303) 00002000:00010000:2.0:1746129824.044443:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f908e00 00000100:00100000:2.0:1746129824.045038:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054072704:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129824.045735:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305a6000/0x48868a4e43955c4c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565be expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.045748:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305a6000/0x48868a4e43955c4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565be expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129824.046417:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054072832:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129824.046419:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6000, rc 0) 00010000:00010000:3.0:1746129824.046436:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801305a7600/0x48868a4e43955c53 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565c5 expref: 40 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.046446:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305a7600/0x48868a4e43955c53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565c5 expref: 40 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.046459:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a7600, rc 0) 00000100:00100000:2.0:1746129824.046463:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054481536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9525us (11134us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129824.046470:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15738 00000100:00100000:3.0:1746129824.046479:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054481664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9389us (11105us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129824.046485:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15739 00000100:00100000:3.0:1746129824.046748:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1962:x1830949054480896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21659us (22483us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129824.046755:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7072 00002000:00100000:3.0:1746129824.046763:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880095242a00 x1830949054480896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/440 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.046772:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949054480896 ext(2097152->3145727) 00002000:00010000:3.0:1746129824.046776:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095242a00 00000100:00100000:2.0:1746129824.048278:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054481152:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22218us (23968us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129824.048285:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7073 00002000:00100000:2.0:1746129824.048291:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880095241c00 x1830949054481152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/440 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.048299:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241c00 with x1830949054481152 ext(3145728->4194303) 00002000:00010000:2.0:1746129824.048303:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095241c00 00000100:00100000:0.0:1746129824.049213:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.049253:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.049307:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054481792 00000100:00100000:2.0:1746129824.049313:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054481792 00000100:00100000:2.0:1746129824.049345:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054481920 00000100:00100000:2.0:1746129824.049347:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054481920 00000100:00100000:2.0:1746129824.049360:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15740 00000100:00100000:2.0:1746129824.049367:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054481792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129824.049379:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129824.049393:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801305a6400/0x48868a4e43955c5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565cc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.049431:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054072960:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129824.049484:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129824.049531:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15741 00000100:00100000:1.0:1746129824.049537:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054481920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129824.049609:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.049618:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800919edc00/0x48868a4e43955c61 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565d3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129824.049638:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054073088:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129824.049667:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129824.050223:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.050407:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054482176 00000100:00100000:1.0:1746129824.050410:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054482176 00000100:00100000:1.0:1746129824.050669:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11091 00000100:00100000:1.0:1746129824.050676:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31719:x1830949054482176:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129824.050688:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.050700:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43955c68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565da expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.050781:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050792:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050802:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050811:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050815:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050819:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050927:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050937:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.050942:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129824.050949:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129824.051013:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051019:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051023:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051028:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb21a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129824.051031:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051037:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051046:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129824.051049:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129824.051052:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051057:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21a00/0x48868a4e43955c6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051090:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051098:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051101:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051105:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb20e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129824.051107:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051110:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051116:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2300) 00010000:00010000:1.0:1746129824.051118:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129824.051119:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051123:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.051157:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094da2400/0x48868a4e43955c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 286 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.051166:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 285 pid: 15044 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129824.051167:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746129824.051171:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.051173:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129824.051175:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20000, rc 0) 00000100:00100000:1.0:1746129824.051741:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31719:x1830949054482176:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1064us (1516us total) trans 8589945114 rc 0/0 00000100:00100000:1.0:1746129824.051748:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11091 00000100:00100000:1.0:1746129824.054044:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054073088:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129824.054079:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800919edc00/0x48868a4e43955c61 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565d3 expref: 40 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.054091:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800919edc00/0x48868a4e43955c61 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565d3 expref: 40 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.054099:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919edc00, rc 0) 00000100:00100000:1.0:1746129824.054131:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054481920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4593us (4876us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129824.054138:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15741 00000100:00100000:2.0:1746129824.054242:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054072960:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129824.054256:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801305a6400/0x48868a4e43955c5a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565cc expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.054264:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801305a6400/0x48868a4e43955c5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565cc expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.054284:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6400, rc 0) 00000100:00100000:2.0:1746129824.054300:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054481792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4934us (5088us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129824.054305:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15740 00000100:00100000:0.0:1746129824.061374:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.062412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.062492:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054482432 00000100:00100000:2.0:1746129824.062503:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054482432 00002000:00100000:2.0:1746129824.062546:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880095241880 x1830949054482432/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.062556:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241880 with x1830949054482432 ext(4194304->4931583) 00002000:00010000:2.0:1746129824.062561:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241880 00000100:00100000:2.0:1746129824.062605:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7075 00000100:00100000:2.0:1746129824.062614:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054482432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129824.063660:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054482688 00000100:00100000:0.0:1746129824.063665:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054482688 00000100:00100000:0.0:1746129824.063686:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4652 00000100:00100000:0.0:1746129824.063691:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31715:x1830949054482688:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129824.063818:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d63c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31715:x1830949054482688:12345-192.168.204.31@tcp:35:cat.0 Request processed in 126us (1409us total) trans 8589945115 rc 0/0 00000100:00100000:0.0:1746129824.063823:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4652 00000100:00100000:2.0:1746129824.072184:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054482432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9563us (10811us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129824.072195:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7075 00002000:00100000:2.0:1746129824.072204:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880095241880 x1830949054482432/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/440 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.072213:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241880 with x1830949054482432 ext(4194304->4931583) 00002000:00010000:2.0:1746129824.072217:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241880 00000100:00100000:0.0:1746129824.085351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.085902:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054482944 00000100:00100000:2.0:1746129824.085912:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054482944 00000100:00100000:2.0:1746129824.085950:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4653 00000100:00100000:2.0:1746129824.085956:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31714:x1830949054482944:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129824.087645:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31714:x1830949054482944:12345-192.168.204.31@tcp:35:cat.0 Request processed in 1683us (2298us total) trans 8589945116 rc 0/0 00000100:00100000:2.0:1746129824.087654:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4653 00000100:00100000:0.0:1746129824.135834:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.135945:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483072 00000100:00100000:2.0:1746129824.135953:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483072 00000100:00100000:2.0:1746129824.135996:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15742 00000100:00100000:2.0:1746129824.136003:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:31719:x1830949054483072:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129824.136024:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129824.136040:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565e1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.136088:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.136096:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.136103:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.136108:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.136110:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.136113:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.136138:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.136148:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.136159:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054073216:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129824.137569:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.137582:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 29 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.137592:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054073344:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129824.137904:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.137912:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 9 pid: 1877 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746129824.137920:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054073472:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.138139:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4eddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129824.139648:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054073216:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.139658:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054073344:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.139664:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054073472:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129824.139686:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.139701:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0e00, rc 0) 00000100:00100000:2.0:1746129824.139740:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:31719:x1830949054483072:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3736us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.139747:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15742 00000100:00100000:0.0:1746129824.141332:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.141367:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.141401:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.141482:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483200 00000100:00100000:2.0:1746129824.141487:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483200 00010000:00010000:2.0:1746129824.141511:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746129824.141535:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483328 00000100:00100000:2.0:1746129824.141537:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483328 00010000:00010000:2.0:1746129824.141545:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.141557:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483456 00000100:00100000:2.0:1746129824.141559:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483456 00010000:00010000:2.0:1746129824.141566:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.141578:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7869 00000100:00100000:2.0:1746129824.141583:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054483200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.141593:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.141610:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.141619:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.141639:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6ff200/0x48868a4e43955abd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564d7 expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.141654:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.141677:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054483200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.141682:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7869 00000100:00100000:2.0:1746129824.141695:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7870 00000100:00100000:2.0:1746129824.141699:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054483328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.141705:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.141711:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.141719:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.141729:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f881400/0x48868a4e43955be3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356555 expref: 40 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.141737:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.141751:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054483328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 51us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.141755:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7870 00000100:00100000:2.0:1746129824.141786:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7871 00000100:00100000:2.0:1746129824.141790:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949054483456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.141796:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.141802:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.141811:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.141821:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1e00/0x48868a4e43955c06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356578 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.141829:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.141830:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.141836:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.141843:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.141893:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.141904:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054073600:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129824.141949:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129824.143904:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054073600:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129824.143917:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.143949:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054483456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2157us (2547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.143956:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7871 00000100:00100000:0.0:1746129824.144266:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.144490:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483712 00000100:00100000:3.0:1746129824.144496:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483712 00002000:00100000:3.0:1746129824.144525:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1949696->1953791) req@ffff88009476a300 x1830949054483712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.144534:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949054483712 ext(1949696->1953791) 00002000:00010000:3.0:1746129824.144537:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a300 00000100:00100000:3.0:1746129824.144552:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7076 00000100:00100000:3.0:1746129824.144557:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054483712:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129824.144680:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009476a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054483712:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 122us (415us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129824.144687:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7076 00002000:00100000:3.0:1746129824.144691:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1949696->1953791) req@ffff88009476a300 x1830949054483712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.144698:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009476a300 with x1830949054483712 ext(1949696->1953791) 00002000:00010000:3.0:1746129824.144701:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009476a300 00000100:00100000:0.0:1746129824.147563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.148256:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483840 00000100:00100000:2.0:1746129824.148263:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483840 00000100:00100000:2.0:1746129824.148309:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15743 00000100:00100000:2.0:1746129824.148316:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31719:x1830949054483840:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129824.148330:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129824.148344:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565e8 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.148372:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.148379:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.148385:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.148389:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.148390:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.148393:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.148416:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 29 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.148426:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 29 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.148436:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054073728:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129824.148603:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 24 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.148611:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 24 pid: 3624 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.148619:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054073856:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129824.148898:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 9 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.148906:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 9 pid: 1877 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746129824.148914:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054073984:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.148960:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129824.151801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.151836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.151888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.151913:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054483968 00000100:00100000:1.0:1746129824.151919:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054483968 00010000:00010000:1.0:1746129824.151958:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.151965:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054484096 00000100:00100000:3.0:1746129824.151970:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054484096 00000100:00100000:1.0:1746129824.151982:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054484224 00000100:00100000:2.0:1746129824.151983:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054073728:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.151984:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054484224 00010000:00010000:3.0:1746129824.151994:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.151994:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 25 pid: 3624 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.151995:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054073856:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.152002:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054073984:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.152016:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7872 00000100:00100000:3.0:1746129824.152021:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7873 00000100:00100000:1.0:1746129824.152022:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054483968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.152025:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->1560575] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.152026:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054484224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.152036:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129824.152036:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.152037:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca6e00, rc 0) 00010000:00010000:3.0:1746129824.152053:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 25 pid: 3624 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746129824.152053:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.152057:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7874 00010000:00010000:1.0:1746129824.152074:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.152075:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054484096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.152088:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 25 pid: 3624 timeout: 870 lvb_type: 0 00000100:00080000:0.0:1746129824.152105:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746129824.152108:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1a00/0x48868a4e43955c29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35659b expref: 25 pid: 3624 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.152122:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129824.152150:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054484224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 123us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.152158:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7873 00010000:00010000:2.0:1746129824.152230:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.152241:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.152257:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.152271:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0800/0x48868a4e43955bff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356571 expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.152278:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6ff600/0x48868a4e43955acb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564de expref: 10 pid: 1877 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.152289:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.152291:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.152296:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.152303:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.152332:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129824.152355:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054483968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 332us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.152361:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7872 00010000:00010000:2.0:1746129824.152369:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.152379:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054074112:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129824.152505:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129824.152522:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31719:x1830949054483840:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4207us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.152528:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15743 00000100:00100000:3.0:1746129824.155073:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054074112:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129824.155089:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129824.155117:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054484096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3054us (3279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.155133:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7874 00000100:00100000:0.0:1746129824.159314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.159401:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054484480 00000100:00100000:2.0:1746129824.159408:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054484480 00002000:00100000:2.0:1746129824.159440:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1556480->1560575) req@ffff88009fbed880 x1830949054484480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.159455:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed880 with x1830949054484480 ext(1556480->1560575) 00002000:00010000:2.0:1746129824.159459:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbed880 00000100:00100000:3.0:1746129824.161012:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7077 00000100:00100000:3.0:1746129824.161025:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054484480:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129824.161180:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054484480:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 159us (1874us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129824.161185:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7077 00002000:00100000:3.0:1746129824.161191:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1556480->1560575) req@ffff88009fbed880 x1830949054484480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/4536 e 0 to 0 dl 1746129835 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.161198:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbed880 with x1830949054484480 ext(1556480->1560575) 00002000:00010000:3.0:1746129824.161202:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbed880 00000100:00100000:0.0:1746129824.163730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.163779:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054484736 00000100:00100000:2.0:1746129824.163786:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054484736 00000100:00100000:2.0:1746129824.163831:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4654 00000100:00100000:2.0:1746129824.163838:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31719:x1830949054484736:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129824.164133:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31719:x1830949054484736:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 294us (407us total) trans 8589945117 rc 0/0 00000100:00100000:2.0:1746129824.164141:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4654 00000100:00100000:0.0:1746129824.171327:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.171598:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054484864 00000100:00100000:1.0:1746129824.171607:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054484864 00000100:00100000:1.0:1746129824.171665:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11092 00000100:00100000:1.0:1746129824.171672:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31725:x1830949054484864:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129824.171689:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.171703:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565ef expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.171752:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171762:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171774:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171784:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171788:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171793:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171902:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.171909:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00000100:00080000:0.0:1746129824.171912:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746129824.171915:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129824.174894:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:1.0:1746129824.174902:0:15044:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746129824.174923:0:15044:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174935:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174943:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174949:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174958:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174962:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801305a6400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129824.174966:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174971:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174984:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129824.174987:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129824.174990:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.174995:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175030:0:15044:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175035:0:15044:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175039:0:15044:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175043:0:15044:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801305a6600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129824.175045:0:15044:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175050:0:15044:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175059:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2e00) 00010000:00010000:1.0:1746129824.175070:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129824.175072:0:15044:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175076:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955ca7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.175108:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955c99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.175118:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 7 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.175123:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.175125:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129824.175127:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6000, rc 0) 00000100:00100000:1.0:1746129824.175182:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31725:x1830949054484864:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 3510us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.175190:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11092 00000100:00100000:0.0:1746129824.178476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.178511:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.179292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.179440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.179456:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054484992 00000100:00100000:2.0:1746129824.179462:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054484992 00000100:00100000:2.0:1746129824.179499:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054485248 00000100:00100000:2.0:1746129824.179501:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054485248 00000100:00100000:2.0:1746129824.179517:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054485120 00000100:00100000:2.0:1746129824.179519:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054485120 00000100:00100000:2.0:1746129824.179534:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15744 00000100:00100000:2.0:1746129824.179540:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054484992:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129824.179554:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129824.179568:0:7975:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135b66000/0x48868a4e43955cb5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565f6 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.179613:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054074240:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129824.179674:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129824.179687:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15745 00000100:00100000:2.0:1746129824.179692:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054485248:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129824.179699:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129824.179707:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae0800/0x48868a4e43955cbc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356604 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.179726:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054074368:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129824.179741:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129824.179873:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15746 00000100:00100000:3.0:1746129824.179880:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054485120:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129824.179886:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.179892:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43955cc3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3565fd expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.179912:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054074496:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129824.179947:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129824.180185:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054485376 00000100:00100000:0.0:1746129824.180188:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054485376 00000100:00100000:0.0:1746129824.180204:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15747 00000100:00100000:0.0:1746129824.180209:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054485376:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129824.180214:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129824.180219:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955cca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35660b expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129824.180240:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054074624:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129824.180276:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129824.181911:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054074240:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129824.181933:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054074368:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129824.181941:0:7975:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135b66000/0x48868a4e43955cb5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565f6 expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.181947:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0800/0x48868a4e43955cbc lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356604 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.181956:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0800/0x48868a4e43955cbc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356604 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.181967:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0800, rc 0) 00000100:00100000:3.0:1746129824.182002:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054485248:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2310us (3490us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129824.182009:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15745 00010000:00010000:2.0:1746129824.182037:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135b66000/0x48868a4e43955cb5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565f6 expref: 12 pid: 7975 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129824.182049:0:7975:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b66000, rc 0) 00000100:00100000:2.0:1746129824.182078:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054484992:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2538us (3609us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129824.182084:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15744 00000100:00100000:3.0:1746129824.182782:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054074496:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129824.182797:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43955cc3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565fd expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.182805:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013094ba00/0x48868a4e43955cc3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565fd expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.182811:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013094ba00, rc 0) 00000100:00100000:3.0:1746129824.182831:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054485120:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2952us (3539us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129824.182836:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15746 00000100:00100000:1.0:1746129824.182926:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054074624:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129824.182940:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955cca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35660b expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.182948:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955cca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35660b expref: 10 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.182967:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa87a00, rc 0) 00000100:00100000:1.0:1746129824.182983:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054485376:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2774us (3543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129824.182988:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15747 00000100:00100000:0.0:1746129824.185399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.185463:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054485632 00000100:00100000:1.0:1746129824.185469:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054485632 00000100:00100000:1.0:1746129824.185547:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11093 00000100:00100000:1.0:1746129824.185555:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31725:x1830949054485632:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129824.185574:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.185588:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356612 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.185669:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.185809:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 286 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.185816:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.185821:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.185874:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.185885:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 8 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.185895:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054074752:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.185981:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 286 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.185988:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 286 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.185995:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054074880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.186012:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129824.187031:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054074752:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.187040:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054074880:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.187054:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:0.0:1746129824.187590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.187970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.188043:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054485760 00000100:00100000:3.0:1746129824.188049:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054485760 00010000:00010000:3.0:1746129824.188083:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 9 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.188108:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054485888 00000100:00100000:3.0:1746129824.188110:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054485888 00010000:00010000:3.0:1746129824.188118:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 287 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.188142:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7875 00000100:00100000:3.0:1746129824.188148:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054485760:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.188158:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129824.188162:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 9 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.188171:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 9 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.188186:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6000/0x48868a4e43955cae lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565ef expref: 9 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.188197:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129824.188201:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129824.188207:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129824.188211:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129824.188242:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054485760:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.188248:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7875 00000100:00100000:3.0:1746129824.188265:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7876 00000100:00100000:3.0:1746129824.188269:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:1963:x1830949054485888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.188275:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129824.188279:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 287 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.188286:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 287 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.188296:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955c7d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565da expref: 287 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.188303:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129824.188306:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129824.188311:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129824.188317:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15044 initiator: MDT0 00010000:00010000:3.0:1746129824.188331:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129824.188343:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1963:x1830949054485888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.188347:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7876 00010000:00010000:1.0:1746129824.188434:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.188441:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129824.188457:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129824.188578:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6600/0x48868a4e43955cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356612 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.188588:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356612 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.188598:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.188600:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129824.188602:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801305a6400, rc 0) 00000100:00100000:1.0:1746129824.188623:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054485632:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 3070us (3232us total) trans 8589945118 rc 0/0 00000100:00100000:1.0:1746129824.188628:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11093 00000100:00100000:2.0:1746129824.191222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.191297:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486144 00000100:00100000:1.0:1746129824.191303:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486144 00000100:00100000:1.0:1746129824.191940:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11094 00000100:00100000:1.0:1746129824.191948:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054486144:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129824.191965:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.191968:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746129824.191990:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801305a6400/0x48868a4e43955cd8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356612 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.192005:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.192008:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129824.192017:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20c00/0x48868a4e43955ce6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356619 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.192096:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955ced lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.192105:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955ced lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.192113:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955ced lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000004:00200000:1.0:1746129824.192125:0:15044:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129824.192254:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20c00/0x48868a4e43955ce6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356619 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.192265:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955ced lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356619 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.192270:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.192272:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746129824.192274:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb20e00, rc 0) 00000100:00100000:1.0:1746129824.192691:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054486144:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 743us (1474us total) trans 8589945119 rc 0/0 00000100:00100000:1.0:1746129824.192697:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11094 00000100:00100000:0.0:1746129824.195145:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.195462:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486272 00000100:00100000:1.0:1746129824.195470:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486272 00000100:00100000:1.0:1746129824.195515:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11095 00000100:00100000:1.0:1746129824.195522:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054486272:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129824.195539:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.195552:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21000/0x48868a4e43955cfb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356620 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.195594:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21000/0x48868a4e43955cfb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356620 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.195604:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21000/0x48868a4e43955cfb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356620 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.195623:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.195625:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129824.195628:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bb21000, rc 0) 00000100:00100000:1.0:1746129824.195669:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31725:x1830949054486272:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 148us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.195674:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11095 00000100:00100000:0.0:1746129824.198033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.198077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.198156:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486400 00000100:00100000:1.0:1746129824.198162:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486400 00000100:00100000:0.0:1746129824.198381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.198719:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486528 00000100:00100000:1.0:1746129824.198723:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486528 00000100:00100000:0.0:1746129824.198730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.198806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.198818:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486656 00000100:00100000:2.0:1746129824.198828:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486784 00000100:00100000:2.0:1746129824.198830:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486784 00000100:00100000:3.0:1746129824.198889:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486656 00000100:00100000:1.0:1746129824.199005:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054486912 00000100:00100000:1.0:1746129824.199008:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054486912 00000100:00100000:0.0:1746129824.199017:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15748 00000100:00100000:0.0:1746129824.199023:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054486400:12345-192.168.204.31@tcp:1:mirror_io.0 00000100:00100000:1.0:1746129824.199030:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15749 00000100:00100000:1.0:1746129824.199034:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054486528:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129824.199055:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.199055:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.199079:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.199079:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.199086:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129824.199088:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129824.199090:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.199090:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129824.199092:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129824.199094:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.199111:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 28 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.199111:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.199121:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 23 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746129824.199122:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 28 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.199132:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054075136:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129824.199132:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054075008:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.199184:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15750 00000100:00100000:2.0:1746129824.199190:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054486784:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:2.0:1746129824.199203:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.199213:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.199218:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129824.199219:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129824.199221:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.199234:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.199240:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 27 pid: 8436 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.199248:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054075264:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129824.199282:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15751 00000100:00100000:3.0:1746129824.199287:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054486656:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129824.199301:0:3624:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.199310:0:3624:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.199314:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129824.199315:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129824.199317:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.199330:0:3624:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 38 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.199337:0:3624:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 38 pid: 8436 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.199343:0:3624:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054075392:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.199473:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129824.199490:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15752 00000100:00100000:1.0:1746129824.199495:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054486912:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:1.0:1746129824.199510:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.199519:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.199526:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 23 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.199532:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.199536:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.199537:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.199539:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.199552:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 27 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.199559:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 27 pid: 3624 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746129824.199566:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054075520:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129824.199736:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1746129824.199743:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129824.199770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.199777:0:3624:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129824.199789:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487040 00000100:00100000:3.0:1746129824.199791:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487040 00000100:00100000:3.0:1746129824.199807:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15753 00000100:00100000:3.0:1746129824.199811:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054487040:12345-192.168.204.31@tcp:1:mirror_io.0 00010000:00010000:3.0:1746129824.199824:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.199833:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.199839:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 28 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.199858:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 38 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.199864:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.199865:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.199867:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.199880:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 38 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.199888:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 38 pid: 4589 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746129824.199895:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054075648:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129824.199923:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 28 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.199930:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 28 pid: 1140 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746129824.199937:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054075776:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129824.199957:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.199964:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 11 pid: 10930 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746129824.199971:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054075904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129824.199983:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8300 going to sleep for 11 seconds 00010000:00010000:1.0:1746129824.200204:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 23 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.200212:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 23 pid: 1140 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746129824.200219:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054076032:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.200240:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.200247:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 11 pid: 10930 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746129824.200254:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054076160:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.200268:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129824.203517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.203551:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054075648:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.203963:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054075776:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129824.203972:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054075904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129824.203992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129824.203994:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.204018:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:7975:1830949054075264:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129824.204033:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.204052:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487168 00000100:00100000:2.0:1746129824.204057:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487168 00002000:00100000:2.0:1746129824.204101:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1949696->2097151) req@ffff8800a01b9f80 x1830949054487168/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.204109:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9f80 with x1830949054487168 ext(1949696->2097151) 00010000:00010000:2.0:1746129824.204115:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 39 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.204123:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 39 pid: 8436 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746129824.204128:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01b9f80 00000100:00100000:2.0:1746129824.204147:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487296 00000100:00100000:2.0:1746129824.204149:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487296 00002000:00100000:2.0:1746129824.204161:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (999424->1048575) req@ffff8800a01b8380 x1830949054487296/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129824.204166:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8380 with x1830949054487296 ext(999424->1048575) 00010000:00010000:2.0:1746129824.204170:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 24 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.204175:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 24 pid: 1140 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746129824.204180:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b8380 00000100:00100000:2.0:1746129824.204191:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1914 00000100:00100000:2.0:1746129824.204196:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054487168:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129824.204363:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1915 00000100:00100000:2.0:1746129824.204369:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054487296:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129824.204617:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054075008:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.204630:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129824.204652:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054075520:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.204659:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054076032:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.204665:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054076160:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.204680:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129824.204696:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054075136:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.204704:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.204747:0:3624:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:3624:1830949054075392:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129824.204757:0:3624:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.210707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.213407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.213435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.213447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.213467:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487680 00000100:00100000:2.0:1746129824.213474:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487680 00010000:00010000:2.0:1746129824.213502:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 41 pid: 4589 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746129824.213613:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487424 00000100:00100000:3.0:1746129824.213617:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487424 00002000:00100000:3.0:1746129824.213643:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1560575) req@ffff8800936de680 x1830949054487424/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.213652:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de680 with x1830949054487424 ext(1048576->1560575) 00010000:00010000:3.0:1746129824.213659:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 28 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.213669:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 28 pid: 8436 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746129824.213674:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936de680 00000100:00100000:3.0:1746129824.213690:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1916 00000100:00100000:3.0:1746129824.213697:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054487424:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129824.214291:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487936 00000100:00100000:2.0:1746129824.214295:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487936 00010000:00010000:2.0:1746129824.214307:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 29 pid: 1140 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746129824.214379:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487552 00000100:00100000:1.0:1746129824.214382:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487552 00010000:00010000:1.0:1746129824.214396:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746129824.214411:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7877 00000100:00100000:1.0:1746129824.214416:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949054487680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129824.214424:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129824.214439:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 41 pid: 4589 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214447:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 41 pid: 4589 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214469:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0000/0x48868a4e43955c22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356594 expref: 41 pid: 4589 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214490:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129824.214513:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054487680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.214518:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7877 00000100:00100000:1.0:1746129824.214551:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7878 00000100:00100000:1.0:1746129824.214556:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054487936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129824.214561:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129824.214567:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 29 pid: 1140 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214573:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 29 pid: 1140 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214583:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1000/0x48868a4e43955c45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b7 expref: 29 pid: 1140 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214590:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129824.214601:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054487936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.214605:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7878 00000100:00100000:1.0:1746129824.214613:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7879 00000100:00100000:1.0:1746129824.214617:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054487552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129824.214622:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129824.214628:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214634:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214643:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c552800/0x48868a4e43955ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564ec expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746129824.214649:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.214651:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.214654:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.214661:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.214679:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129824.214691:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054487552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.214696:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7879 00010000:00010000:2.0:1746129824.214866:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214874:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214888:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214894:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214900:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214906:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135b67200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129824.214909:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214915:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214924:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.214928:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67200/0x48868a4e43955d25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.214977:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054487040:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 15165us (15206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.214982:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15753 00000100:00100000:2.0:1746129824.215016:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.215030:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488064 00000100:00100000:2.0:1746129824.215032:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488064 00010000:00010000:2.0:1746129824.215041:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746129824.215052:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7880 00000100:00100000:2.0:1746129824.215056:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1964:x1830949054488064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.215075:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.215084:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215091:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215101:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c552e00/0x48868a4e43955ac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3564e5 expref: 12 pid: 10930 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215108:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.215120:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054488064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 63us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.215124:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7880 00000100:00100000:2.0:1746129824.215164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.215184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.215192:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488192 00000100:00100000:2.0:1746129824.215194:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488192 00010000:00010000:2.0:1746129824.215201:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 26 pid: 1140 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746129824.215212:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7881 00000100:00100000:2.0:1746129824.215216:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054488192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.215221:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.215226:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 26 pid: 1140 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215233:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 26 pid: 1140 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215243:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1600/0x48868a4e43955c3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565b0 expref: 26 pid: 1140 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215250:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.215261:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054488192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (76us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.215265:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7881 00000100:00100000:2.0:1746129824.215339:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.215350:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488320 00000100:00100000:2.0:1746129824.215353:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488320 00010000:00010000:2.0:1746129824.215361:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 30 pid: 3624 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746129824.215372:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7882 00000100:00100000:2.0:1746129824.215376:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054488320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.215381:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.215386:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 30 pid: 3624 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215393:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 30 pid: 3624 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215402:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e43955c14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35658d expref: 30 pid: 3624 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746129824.215413:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.215414:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.215416:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215421:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215433:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.215444:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054488320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.215448:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7882 00010000:00010000:2.0:1746129824.215460:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215466:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215476:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215482:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215486:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215495:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800919ece00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129824.215497:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215502:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215508:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.215513:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800919ece00/0x48868a4e43955d1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.215537:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054486912:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 16042us (16731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.215541:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15752 00000100:00100000:3.0:1746129824.215794:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054487808 00000100:00100000:3.0:1746129824.215798:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054487808 00000100:00100000:0.0:1746129824.215805:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054487168:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 11608us (12296us total) trans 17179874173 rc 0/0 00000100:00100000:0.0:1746129824.215811:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1914 00002000:00100000:3.0:1746129824.215814:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1282047) req@ffff8800936dd880 x1830949054487808/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/0 e 0 to 0 dl 1746129835 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129824.215815:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1949696->2097151) req@ffff8800a01b9f80 x1830949054487168/t17179874173(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/448 e 0 to 0 dl 1746129835 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.215822:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830949054487808 ext(1048576->1282047) 00002000:00100000:0.0:1746129824.215822:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9f80 with x1830949054487168 ext(1949696->2097151) 00010000:00010000:3.0:1746129824.215827:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 28 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746129824.215827:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.215835:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 28 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746129824.215839:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746129824.215841:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dd880 00002000:00010000:0.0:1746129824.215844:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01b9f80 00000100:00100000:3.0:1746129824.215866:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1917 00000100:00100000:3.0:1746129824.215871:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054487808:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129824.216739:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054487296:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12367us (12743us total) trans 21474841367 rc 0/0 00000100:00100000:0.0:1746129824.216746:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1915 00002000:00100000:0.0:1746129824.216751:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (999424->1048575) req@ffff8800a01b8380 x1830949054487296/t21474841367(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/448 e 0 to 0 dl 1746129835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129824.216758:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8380 with x1830949054487296 ext(999424->1048575) 00010000:00010000:0.0:1746129824.216763:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 25 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746129824.216771:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 25 pid: 1140 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746129824.216776:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b8380 00010000:00010000:1.0:1746129824.217041:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746129824.219631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.220091:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488448 00000100:00100000:3.0:1746129824.220099:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488448 00010000:00010000:3.0:1746129824.220126:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 25 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.220150:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7883 00000100:00100000:3.0:1746129824.220157:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054488448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.220169:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129824.220186:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 25 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.220200:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 25 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.220220:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1400/0x48868a4e43955bdc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 999424->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35654e expref: 25 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.220248:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.220250:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.220254:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.220261:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.220283:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129824.220313:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054488448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 157us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.220319:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7883 00010000:00010000:1.0:1746129824.220972:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.220980:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.220999:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.221006:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.221012:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.221018:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa87a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129824.221021:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.221027:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.221038:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129824.221214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.221278:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488576 00000100:00100000:3.0:1746129824.221282:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488576 00010000:00010000:1.0:1746129824.221516:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa87a00/0x48868a4e43955d02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129824.221555:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054486400:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 22532us (23528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.221562:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15748 00010000:00010000:3.0:1746129824.222277:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.222298:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7884 00000100:00100000:3.0:1746129824.222304:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1964:x1830949054488576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.222313:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129824.222328:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.222336:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.222348:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae0e00/0x48868a4e43955c8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e1 expref: 40 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.222356:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.222358:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.222361:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.222368:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.222394:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129824.222411:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130564050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1964:x1830949054488576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 108us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.222417:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7884 00010000:00010000:0.0:1746129824.222538:0:3624:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222547:0:3624:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222560:0:3624:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222572:0:3624:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222578:0:3624:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222583:0:3624:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013094ac00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129824.222586:0:3624:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222592:0:3624:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222601:0:3624:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.222606:0:3624:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013094ac00/0x48868a4e43955d17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129824.222746:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054486656:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 23457us (24364us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129824.222753:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15751 00000100:00100000:1.0:1746129824.223596:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949054487808:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7722us (8429us total) trans 17179874174 rc 0/0 00000100:00100000:1.0:1746129824.223604:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1917 00002000:00100000:1.0:1746129824.223613:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1282047) req@ffff8800936dd880 x1830949054487808/t17179874174(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:565/0 lens 488/448 e 0 to 0 dl 1746129835 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129824.223620:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936dd880 with x1830949054487808 ext(1048576->1282047) 00010000:00010000:1.0:1746129824.223628:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746129824.223636:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746129824.223641:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936dd880 00000100:00100000:3.0:1746129824.225523:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054487424:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 11819us (14817us total) trans 21474841368 rc 0/0 00000100:00100000:3.0:1746129824.225538:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1916 00002000:00100000:3.0:1746129824.225544:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1560575) req@ffff8800936de680 x1830949054487424/t21474841368(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:565/0 lens 488/448 e 0 to 0 dl 1746129835 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129824.225553:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936de680 with x1830949054487424 ext(1048576->1560575) 00010000:00010000:3.0:1746129824.225561:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.225571:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746129824.225650:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936de680 00000100:00100000:0.0:1746129824.225712:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.225786:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488704 00000100:00100000:3.0:1746129824.225791:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488704 00010000:00010000:3.0:1746129824.225807:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746129824.225831:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7885 00000100:00100000:3.0:1746129824.225836:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054488704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129824.225845:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129824.225871:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.225879:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.225896:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1c00/0x48868a4e43955bf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1282047) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35656a expref: 30 pid: 1140 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746129824.225909:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.225911:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.225915:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.225926:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.225946:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129824.225949:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.225958:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.225973:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.225979:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.225985:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054488704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 148us (273us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129824.225986:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.225990:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7885 00010000:00010000:1.0:1746129824.225995:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801305a6600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129824.225997:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.226004:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.226013:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.226019:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801305a6600/0x48868a4e43955d09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129824.226072:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054486528:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 27022us (27980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.226080:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15749 00000100:00100000:0.0:1746129824.227369:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.227434:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054488832 00000100:00100000:2.0:1746129824.227438:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054488832 00010000:00010000:2.0:1746129824.227454:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.227481:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7886 00000100:00100000:2.0:1746129824.227487:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054488832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.227496:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.227507:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.227516:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.227529:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca6e00/0x48868a4e43955c92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1560575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3565e8 expref: 29 pid: 8436 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.227679:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.227681:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129824.227685:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.227692:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129824.227714:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.227738:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054488832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 250us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129824.227743:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7886 00010000:00010000:3.0:1746129824.227835:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227842:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227875:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227881:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227887:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227893:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cae1800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129824.227895:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227905:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227914:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.227919:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae1800/0x48868a4e43955d10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129824.228263:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054486784:12345-192.168.204.31@tcp:1:mirror_io.0 Request processed in 28765us (29224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.228269:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15750 00000100:00100000:0.0:1746129824.229618:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.229652:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489088 00000100:00100000:1.0:1746129824.229658:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489088 00000100:00100000:1.0:1746129824.229692:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11096 00000100:00100000:1.0:1746129824.229696:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31725:x1830949054489088:12345-192.168.204.31@tcp:36:mirror_io.0 00010000:00010000:1.0:1746129824.229726:0:15044:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129824.229740:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb21000/0x48868a4e43955cfb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356620 expref: 10 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229749:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.229751:0:15044:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129824.229768:0:15044:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.229775:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229778:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229782:0:15044:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229785:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 6/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.229802:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229808:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 285 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.229815:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054076288:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.229888:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229896:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 9 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.229929:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054076416:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.229953:0:15044:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.229959:0:15044:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 9 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.229966:0:15044:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054076544:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129824.229980:0:15044:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129824.231234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.231257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.231276:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489344 00000100:00100000:2.0:1746129824.231280:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489344 00010000:00010000:2.0:1746129824.231297:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 286 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746129824.231309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129824.231313:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489472 00000100:00100000:2.0:1746129824.231315:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489472 00010000:00010000:2.0:1746129824.231322:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 10 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.231333:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489216 00000100:00100000:2.0:1746129824.231334:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489216 00010000:00010000:2.0:1746129824.231340:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 11 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.231352:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7887 00000100:00100000:2.0:1746129824.231357:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949054489344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.231365:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.231368:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 286 pid: 14313 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.231375:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 286 pid: 14313 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.231387:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129824.231391:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129824.231396:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129824.231410:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7888 00000100:00100000:2.0:1746129824.231416:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:1962:x1830949054489344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.231416:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054489472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129824.231421:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7887 00010000:00010000:1.0:1746129824.231422:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129824.231426:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 11 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.231432:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7889 00010000:00010000:1.0:1746129824.231432:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 11 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.231435:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054489216:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129824.231439:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129824.231442:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 11 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746129824.231442:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.231444:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.231449:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129824.231450:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 11 pid: 15044 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746129824.231458:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129824.231460:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00000100:00100000:1.0:1746129824.231460:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054489472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.231464:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7888 00010000:00010000:2.0:1746129824.231466:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129824.231470:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15044 initiator: MDT0 00010000:00010000:2.0:1746129824.231479:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129824.231489:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054489216:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (180us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129824.231489:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fc00/0x48868a4e43955bc7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356539 expref: 285 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746129824.231494:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7889 00000100:00100000:1.0:1746129824.231506:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054076288:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.231515:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d6c3400/0x48868a4e43955bb9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35652b expref: 9 pid: 14313 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.231522:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054076416:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.231529:0:15044:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb53c00/0x48868a4e43955bb2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356524 expref: 8 pid: 15044 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746129824.231535:0:15044:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15044:1830949054076544:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129824.231549:0:15044:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.231723:0:15044:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.231730:0:15044:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000040:00080000:1.0:1746129824.232575:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3551, 88 off299224 00000004:00080000:1.0:1746129824.232581:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770290733182ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.232632:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3553, 88 off299312 00000004:00080000:1.0:1746129824.232637:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770290788760ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233220:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3554, 88 off299400 00000004:00080000:1.0:1746129824.233226:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291378165ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233234:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3552, 88 off299312 00000004:00080000:1.0:1746129824.233237:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291388895ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233258:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3553, 88 off299400 00000004:00080000:1.0:1746129824.233262:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291413782ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233269:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3555, 88 off299488 00000004:00080000:1.0:1746129824.233271:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291423526ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233277:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3556, 88 off299576 00000004:00080000:1.0:1746129824.233280:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291431970ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233290:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3557, 88 off299664 00000004:00080000:1.0:1746129824.233293:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291444660ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233300:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3554, 88 off299488 00000004:00080000:1.0:1746129824.233302:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291454130ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233310:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3558, 88 off299752 00000004:00080000:1.0:1746129824.233312:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291464321ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233318:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3555, 88 off299576 00000004:00080000:1.0:1746129824.233320:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291472246ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233327:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3559, 88 off299840 00000004:00080000:1.0:1746129824.233329:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291481596ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129824.233335:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3556, 88 off299664 00000004:00080000:1.0:1746129824.233337:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291489641ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233344:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3557, 88 off299752 00000004:00080000:1.0:1746129824.233346:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291498189ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233352:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3558, 88 off299840 00000004:00080000:1.0:1746129824.233354:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291506389ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233360:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3559, 88 off299928 00000004:00080000:1.0:1746129824.233362:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770291514422ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129824.233368:0:15044:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3560, 88 off299928 00000004:00080000:1.0:1746129824.233371:0:15044:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770291522669ns, next at 716792379979ns, rc = 0 00000001:00080000:0.0:1746129824.255905:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945115 is committed 00000001:00080000:0.0:1746129824.255914:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945120 is committed 00000004:00080000:0.0:1746129824.255917:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2727 committed 00000004:00080000:0.0:1746129824.255921:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2731 committed 00000004:00080000:0.0:1746129824.255925:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2730 committed 00000004:00080000:0.0:1746129824.255926:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2729 committed 00000004:00080000:0.0:1746129824.255927:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2728 committed 00000004:00080000:0.0:1746129824.255929:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2726 committed 00000004:00080000:0.0:1746129824.255930:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2727 committed 00000004:00080000:0.0:1746129824.255931:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2725 committed 00000004:00080000:0.0:1746129824.255933:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2726 committed 00000004:00080000:0.0:1746129824.255934:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746129824.255935:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2723 committed 00000004:00080000:0.0:1746129824.255936:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746129824.255937:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2725 committed 00000004:00080000:0.0:1746129824.255938:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746129824.255940:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746129824.255941:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746129824.255942:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2723 committed 00000001:00080000:0.0:1746129824.255951:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945113 is committed 00000001:00080000:0.0:1746129824.255956:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945117 is committed 00000001:00080000:0.0:1746129824.255958:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945116 is committed 00000004:00010000:1.0:1746129824.256136:0:15044:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a01b9180 reply state ffff8800942ffc00 transno 8589945120 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15044 initiator: MDT0 00000100:00100000:1.0:1746129824.256150:0:15044:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746129824.256220:0:15044:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746129824.256231:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054489088:12345-192.168.204.31@tcp:36:mirror_io.0 Request processed in 26531us (26613us total) trans 8589945120 rc 0/0 00000100:00100000:1.0:1746129824.256238:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11096 00010000:00010000:1.0:1746129824.256263:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.256269:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.256274:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.256278:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bb20000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129824.256281:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.256286:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.256296:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129824.256298:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129824.256301:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00010000:00010000:1.0:1746129824.256305:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20000/0x48868a4e43955d2c lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15044 initiator: MDT0 00000100:00100000:2.0:1746129824.256647:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054076800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.256684:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256702:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077312:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.256715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256724:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.256732:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256739:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.256749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256759:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746129824.256762:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054076672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.256772:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256779:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.256787:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256793:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.256802:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256808:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.256817:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.256831:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054076800 00000100:00100000:2.0:1746129824.256835:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054076800 00000100:00100000:2.0:1746129824.256869:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077312 00000100:00100000:2.0:1746129824.256871:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077312 00000100:00100000:2.0:1746129824.256879:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077824 00000100:00100000:2.0:1746129824.256880:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077824 00000100:00100000:2.0:1746129824.256887:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078336 00000100:00100000:2.0:1746129824.256888:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078336 00000100:00100000:2.0:1746129824.256894:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054076672 00000100:00100000:2.0:1746129824.256895:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054076672 00000100:00100000:2.0:1746129824.256899:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077184 00000100:00100000:2.0:1746129824.256901:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077184 00000100:00100000:2.0:1746129824.256905:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077696 00000100:00100000:2.0:1746129824.256906:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077696 00000100:00100000:2.0:1746129824.256910:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078208 00000100:00100000:2.0:1746129824.256911:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078208 00000100:00100000:2.0:1746129824.256917:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15754 00000100:00100000:2.0:1746129824.256922:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949054076800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257051:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949054076800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 129us (366us total) trans 21474841369 rc 0/0 00000100:00100000:2.0:1746129824.257056:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15754 00000100:00100000:2.0:1746129824.257164:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15755 00000100:00100000:2.0:1746129824.257168:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054077312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.257249:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830949054077312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (533us total) trans 17179874175 rc 0/0 00000100:00100000:2.0:1746129824.257254:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15755 00000100:00100000:2.0:1746129824.257261:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15756 00000100:00100000:2.0:1746129824.257264:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054077824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.257315:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830949054077824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (582us total) trans 17179874176 rc 0/0 00000100:00100000:2.0:1746129824.257319:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15756 00000100:00100000:2.0:1746129824.257326:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15757 00000100:00100000:2.0:1746129824.257329:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949054078336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257382:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949054078336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (631us total) trans 21474841370 rc 0/0 00000100:00100000:2.0:1746129824.257386:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15757 00000100:00100000:2.0:1746129824.257395:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15758 00000100:00100000:2.0:1746129824.257398:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949054076672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257451:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949054076672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 53us (678us total) trans 21474841371 rc 0/0 00000100:00100000:2.0:1746129824.257455:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15758 00000100:00100000:2.0:1746129824.257465:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15759 00000100:00100000:2.0:1746129824.257469:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054077184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.257527:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830949054077184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (738us total) trans 17179874177 rc 0/0 00000100:00100000:2.0:1746129824.257531:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15759 00000100:00100000:2.0:1746129824.257538:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15760 00000100:00100000:2.0:1746129824.257541:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054077696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129824.257591:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3299:x1830949054077696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (788us total) trans 17179874178 rc 0/0 00000100:00100000:2.0:1746129824.257595:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15760 00000100:00100000:2.0:1746129824.257602:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15761 00000100:00100000:2.0:1746129824.257605:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949054078208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257656:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949054078208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (838us total) trans 21474841372 rc 0/0 00000100:00100000:2.0:1746129824.257660:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15761 00000004:00080000:2.0:1746129824.257690:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dca80/2, rc 0, transno 21474841371 00000100:00100000:2.0:1746129824.257696:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054076672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129824.257702:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85f80/2, rc 0, transno 17179874177 00000100:00100000:2.0:1746129824.257705:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077184:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129824.257709:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87b80/2, rc 0, transno 17179874178 00000100:00100000:2.0:1746129824.257711:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077696:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129824.257715:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936dea00/2, rc 0, transno 21474841372 00000100:00100000:2.0:1746129824.257717:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078208:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129824.257722:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936de300/2, rc 0, transno 21474841369 00000100:00100000:2.0:1746129824.257724:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054076800:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129824.257728:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba86300/2, rc 0, transno 17179874175 00000100:00100000:2.0:1746129824.257729:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077312:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129824.257733:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284ce00/2, rc 0, transno 17179874176 00000100:00100000:2.0:1746129824.257735:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054077824:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129824.257740:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39500/2, rc 0, transno 21474841370 00000100:00100000:2.0:1746129824.257742:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257760:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746129824.257763:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257776:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.257788:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078720 00000100:00100000:2.0:1746129824.257790:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078720 00000100:00100000:2.0:1746129824.257799:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15762 00000100:00100000:2.0:1746129824.257802:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3299:x1830949054078720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129824.257879:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3299:x1830949054078720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (101us total) trans 21474841373 rc 0/0 00000100:00100000:2.0:1746129824.257883:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15762 00000004:00080000:2.0:1746129824.257902:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012d634000/2, rc 0, transno 21474841373 00000100:00100000:2.0:1746129824.257904:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d634000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129824.258229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.258242:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489600 00000100:00100000:0.0:1746129824.258244:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489600 00000100:00100000:0.0:1746129824.258262:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11097 00000100:00100000:0.0:1746129824.258266:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054489600:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129824.258278:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129824.258287:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356627 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.258320:0:15044:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.258330:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129824.258342:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129824.258344:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129824.258346:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1400, rc 0) 00000100:00100000:0.0:1746129824.258364:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054489600:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 99us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129824.258369:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11097 00000100:00100000:1.0:1746129824.258625:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054076928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.258645:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258657:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.258667:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258674:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.258683:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258690:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054078464:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.258698:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258706:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746129824.258709:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.258718:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258724:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077568:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.258733:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258738:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054078080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.258747:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258753:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054078592:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.258761:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.258776:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054076928 00000100:00100000:1.0:1746129824.258778:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054076928 00000100:00100000:1.0:1746129824.258788:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077440 00000100:00100000:1.0:1746129824.258790:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077440 00000100:00100000:1.0:1746129824.258796:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077952 00000100:00100000:1.0:1746129824.258797:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077952 00000100:00100000:1.0:1746129824.258802:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078464 00000100:00100000:1.0:1746129824.258803:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078464 00000100:00100000:1.0:1746129824.258807:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077056 00000100:00100000:1.0:1746129824.258808:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077056 00000100:00100000:1.0:1746129824.258812:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054077568 00000100:00100000:1.0:1746129824.258813:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054077568 00000100:00100000:1.0:1746129824.258817:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078080 00000100:00100000:1.0:1746129824.258819:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078080 00000100:00100000:1.0:1746129824.258823:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078592 00000100:00100000:1.0:1746129824.258824:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078592 00000100:00100000:1.0:1746129824.258829:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15763 00000100:00100000:1.0:1746129824.258832:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949054076928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.258932:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949054076928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (286us total) trans 21474841374 rc 0/0 00000100:00100000:1.0:1746129824.258937:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15763 00000100:00100000:1.0:1746129824.258944:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15764 00000100:00100000:1.0:1746129824.258947:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949054077440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.259004:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054077440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (336us total) trans 17179874179 rc 0/0 00000100:00100000:1.0:1746129824.259008:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15764 00000100:00100000:1.0:1746129824.259015:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15765 00000100:00100000:1.0:1746129824.259018:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949054077952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.259078:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054077952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (393us total) trans 17179874180 rc 0/0 00000100:00100000:1.0:1746129824.259083:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15765 00000100:00100000:1.0:1746129824.259089:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15766 00000100:00100000:1.0:1746129824.259093:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949054078464:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129824.259139:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129824.259142:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129824.259143:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129824.259145:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129824.259146:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129824.259159:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949054078464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (460us total) trans 21474841375 rc 0/0 00000100:00100000:1.0:1746129824.259163:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15766 00000100:00100000:1.0:1746129824.259171:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15767 00000100:00100000:1.0:1746129824.259174:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949054077056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.259229:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054077056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (510us total) trans 17179874181 rc 0/0 00000100:00100000:1.0:1746129824.259233:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15767 00000100:00100000:1.0:1746129824.259240:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15768 00000100:00100000:1.0:1746129824.259243:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+36:3296:x1830949054077568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129824.259291:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054077568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (557us total) trans 17179874182 rc 0/0 00000100:00100000:1.0:1746129824.259294:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15768 00000100:00100000:1.0:1746129824.259301:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15769 00000100:00100000:1.0:1746129824.259304:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949054078080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.259353:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949054078080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 49us (605us total) trans 21474841376 rc 0/0 00000100:00100000:1.0:1746129824.259357:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15769 00000100:00100000:1.0:1746129824.259363:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15770 00000100:00100000:1.0:1746129824.259366:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3296:x1830949054078592:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129824.259415:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949054078592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (652us total) trans 21474841377 rc 0/0 00000100:00100000:1.0:1746129824.259419:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15770 00000004:00080000:1.0:1746129824.259441:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba85c00/2, rc 0, transno 17179874181 00000100:00100000:1.0:1746129824.259444:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba85c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129824.259449:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba86680/2, rc 0, transno 17179874182 00000100:00100000:1.0:1746129824.259452:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077568:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129824.259457:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936ddc00/2, rc 0, transno 21474841376 00000100:00100000:1.0:1746129824.259459:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054078080:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129824.259464:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bd180/2, rc 0, transno 21474841377 00000100:00100000:1.0:1746129824.259466:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054078592:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129824.259471:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936df800/2, rc 0, transno 21474841374 00000100:00100000:1.0:1746129824.259474:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054076928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129824.259478:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ba87100/2, rc 0, transno 17179874179 00000100:00100000:1.0:1746129824.259480:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ba87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129824.259485:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009284d180/2, rc 0, transno 17179874180 00000100:00100000:1.0:1746129824.259486:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054077952:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129824.259490:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39c00/2, rc 0, transno 21474841375 00000100:00100000:1.0:1746129824.259492:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054078464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129824.259899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129824.259945:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489728 00000100:00100000:3.0:1746129824.259949:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489728 00000100:00100000:3.0:1746129824.259966:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11098 00000100:00100000:3.0:1746129824.259970:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054489728:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129824.259977:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.259986:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095212600/0x48868a4e43955d3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35662e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.260038:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129824.260046:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129824.260054:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129824.260080:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129824.260083:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129824.260093:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129824.260108:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095212600/0x48868a4e43955d3a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.260118:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.260123:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129824.260125:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129824.260127:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f984c00, rc 0) 00000100:00100000:3.0:1746129824.260146:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054489728:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 176us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.260150:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11098 00000100:00100000:0.0:1746129824.262935:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.262962:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.263259:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.263273:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.263284:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129824.263340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129824.263498:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489856 00000100:00100000:1.0:1746129824.263505:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489856 00000100:00100000:1.0:1746129824.263534:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490112 00000100:00100000:1.0:1746129824.263536:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490112 00000100:00100000:1.0:1746129824.263545:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054489984 00000100:00100000:1.0:1746129824.263547:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054489984 00000100:00100000:1.0:1746129824.263554:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490240 00000100:00100000:1.0:1746129824.263555:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490240 00000100:00100000:1.0:1746129824.263563:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490368 00000100:00100000:1.0:1746129824.263564:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490368 00000100:00100000:1.0:1746129824.263571:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490496 00000100:00100000:1.0:1746129824.263573:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490496 00000100:00100000:1.0:1746129824.263582:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15771 00000100:00100000:1.0:1746129824.263588:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054489856:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129824.263601:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.263615:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356635 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129824.263635:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x7e7 00010000:00010000:1.0:1746129824.263649:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263651:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263658:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263669:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263677:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244600, rc 0) 00000100:00100000:1.0:1746129824.263709:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054489856:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 121us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.263714:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15771 00000100:00100000:1.0:1746129824.263727:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15772 00000100:00100000:1.0:1746129824.263731:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054490112:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129824.263738:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.263747:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356643 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129824.263764:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x821 00010000:00010000:1.0:1746129824.263771:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263772:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263777:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263786:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263792:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244200, rc 0) 00000100:00100000:3.0:1746129824.263793:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15773 00000100:00100000:3.0:1746129824.263800:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054489984:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129824.263805:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054490112:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 74us (843us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129824.263806:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129824.263809:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15772 00010000:00010000:3.0:1746129824.263814:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35663c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129824.263817:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15774 00000100:00100000:1.0:1746129824.263821:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054490240:12345-192.168.204.31@tcp:101:mirror_io.0 00002000:00010000:3.0:1746129824.263824:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x821 00010000:00010000:1.0:1746129824.263825:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.263831:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263831:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35664a expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129824.263832:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.263835:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746129824.263840:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x821 00010000:00010000:3.0:1746129824.263843:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263865:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263867:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263870:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.263872:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa86a00, rc 0) 00010000:00010000:1.0:1746129824.263878:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263884:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244000, rc 0) 00000100:00100000:3.0:1746129824.263886:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054489984:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 88us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.263891:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15773 00000100:00100000:1.0:1746129824.263894:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054490240:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 73us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.263899:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15774 00000100:00100000:3.0:1746129824.263902:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15775 00000100:00100000:3.0:1746129824.263906:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054490368:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129824.263907:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15776 00000100:00100000:1.0:1746129824.263910:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054490496:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129824.263911:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129824.263914:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129824.263918:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356651 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129824.263920:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356658 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746129824.263927:0:10930:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x15e5 00002000:00010000:1.0:1746129824.263928:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d3a0, atime: 0x6813d3a0, ctime: 0x6813d3a0, blocks: 0x1029 00010000:00010000:3.0:1746129824.263933:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.263934:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263934:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129824.263935:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129824.263938:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263938:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.263945:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 11 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129824.263945:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129824.263951:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12aa00, rc 0) 00010000:00010000:1.0:1746129824.263951:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135676200, rc 0) 00000100:00100000:3.0:1746129824.263961:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054490368:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 56us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.263961:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054490496:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 50us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.263966:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15776 00000100:00100000:3.0:1746129824.263968:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15775 00000100:00100000:2.0:1746129824.773093:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746129824.773152:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129824.774873:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078848 00000100:00100000:3.0:1746129824.774881:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078848 00000100:00100000:3.0:1746129824.774988:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1746129824.774996:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3299:x1830949054078848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746129824.775015:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 570359808 pending 30670848 free 3852468224 avail 3850371072 00000100:00100000:3.0:1746129824.775077:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ba86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3299:x1830949054078848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.775083:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1746129824.775163:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054078848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746129824.821084:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949054079232:0@lo:400:kworker.0 00000100:00100000:0.0:1746129824.821096:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3297:1830949054079104:0@lo:400:kworker.0 00000100:00100000:1.0:1746129824.821142:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129824.821159:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129824.821219:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949054078976:0@lo:400:kworker.0 00000100:00100000:2.0:1746129824.821247:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129824.821306:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079232 00000100:00100000:3.0:1746129824.821313:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079232 00000100:00100000:0.0:1746129824.821546:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079104 00000100:00100000:0.0:1746129824.821550:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079104 00000100:00100000:1.0:1746129824.821560:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746129824.821565:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949054079360:0@lo:400:kworker.0 00000100:00100000:1.0:1746129824.821591:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129824.821646:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079360 00000100:00100000:0.0:1746129824.821649:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079360 00000100:00100000:3.0:1746129824.821655:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1746129824.821662:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830949054079104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129824.821664:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1746129824.821669:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949054079232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129824.821697:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830949054079232:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129824.821702:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1746129824.821717:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1746129824.821721:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949054079360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746129824.821739:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949054079360:12345-0@lo:400:kworker.0 Request processed in 18us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129824.821743:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1746129824.821750:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129824.821760:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054078976 00000100:00100000:0.0:1746129824.821762:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054078976 00000100:00100000:0.0:1746129824.821777:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1746129824.821781:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949054078976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129824.821792:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949054079360:0@lo:400:kworker.0 00000100:00100000:1.0:1746129824.821801:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3298:1830949054079232:0@lo:400:kworker.0 00000100:00100000:0.0:1746129824.821803:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3296:x1830949054078976:12345-0@lo:400:kworker.0 Request processed in 22us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129824.821807:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1746129824.821827:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ea7f7eb-2f74-477e-bfed-16dc08365411:3296:1830949054078976:0@lo:400:kworker.0 00000100:00100000:3.0:1746129824.821901:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830949054079104:12345-0@lo:400:kworker.0 Request processed in 240us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129824.821907:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1746129824.821967:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3297:1830949054079104:0@lo:400:kworker.0 00000100:00100000:0.0:1746129824.837373:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054079488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129824.837426:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129824.837520:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054079488 00000100:00100000:1.0:1746129824.837525:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054079488 00000100:00100000:1.0:1746129824.837552:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1746129824.837557:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054079488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746129824.837574:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 612827136 pending 39190528 free 3853516800 avail 3851419648 00000100:00100000:1.0:1746129824.837601:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054079488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129824.837606:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1746129824.837671:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009284f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054079488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129825.142197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.142234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.142508:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490752 00000100:00100000:3.0:1746129825.142515:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490752 00000100:00100000:3.0:1746129825.142556:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 201 00000100:00100000:3.0:1746129825.142562:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:1963:x1830949054490752:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1746129825.142633:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:1963:x1830949054490752:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 71us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.142639:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 201 00000100:00100000:0.0:1746129825.143091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.143104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.143123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.143139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.143327:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491008 00000100:00100000:1.0:1746129825.143331:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491008 00000100:00100000:1.0:1746129825.143350:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491264 00000100:00100000:1.0:1746129825.143352:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491264 00000100:00100000:1.0:1746129825.143363:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491776 00000100:00100000:1.0:1746129825.143364:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491776 00000100:00100000:1.0:1746129825.143381:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 302 00000100:00100000:1.0:1746129825.143386:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054491008:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129825.143408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.143411:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1963:x1830949054491008:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 26us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.143416:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 302 00000100:00100000:1.0:1746129825.143425:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490880 00000100:00100000:1.0:1746129825.143427:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490880 00000100:00100000:1.0:1746129825.143439:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 303 00000100:00100000:1.0:1746129825.143442:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054491264:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129825.143458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.143460:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054491264:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 18us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.143465:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 303 00000100:00100000:1.0:1746129825.143474:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 304 00000100:00100000:1.0:1746129825.143478:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054491776:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129825.143486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.143493:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054491776:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 15us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.143497:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 304 00000100:00100000:1.0:1746129825.143503:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491392 00000100:00100000:1.0:1746129825.143504:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491392 00000100:00100000:1.0:1746129825.143514:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 305 00000100:00100000:0.0:1746129825.143515:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.143518:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054490880:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129825.143529:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491648 00000100:00100000:0.0:1746129825.143531:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491648 00000100:00100000:1.0:1746129825.143534:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8790000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054490880:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 16us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.143539:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 305 00000100:00100000:1.0:1746129825.143545:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 306 00000100:00100000:1.0:1746129825.143548:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054491392:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:0.0:1746129825.143548:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 307 00000100:00100000:0.0:1746129825.143551:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054491648:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129825.143562:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054491392:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 14us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.143566:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054491648:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 14us (51us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.143567:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 306 00000100:00100000:0.0:1746129825.143570:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 307 00000100:00100000:1.0:1746129825.143578:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054490624 00000100:00100000:1.0:1746129825.143580:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054490624 00000100:00100000:1.0:1746129825.143594:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 220 00000100:00100000:1.0:1746129825.143598:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949054490624:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129825.143614:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1963:x1830949054490624:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 16us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.143619:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 220 00000100:00080000:1.0:1746129825.143640:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129825.143705:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491520 00000100:00100000:3.0:1746129825.143708:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491520 00000100:00100000:3.0:1746129825.143723:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054491136 00000100:00100000:3.0:1746129825.143725:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054491136 00000100:00100000:3.0:1746129825.143760:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:3.0:1746129825.143765:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054491520:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:2.0:1746129825.143776:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 203 00000100:00100000:2.0:1746129825.143783:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:1963:x1830949054491136:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:3.0:1746129825.143788:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054491520:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 23us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.143793:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 202 00000100:00100000:2.0:1746129825.143809:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:1963:x1830949054491136:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.143814:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 203 00000100:00080000:1.0:1746129825.143836:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129825.219360:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129825.280489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.280526:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.280572:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054492032 00000100:00100000:1.0:1746129825.280579:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054492032 00000100:00100000:1.0:1746129825.280624:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054492288 00000100:00100000:1.0:1746129825.280626:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054492288 00000100:00100000:1.0:1746129825.280652:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7078 00000100:00100000:1.0:1746129825.280658:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054492032:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129825.280684:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.280692:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7079 00010000:00010000:1.0:1746129825.280696:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.280698:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129825.280700:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054492288:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:1.0:1746129825.280702:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.280712:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.280718:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.280726:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.280728:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.280731:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.280739:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.282675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.283877:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054492544 00000100:00100000:2.0:1746129825.283886:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054492544 00000100:00100000:2.0:1746129825.283946:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7080 00000100:00100000:2.0:1746129825.283954:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054492544:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129825.283982:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.283994:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.283996:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.284001:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.284018:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.288442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.288465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.288942:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054492800 00000100:00100000:0.0:1746129825.288950:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054492800 00000100:00100000:0.0:1746129825.288996:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054493056 00000100:00100000:0.0:1746129825.288999:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054493056 00000100:00100000:0.0:1746129825.289445:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7081 00000100:00100000:0.0:1746129825.289453:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054492800:12345-192.168.204.31@tcp:3:mirror_io.0 00000100:00100000:3.0:1746129825.289496:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7082 00000100:00100000:3.0:1746129825.289508:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054493056:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:3.0:1746129825.289538:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.289551:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.289553:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.289557:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.289570:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.290391:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.290400:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129825.290402:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129825.290404:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.290417:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129825.293941:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.293986:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.294014:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054493312 00000100:00100000:2.0:1746129825.294021:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054493312 00000100:00100000:2.0:1746129825.294111:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054493568 00000100:00100000:2.0:1746129825.294114:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054493568 00000100:00100000:2.0:1746129825.294134:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7083 00000100:00100000:2.0:1746129825.294139:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1961:x1830949054493312:12345-192.168.204.31@tcp:3:mirror_io.0 00000100:00100000:1.0:1746129825.294146:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7084 00000100:00100000:1.0:1746129825.294154:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1961:x1830949054493568:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129825.294163:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.294172:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.294175:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.294176:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.294178:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.294180:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.294180:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.294183:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.294192:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.294192:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.298314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.298431:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054493824 00000100:00100000:2.0:1746129825.298438:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054493824 00000100:00100000:2.0:1746129825.298728:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7085 00000100:00100000:2.0:1746129825.298736:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054493824:12345-192.168.204.31@tcp:3:mirror_io.0 00010000:00010000:2.0:1746129825.298766:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.298780:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.298782:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.298787:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.298798:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308609:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308625:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308632:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308638:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3aa00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129825.308642:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308648:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308665:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.308671:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3aa00/0x48868a4e43955d72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308674:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308682:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308688:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308693:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c3200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129825.308696:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308701:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308711:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.308717:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3200/0x48868a4e43955d79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.308745:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1961:x1830949054492032:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 28082us (28257us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.308757:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+17:1962:x1830949054492288:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 28057us (28229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129825.308757:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7078 00000100:00100000:2.0:1746129825.308764:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7079 00010000:00010000:2.0:1746129825.314316:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.314331:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.314337:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.314342:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c2000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129825.314345:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.314352:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.314367:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.314372:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c2000/0x48868a4e43955d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314909:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314918:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314924:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314929:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6fe000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129825.314932:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314938:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314948:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.314954:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6fe000/0x48868a4e43955d87 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.315404:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1961:x1830949054492544:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 31444us (32728us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.315414:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7080 00000100:00100000:3.0:1746129825.315893:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1961:x1830949054493056:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 26388us (27424us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.315899:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7082 00010000:00010000:2.0:1746129825.321984:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.321998:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.322005:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.322011:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f881200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129825.322014:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.322020:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.322034:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.322052:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f881200/0x48868a4e43955d8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.322120:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054492800:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 32665us (33681us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.322130:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7081 00010000:00010000:2.0:1746129825.324090:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.324103:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.324110:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.324116:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c3800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129825.324120:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.324128:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.324143:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.324149:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e43955d95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.324214:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054493312:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 30071us (30277us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.324222:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7083 00010000:00010000:1.0:1746129825.328252:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.328267:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.328274:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.328280:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a022de00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129825.328283:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.328289:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.328305:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.328309:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022de00/0x48868a4e43955d9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.328384:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054493568:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 34227us (34393us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129825.328394:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7084 00010000:00010000:2.0:1746129825.329185:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.329193:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.329200:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.329204:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d6c3c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129825.329207:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.329213:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.329222:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.329228:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3c00/0x48868a4e43955da3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.329263:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054493824:12345-192.168.204.31@tcp:3:mirror_io.0 Request processed in 30527us (30954us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.329269:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7085 00000100:00100000:0.0:1746129825.334753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.334879:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054493952 00000100:00100000:2.0:1746129825.334886:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054493952 00000100:00100000:2.0:1746129825.335003:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 744 00000100:00100000:2.0:1746129825.335012:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054493952:12345-192.168.204.31@tcp:103:mirror_io.0 00010000:00010000:2.0:1746129825.335024:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129825.335053:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bb20e00/0x48868a4e43955ced lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356619 expref: 9 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.335071:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.335074:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129825.335237:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054493952:12345-192.168.204.31@tcp:103:mirror_io.0 Request processed in 225us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.335243:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 744 00000100:00100000:0.0:1746129825.336492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.337026:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054494208 00000100:00100000:2.0:1746129825.337032:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054494208 00000100:00100000:2.0:1746129825.337080:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4655 00000100:00100000:2.0:1746129825.337086:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31725:x1830949054494208:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129825.337281:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054494208:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 195us (791us total) trans 8589945121 rc 0/0 00000100:00100000:2.0:1746129825.337287:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4655 00000100:00100000:0.0:1746129825.338636:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.339090:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054494464 00000100:00100000:2.0:1746129825.339095:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054494464 00000100:00100000:2.0:1746129825.339119:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4656 00000100:00100000:2.0:1746129825.339125:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31725:x1830949054494464:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129825.339246:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31725:x1830949054494464:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 120us (612us total) trans 8589945122 rc 0/0 00000100:00100000:2.0:1746129825.339251:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4656 00000100:00100000:0.0:1746129825.353270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.353370:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054494720 00000100:00100000:2.0:1746129825.353377:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054494720 00000100:00100000:2.0:1746129825.353413:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11099 00000100:00100000:2.0:1746129825.353420:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31732:x1830949054494720:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129825.353435:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.353450:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b600/0x48868a4e43955daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35665f expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.353536:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353546:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353554:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353565:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353570:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353574:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353658:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353665:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353670:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:2.0:1746129825.353677:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129825.353743:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353749:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353755:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353759:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f3b800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129825.353762:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353768:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353776:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129825.353779:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129825.353782:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.353786:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b800/0x48868a4e43955db1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354197:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354203:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354208:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354212:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a8f3ba00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129825.354214:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354219:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354229:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009baa2e00) 00010000:00010000:2.0:1746129825.354231:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129825.354233:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354237:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955db8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.354267:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b600/0x48868a4e43955daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.354277:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.354282:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.354284:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129825.354285:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f3bc00, rc 0) 00000100:00100000:0.0:1746129825.354297:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.354317:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054494976 00000100:00100000:0.0:1746129825.354320:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054494976 00000100:00100000:0.0:1746129825.354352:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11100 00000100:00100000:0.0:1746129825.354357:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31737:x1830949054494976:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129825.354364:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.354369:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e43955dcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356666 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.354406:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354413:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354418:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354425:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354434:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354439:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354486:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354493:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354499:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:0.0:1746129825.354504:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129825.354539:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354544:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354548:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354552:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6ff000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129825.354554:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354558:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354564:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129825.354667:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129825.354671:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354676:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e43955dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129825.354789:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31732:x1830949054494720:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1369us (1524us total) trans 8589945123 rc 0/0 00000100:00100000:2.0:1746129825.354796:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11099 00010000:00010000:0.0:1746129825.354902:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354907:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354911:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354915:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6fea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129825.354917:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354921:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354927:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800932eff00) 00010000:00010000:0.0:1746129825.354929:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129825.354931:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354936:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fea00/0x48868a4e43955ddb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.354957:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e43955dcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.354969:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 283 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.354974:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129825.354975:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129825.354977:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6fe800, rc 0) 00000100:00100000:0.0:1746129825.354997:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31737:x1830949054494976:12345-192.168.204.31@tcp:101:cat.0 Request processed in 639us (699us total) trans 8589945124 rc 0/0 00000100:00100000:0.0:1746129825.355001:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11100 00000100:00100000:0.0:1746129825.358109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.359171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.359189:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496000 00000100:00100000:0.0:1746129825.359195:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496000 00000100:00100000:1.0:1746129825.359786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.359810:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054495104 00000100:00100000:2.0:1746129825.359814:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054495104 00000100:00100000:2.0:1746129825.359841:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15777 00000100:00100000:2.0:1746129825.359867:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054495104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.359881:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.359894:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35666d expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.359916:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.359918:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.359925:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.359938:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 29 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.359947:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f3ba00, rc 0) 00000100:00100000:2.0:1746129825.359990:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054495104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 141us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.359996:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15777 00000100:00100000:0.0:1746129825.360396:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11101 00000100:00100000:0.0:1746129825.360405:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31731:x1830949054496000:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129825.360420:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.360430:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e43955df7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356697 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360510:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.360523:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360529:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360539:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360545:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.360573:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360585:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 284 pid: 14313 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746129825.360597:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054079616:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129825.360670:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 7 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360679:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 7 pid: 14315 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746129825.360687:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054079744:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129825.360723:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.360731:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 9 pid: 1851 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746129825.360738:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054079872:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.360764:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.361261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.361288:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.361312:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.361333:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054495232 00000100:00100000:1.0:1746129825.361339:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054495232 00000100:00100000:1.0:1746129825.361364:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054495360 00000100:00100000:1.0:1746129825.361368:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054495360 00000100:00100000:1.0:1746129825.361383:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054495488 00000100:00100000:1.0:1746129825.361387:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054495488 00000100:00100000:1.0:1746129825.361400:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054495616 00000100:00100000:1.0:1746129825.361403:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054495616 00000100:00100000:1.0:1746129825.361422:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15778 00000100:00100000:1.0:1746129825.361427:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054495232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.361435:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.361444:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356674 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.361458:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361460:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361467:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 41 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361479:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 41 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361488:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022cc00, rc 0) 00000100:00100000:1.0:1746129825.361520:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949054495232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 90us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.361525:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15778 00000100:00100000:1.0:1746129825.361541:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15779 00000100:00100000:1.0:1746129825.361547:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054495360:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.361554:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.361561:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35667b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.361572:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361573:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361578:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 41 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361587:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 41 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361594:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022c400, rc 0) 00000100:00100000:1.0:1746129825.361616:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1962:x1830949054495360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.361621:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15779 00000100:00100000:1.0:1746129825.361633:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15780 00000100:00100000:1.0:1746129825.361639:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054495488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.361646:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.361655:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356682 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.361666:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361667:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361672:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361683:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361690:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022c600, rc 0) 00000100:00100000:1.0:1746129825.361710:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054495488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 71us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.361715:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15780 00000100:00100000:1.0:1746129825.361729:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15781 00000100:00100000:1.0:1746129825.361734:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054495616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.361741:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.361748:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356689 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.361760:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361761:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361766:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361775:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361782:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022c800, rc 0) 00000100:00100000:1.0:1746129825.361803:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054495616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 68us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.361808:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15781 00000100:00100000:1.0:1746129825.361893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.361914:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054495744 00000100:00100000:1.0:1746129825.361919:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054495744 00000100:00100000:1.0:1746129825.361942:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15782 00000100:00100000:1.0:1746129825.361948:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949054495744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.361957:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.361964:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356690 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.361976:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361977:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.361982:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 42 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361991:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 42 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.361998:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022ce00, rc 0) 00000100:00100000:1.0:1746129825.362020:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1961:x1830949054495744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.362025:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15782 00000100:00100000:0.0:1746129825.363665:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.363876:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496256 00000100:00100000:3.0:1746129825.363883:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496256 00000100:00100000:3.0:1746129825.363924:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11102 00000100:00100000:3.0:1746129825.363932:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31736:x1830949054496256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129825.363949:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.363962:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91c00/0x48868a4e43955e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35669e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.364053:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91e00/0x48868a4e43955e2f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129825.364069:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91e00/0x48868a4e43955e2f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129825.364079:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91e00/0x48868a4e43955e2f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:3.0:1746129825.364090:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129825.364231:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91c00/0x48868a4e43955e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35669e expref: 11 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.364270:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91e00/0x48868a4e43955e2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35669e expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.364277:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.364279:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129825.364282:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.364288:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.364293:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d91e00, rc 0) 00000100:00100000:3.0:1746129825.364337:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31736:x1830949054496256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 407us (676us total) trans 8589945125 rc 0/0 00000100:00100000:3.0:1746129825.364342:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11102 00000100:00100000:2.0:1746129825.366626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.366640:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054079616:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.366649:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054079744:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129825.366652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.366675:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054079872:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129825.366693:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:2.0:1746129825.366718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.366745:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496384 00000100:00100000:3.0:1746129825.366750:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496384 00010000:00010000:3.0:1746129825.366772:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 10 pid: 14315 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746129825.366809:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496512 00000100:00100000:3.0:1746129825.366812:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496512 00010000:00010000:3.0:1746129825.366821:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 285 pid: 14313 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746129825.366827:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496640 00000100:00100000:2.0:1746129825.366829:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496640 00010000:00010000:2.0:1746129825.366839:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 10 pid: 1851 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746129825.367550:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7890 00000100:00100000:3.0:1746129825.367559:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054496384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.367572:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.367579:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 10 pid: 14315 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367589:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 10 pid: 14315 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367608:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3bc00/0x48868a4e43955dbf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35665f expref: 10 pid: 14315 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367622:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.367627:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367634:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367638:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129825.367670:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1963:x1830949054496384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 113us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.367675:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7890 00000100:00100000:3.0:1746129825.367709:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7891 00000100:00100000:3.0:1746129825.367714:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054496512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.367720:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.367723:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 285 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367729:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 285 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367738:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe800/0x48868a4e43955de2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356666 expref: 285 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367744:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.367747:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367751:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367755:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129825.367768:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1961:x1830949054496512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.367772:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7891 00000100:00100000:3.0:1746129825.367780:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7892 00000100:00100000:3.0:1746129825.367784:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054496640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.367789:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.367792:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 10 pid: 1851 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367803:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 10 pid: 1851 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367812:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f984c00/0x48868a4e43955d41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35662e expref: 10 pid: 1851 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.367818:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.367821:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367826:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367831:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.367845:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746129825.368205:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.368211:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:0.0:1746129825.368224:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:2.0:1746129825.368230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.368248:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496768 00000100:00100000:2.0:1746129825.368251:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496768 00000100:00100000:2.0:1746129825.368269:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11103 00000100:00100000:2.0:1746129825.368273:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31736:x1830949054496768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.368286:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.368294:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b600/0x48868a4e43955e44 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566a5 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.368326:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e43955df7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 285 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.368337:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.368337:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.368342:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129825.368344:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129825.368346:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ff600, rc 0) 00010000:00010000:2.0:1746129825.368348:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.368353:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129825.368364:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31731:x1830949054496000:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7962us (9196us total) trans 8589945126 rc 0/0 00000100:00100000:0.0:1746129825.368369:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11101 00010000:00010000:2.0:1746129825.368370:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.368379:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 283 pid: 14313 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746129825.368388:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054080000:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129825.368458:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.368506:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054496640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 86us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.368512:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7892 00000100:00100000:2.0:1746129825.375313:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054080000:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.375330:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129825.375335:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129825.375484:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054496896 00000100:00100000:3.0:1746129825.375490:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054496896 00010000:00010000:3.0:1746129825.375515:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746129825.375536:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7893 00000100:00100000:3.0:1746129825.375542:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1964:x1830949054496896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.375555:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.375561:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.375571:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.375590:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e43955dfe lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356697 expref: 284 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746129825.375604:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.375608:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.375616:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.375622:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.375660:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129825.375677:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129825.375682:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129825.375691:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949054496896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.375696:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7893 00000004:00200000:2.0:1746129825.375713:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129825.375717:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129825.375730:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129825.375757:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3b600/0x48868a4e43955e44 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566a5 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.375783:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566a5 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.375789:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.375791:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129825.375793:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8f3a200, rc 0) 00000100:00100000:2.0:1746129825.375815:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31736:x1830949054496768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7541us (7584us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.375820:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11103 00000100:00100000:2.0:1746129825.377975:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.378007:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.378025:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497024 00000100:00100000:0.0:1746129825.378031:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497024 00000100:00100000:0.0:1746129825.378081:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11104 00000100:00100000:0.0:1746129825.378087:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31737:x1830949054497024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129825.378104:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.378117:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566ac expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.378160:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.378171:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.378185:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129825.378188:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129825.378190:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094561600, rc 0) 00000100:00100000:2.0:1746129825.378205:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.378227:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31737:x1830949054497024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 140us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.378232:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11104 00000100:00100000:1.0:1746129825.378240:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497152 00000100:00100000:1.0:1746129825.378243:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497152 00000100:00100000:0.0:1746129825.378248:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497280 00000100:00100000:0.0:1746129825.378250:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497280 00000100:00100000:1.0:1746129825.378261:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15783 00000100:00100000:1.0:1746129825.378266:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054497152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.378273:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.378282:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566b3 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.378299:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.378300:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.378306:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.378316:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.378323:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022d200, rc 0) 00000100:00100000:2.0:1746129825.378374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.378406:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054497152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 139us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.378411:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15783 00000100:00100000:2.0:1746129825.378643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.378661:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497408 00000100:00100000:1.0:1746129825.378663:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497408 00000100:00100000:1.0:1746129825.378676:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15784 00000100:00100000:1.0:1746129825.378680:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054497280:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.378687:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.378694:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566ba expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.378703:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.378704:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.378708:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.378717:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.378728:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022d400, rc 0) 00000100:00100000:1.0:1746129825.378740:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054497280:12345-192.168.204.31@tcp:101:cat.0 Request processed in 60us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.378744:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15784 00000100:00100000:1.0:1746129825.378751:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15785 00000100:00100000:1.0:1746129825.378755:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054497408:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.378759:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.378763:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566c1 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.378769:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.378770:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.378773:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.378780:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.378786:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022d600, rc 0) 00000100:00100000:1.0:1746129825.378793:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054497408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.378797:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15785 00000100:00100000:2.0:1746129825.380347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.380373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.380406:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497536 00000100:00100000:1.0:1746129825.380411:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497536 00000100:00100000:3.0:1746129825.380425:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497664 00000100:00100000:3.0:1746129825.380429:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497664 00000100:00100000:1.0:1746129825.380429:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054497792 00000100:00100000:1.0:1746129825.380431:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054497792 00000100:00100000:1.0:1746129825.380442:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15786 00000100:00100000:3.0:1746129825.380445:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15787 00000100:00100000:1.0:1746129825.380447:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054497536:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129825.380449:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054497792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129825.380457:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.380457:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.380466:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566d6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.380466:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566c8 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.380479:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.380479:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.380480:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.380480:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.380486:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.380486:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 27 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.380496:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 32 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.380496:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 27 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.380503:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d91a00, rc 0) 00010000:00010000:1.0:1746129825.380503:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022dc00, rc 0) 00000100:00100000:1.0:1746129825.380526:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c1c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054497536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 79us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.380528:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1963:x1830949054497792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.380531:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15786 00000100:00100000:3.0:1746129825.380533:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15787 00000100:00100000:1.0:1746129825.380541:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15788 00000100:00100000:1.0:1746129825.380545:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054497664:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.380550:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.380555:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566cf expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.380563:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.380564:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.380567:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.380574:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.380580:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022c000, rc 0) 00000100:00100000:1.0:1746129825.380591:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054497664:12345-192.168.204.31@tcp:101:cat.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.380595:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15788 00000100:00100000:0.0:1746129825.415966:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.417402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.417427:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054498176 00000100:00100000:2.0:1746129825.417435:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054498176 00002000:00100000:2.0:1746129825.417481:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880092adb800 x1830949054498176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.417491:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb800 with x1830949054498176 ext(0->1048575) 00002000:00010000:2.0:1746129825.417496:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adb800 00000100:00100000:2.0:1746129825.417545:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7086 00000100:00100000:2.0:1746129825.417554:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054498176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129825.419896:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054498304 00000100:00100000:1.0:1746129825.419903:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054498304 00002000:00100000:1.0:1746129825.419931:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880092ada680 x1830949054498304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.419939:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada680 with x1830949054498304 ext(0->1048575) 00002000:00010000:1.0:1746129825.419943:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada680 00000100:00100000:1.0:1746129825.419959:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7087 00000100:00100000:1.0:1746129825.419964:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054498304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.425799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.425837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.425903:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054498816 00000100:00100000:1.0:1746129825.425911:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054498816 00002000:00100000:1.0:1746129825.425946:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009284e300 x1830949054498816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.425956:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284e300 with x1830949054498816 ext(1048576->2097151) 00002000:00010000:1.0:1746129825.425961:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284e300 00000100:00100000:1.0:1746129825.425982:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054498688 00000100:00100000:1.0:1746129825.425985:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054498688 00002000:00100000:1.0:1746129825.425995:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009284c000 x1830949054498688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.426002:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c000 with x1830949054498688 ext(1048576->2097151) 00002000:00010000:1.0:1746129825.426005:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284c000 00000100:00100000:1.0:1746129825.426016:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7088 00000100:00100000:1.0:1746129825.426022:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1961:x1830949054498816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129825.426321:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7089 00000100:00100000:2.0:1746129825.426327:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1963:x1830949054498688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.429273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.429306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.429321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.429333:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.429361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.429374:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500096 00000100:00100000:0.0:1746129825.429374:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054499200 00000100:00100000:3.0:1746129825.429380:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500096 00000100:00100000:0.0:1746129825.429380:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054499200 00002000:00100000:0.0:1746129825.429410:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009284ca80 x1830949054499200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746129825.429417:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11105 00000100:00100000:3.0:1746129825.429425:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31732:x1830949054500096:12345-192.168.204.31@tcp:101:multiop.0 00002000:00100000:0.0:1746129825.429431:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ca80 with x1830949054499200 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.429436:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284ca80 00010000:00010000:3.0:1746129825.429437:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.429440:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00000100:00100000:0.0:1746129825.429454:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054499328 00000100:00100000:0.0:1746129825.429456:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054499328 00010000:00010000:3.0:1746129825.429460:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8f3a200/0x48868a4e43955e4b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566a5 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746129825.429467:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009284d880 x1830949054499328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.429473:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284d880 with x1830949054499328 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.429475:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284d880 00010000:00010000:3.0:1746129825.429481:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91e00/0x48868a4e43955e2f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35669e expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.429487:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054499712 00010000:00010000:3.0:1746129825.429489:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00000100:00100000:0.0:1746129825.429489:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054499712 00010000:00010000:3.0:1746129825.429493:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746129825.429499:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009284c700 x1830949054499712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129825.429500:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91400/0x48868a4e43955e83 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566dd expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746129825.429505:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c700 with x1830949054499712 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.429508:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284c700 00000100:00100000:0.0:1746129825.429516:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054499840 00000100:00100000:0.0:1746129825.429518:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054499840 00002000:00100000:0.0:1746129825.429526:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88008fad3100 x1830949054499840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.429532:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3100 with x1830949054499840 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.429534:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3100 00010000:00010000:3.0:1746129825.429539:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129825.429544:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7090 00010000:00010000:3.0:1746129825.429549:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.429549:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1963:x1830949054499200:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:3.0:1746129825.429555:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.429560:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129825.429582:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.429592:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 283 pid: 1851 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746129825.429603:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080128:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.429657:0:14315:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 8 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.429665:0:14315:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 8 pid: 15044 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746129825.429672:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080256:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.429689:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.429711:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7091 00000100:00100000:3.0:1746129825.429717:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1961:x1830949054499328:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.429951:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7092 00000100:00100000:3.0:1746129825.429956:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054499712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129825.430533:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7093 00000100:00100000:2.0:1746129825.430540:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054499840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129825.436620:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054498176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18930us (20525us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.436632:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7086 00002000:00100000:2.0:1746129825.436643:0:21600:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880092adb800 x1830949054498176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.436651:0:21600:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adb800 with x1830949054498176 ext(0->1048575) 00002000:00010000:2.0:1746129825.436656:0:21600:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adb800 00000100:00100000:0.0:1746129825.439275:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.439323:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080128:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.439333:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080256:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.439356:0:14315:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:0.0:1746129825.440664:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.441547:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500352 00000100:00100000:1.0:1746129825.441555:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500352 00010000:00010000:1.0:1746129825.441589:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 9 pid: 15044 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746129825.441611:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500224 00000100:00100000:1.0:1746129825.441613:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500224 00010000:00010000:1.0:1746129825.441620:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 284 pid: 1851 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746129825.441633:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7894 00000100:00100000:1.0:1746129825.441638:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054500352:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.441649:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.441654:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 9 pid: 15044 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.441662:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 9 pid: 15044 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.441680:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1400/0x48868a4e43955d33 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356627 expref: 9 pid: 15044 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.441708:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129825.441712:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129825.441718:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129825.441722:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.441754:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054500352:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 116us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.441760:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7894 00000100:00100000:1.0:1746129825.441772:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7895 00000100:00100000:1.0:1746129825.441776:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1964:x1830949054500224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.441784:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.441787:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 284 pid: 1851 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.441794:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 284 pid: 1851 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.441805:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094561600/0x48868a4e43955e52 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ac expref: 284 pid: 1851 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.441812:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129825.441814:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129825.441819:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129825.441826:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129825.441841:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.441870:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1964:x1830949054500224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.441876:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7895 00010000:00010000:1.0:1746129825.441902:0:14315:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129825.441908:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:1.0:1746129825.443359:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3560, 88 off300016 00000004:00080000:1.0:1746129825.444535:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502685676ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444616:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3561, 88 off300016 00000004:00080000:1.0:1746129825.444622:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502774499ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444651:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3562, 88 off300104 00000004:00080000:1.0:1746129825.444654:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502806389ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444667:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3561, 88 off300104 00000004:00080000:1.0:1746129825.444670:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502822304ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444678:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3562, 88 off300192 00000004:00080000:1.0:1746129825.444680:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502831959ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444686:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3563, 88 off300192 00000004:00080000:1.0:1746129825.444689:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502841426ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444697:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3564, 88 off300280 00000004:00080000:1.0:1746129825.444699:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502851082ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444706:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3565, 88 off300368 00000004:00080000:1.0:1746129825.444709:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502861581ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444716:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3563, 88 off300280 00000004:00080000:1.0:1746129825.444719:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502871032ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444726:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3566, 88 off300456 00000004:00080000:1.0:1746129825.444728:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502880289ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444735:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3564, 88 off300368 00000004:00080000:1.0:1746129825.444738:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502889781ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444745:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3567, 88 off300544 00000004:00080000:1.0:1746129825.444747:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502899509ns, next at 716792379979ns, rc = 0 00000040:00080000:1.0:1746129825.444754:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3565, 88 off300456 00000004:00080000:1.0:1746129825.444756:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502908102ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444763:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3566, 88 off300544 00000004:00080000:1.0:1746129825.444766:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502918331ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444774:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3567, 88 off300632 00000004:00080000:1.0:1746129825.444776:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502928209ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444782:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3568, 88 off300720 00000004:00080000:1.0:1746129825.444786:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771502938474ns, next at 731767308185ns, rc = 0 00000040:00080000:1.0:1746129825.444794:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3568, 88 off300632 00000004:00080000:1.0:1746129825.444796:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771502948552ns, next at 716792379979ns, rc = 0 00000100:00100000:1.0:1746129825.445380:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054498304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25410us (27981us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129825.445390:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7087 00002000:00100000:1.0:1746129825.445400:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880092ada680 x1830949054498304/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.445409:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada680 with x1830949054498304 ext(0->1048575) 00002000:00010000:1.0:1746129825.445414:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada680 00000100:00100000:2.0:1746129825.450236:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1963:x1830949054498688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23895us (24384us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.450248:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7089 00002000:00100000:2.0:1746129825.450257:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009284c000 x1830949054498688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.450265:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c000 with x1830949054498688 ext(1048576->2097151) 00002000:00010000:2.0:1746129825.450270:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284c000 00000100:00100000:2.0:1746129825.450557:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054499712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20599us (21233us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.450562:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7092 00002000:00100000:2.0:1746129825.450567:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009284c700 x1830949054499712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.450574:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284c700 with x1830949054499712 ext(1048576->2097151) 00002000:00010000:2.0:1746129825.450576:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009284c700 00000100:00100000:1.0:1746129825.458695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.460352:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500480 00000100:00100000:2.0:1746129825.460362:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500480 00000100:00100000:2.0:1746129825.460399:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11106 00000100:00100000:2.0:1746129825.460405:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31736:x1830949054500480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.460420:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.460436:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566e4 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.460477:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.460485:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.460498:0:1851:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129825.460506:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.460518:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.460520:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129825.460523:0:1851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.460532:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013083b800, rc 0) 00000100:00100000:2.0:1746129825.460572:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31736:x1830949054500480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 167us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.460578:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11106 00000100:00100000:0.0:1746129825.472136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.472275:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500608 00000100:00100000:0.0:1746129825.472282:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500608 00000100:00100000:0.0:1746129825.472314:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11107 00000100:00100000:0.0:1746129825.472321:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31739:x1830949054500608:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129825.472340:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.472355:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68400/0x48868a4e43955e98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566eb expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.472398:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472407:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472415:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472424:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472428:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472433:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472509:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472515:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.472521:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x40 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129825.479074:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1961:x1830949054499328:12345-192.168.204.31@tcp:3:cat.0 Request processed in 49349us (49759us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.479085:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7091 00002000:00100000:3.0:1746129825.479094:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009284d880 x1830949054499328/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.479102:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284d880 with x1830949054499328 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.479107:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284d880 00000100:00100000:0.0:1746129825.481156:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.481409:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1963:x1830949054499200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 51859us (52142us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129825.481417:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7090 00002000:00100000:0.0:1746129825.481425:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009284ca80 x1830949054499200/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.481434:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284ca80 with x1830949054499200 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.481438:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284ca80 00000100:00100000:3.0:1746129825.481606:0:15044:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500736 00000100:00100000:3.0:1746129825.481614:0:15044:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500736 00000100:00100000:3.0:1746129825.481641:0:15044:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11108 00000100:00100000:3.0:1746129825.481646:0:15044:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31737:x1830949054500736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129825.481658:0:15044:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.481671:0:15044:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566f2 expref: -99 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.481710:0:15044:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.481719:0:15044:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 284 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.481728:0:15044:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.481730:0:15044:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129825.481734:0:15044:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.481739:0:15044:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1e00, rc 0) 00000100:00100000:3.0:1746129825.481752:0:15044:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31737:x1830949054500736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 107us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.481757:0:15044:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11108 00000100:00100000:2.0:1746129825.482205:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054499840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 51666us (52871us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129825.482211:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7093 00002000:00100000:2.0:1746129825.482216:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88008fad3100 x1830949054499840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.482223:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad3100 with x1830949054499840 ext(1048576->2097151) 00002000:00010000:2.0:1746129825.482225:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad3100 00000100:00100000:1.0:1746129825.486841:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009284e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1961:x1830949054498816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 60813us (61044us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129825.486866:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7088 00002000:00100000:1.0:1746129825.486876:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009284e300 x1830949054498816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.486885:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009284e300 with x1830949054498816 ext(1048576->2097151) 00002000:00010000:1.0:1746129825.486890:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009284e300 00010000:00010000:2.0:1746129825.508091:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 12 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508106:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.508109:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129825.508111:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x40 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508119:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508123:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508131:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508140:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508145:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508151:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508157:0:14315:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508162:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508190:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 283 pid: 15044 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.508202:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080384:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129825.508283:0:14315:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.508290:0:14315:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080512:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129825.508312:0:14315:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129825.508398:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508406:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129825.508440:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129825.508443:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129825.508456:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508464:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508471:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508476:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508480:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508485:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c68200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129825.508488:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508492:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508499:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129825.508501:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129825.508503:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508507:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68200/0x48868a4e43955e9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508515:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508519:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508523:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508525:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135c68000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129825.508527:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508530:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508534:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880130e02300) 00010000:00010000:2.0:1746129825.508536:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129825.508537:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508540:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68000/0x48868a4e43955ea6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.508563:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c68400/0x48868a4e43955e98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 10 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508572:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.508576:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.508578:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746129825.508580:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135c69400, rc 0) 00000100:00100000:2.0:1746129825.508601:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31739:x1830949054500608:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 36281us (36473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.508608:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11107 00000001:00080000:0.0:1746129825.516905:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945126 is committed 00000001:00080000:0.0:1746129825.516920:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945127 is committed 00000004:00080000:0.0:1746129825.516922:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2735 committed 00000004:00080000:0.0:1746129825.517511:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2740 committed 00000004:00080000:0.0:1746129825.517516:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2739 committed 00000004:00080000:0.0:1746129825.517518:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2738 committed 00000004:00080000:0.0:1746129825.517519:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2737 committed 00000004:00080000:0.0:1746129825.517521:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746129825.517522:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2736 committed 00000004:00080000:0.0:1746129825.517523:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746129825.517525:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2735 committed 00000004:00080000:0.0:1746129825.517526:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2732 committed 00000004:00080000:0.0:1746129825.517528:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2731 committed 00000004:00080000:0.0:1746129825.517529:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2730 committed 00000004:00080000:0.0:1746129825.517531:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746129825.517532:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746129825.517534:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2729 committed 00000004:00080000:0.0:1746129825.517535:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2728 committed 00000004:00080000:0.0:1746129825.517537:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2732 committed 00000001:00080000:0.0:1746129825.517546:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945122 is committed 00000100:00100000:3.0:1746129825.517561:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054080640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517607:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129825.517621:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.517624:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054081152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517636:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517651:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746129825.517655:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054081024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517667:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517675:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054081536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517686:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129825.517699:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.517701:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054080768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517715:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517724:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517736:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517746:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.517759:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517770:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054082304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.517783:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517791:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1746129825.517795:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054080896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129825.517795:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080384:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129825.517803:0:14315:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14315:1830949054080512:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129825.517806:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517814:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.517824:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.517832:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081920:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746129825.517832:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91400/0x48868a4e43955e83 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 9 pid: 14315 timeout: 0 lvb_type: 3 00000100:00100000:3.0:1746129825.517841:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746129825.517863:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129825.517866:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054082432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.517877:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746129825.517888:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d91200, rc 0) 00000100:00100000:3.0:1746129825.517917:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054080640 00000100:00100000:0.0:1746129825.517917:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31732:x1830949054500096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 88493us (88555us total) trans 8589945127 rc 0/0 00000100:00100000:3.0:1746129825.517921:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054080640 00000100:00100000:0.0:1746129825.517925:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11105 00000100:00100000:0.0:1746129825.517942:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500992 00000100:00100000:0.0:1746129825.517943:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500992 00000100:00100000:3.0:1746129825.517946:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081152 00000100:00100000:3.0:1746129825.517947:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081152 00000100:00100000:3.0:1746129825.517953:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081024 00000100:00100000:3.0:1746129825.517955:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081024 00000100:00100000:0.0:1746129825.517959:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11109 00000100:00100000:3.0:1746129825.517960:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081536 00000100:00100000:3.0:1746129825.517961:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081536 00000100:00100000:0.0:1746129825.517963:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31739:x1830949054500992:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:3.0:1746129825.517966:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054080768 00000100:00100000:3.0:1746129825.517967:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054080768 00000100:00100000:3.0:1746129825.517972:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081280 00000100:00100000:3.0:1746129825.517973:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081280 00010000:00010000:0.0:1746129825.517975:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129825.517978:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081792 00000100:00100000:3.0:1746129825.517979:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081792 00010000:00010000:0.0:1746129825.517984:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e43955ebb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3566f9 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129825.517986:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082304 00000100:00100000:3.0:1746129825.517987:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082304 00000100:00100000:3.0:1746129825.517992:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054080896 00000100:00100000:3.0:1746129825.517994:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054080896 00000100:00100000:3.0:1746129825.517999:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081408 00000100:00100000:3.0:1746129825.518000:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081408 00000100:00100000:3.0:1746129825.518005:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081920 00000100:00100000:3.0:1746129825.518006:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081920 00000100:00100000:3.0:1746129825.518010:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082432 00000100:00100000:3.0:1746129825.518012:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082432 00010000:00010000:0.0:1746129825.518012:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e43955ebb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f9 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129825.518018:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15789 00000100:00100000:3.0:1746129825.518021:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949054080640:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746129825.518022:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e43955ebb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f9 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.518032:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129825.518048:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129825.518050:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fa800, rc 0) 00000100:00100000:0.0:1746129825.518064:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31739:x1830949054500992:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 100us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.518069:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11109 00000100:00100000:0.0:1746129825.518084:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054500864 00000100:00100000:0.0:1746129825.518086:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054500864 00000100:00100000:0.0:1746129825.518101:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4657 00000100:00100000:0.0:1746129825.518106:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31737:x1830949054500864:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:0.0:1746129825.518149:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31737:x1830949054500864:12345-192.168.204.31@tcp:49:cat.0 Request processed in 43us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.518154:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4657 00002000:00010000:3.0:1746129825.518165:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129825.518167:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518169:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00000100:00100000:0.0:1746129825.518169:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15790 00002000:00010000:3.0:1746129825.518171:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518173:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129825.518173:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949054081152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.518190:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949054080640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (584us total) trans 17179874183 rc 0/0 00000100:00100000:3.0:1746129825.518195:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15789 00000100:00100000:3.0:1746129825.518204:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15791 00000100:00100000:3.0:1746129825.518208:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3297:x1830949054081024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129825.518249:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3297:x1830949054081152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (611us total) trans 17179874184 rc 0/0 00000100:00100000:0.0:1746129825.518254:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15790 00000100:00100000:0.0:1746129825.518262:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15792 00000100:00100000:0.0:1746129825.518266:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949054081536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.518267:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949054081024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (599us total) trans 17179874185 rc 0/0 00000100:00100000:3.0:1746129825.518271:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15791 00000100:00100000:0.0:1746129825.518324:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3297:x1830949054081536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (636us total) trans 17179874186 rc 0/0 00000100:00100000:0.0:1746129825.518328:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15792 00000100:00100000:0.0:1746129825.518336:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15793 00000100:00100000:0.0:1746129825.518339:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054080768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.518367:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15794 00000100:00100000:3.0:1746129825.518371:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054081280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129825.518393:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129825.518395:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518397:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518399:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518400:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129825.518419:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949054080768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (703us total) trans 17179874187 rc 0/0 00000100:00100000:0.0:1746129825.518424:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15793 00000100:00100000:3.0:1746129825.518425:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949054081280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (689us total) trans 17179874188 rc 0/0 00000100:00100000:3.0:1746129825.518430:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15794 00000100:00100000:0.0:1746129825.518432:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15795 00000100:00100000:0.0:1746129825.518435:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054081792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518436:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15796 00000100:00100000:3.0:1746129825.518439:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054082304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518460:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15797 00000100:00100000:3.0:1746129825.518463:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054080896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129825.518513:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746129825.518515:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518517:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518518:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518520:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129825.518535:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949054080896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (728us total) trans 17179874189 rc 0/0 00000100:00100000:3.0:1746129825.518539:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15797 00000100:00100000:3.0:1746129825.518547:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15798 00000100:00100000:3.0:1746129825.518550:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054081408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129825.518560:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129825.518562:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518564:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518565:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518567:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129825.518582:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949054081792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (822us total) trans 21474841378 rc 0/0 00000100:00100000:0.0:1746129825.518587:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15795 00000100:00100000:0.0:1746129825.518595:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15799 00000100:00100000:0.0:1746129825.518598:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054081920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518608:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949054081408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (782us total) trans 17179874190 rc 0/0 00000100:00100000:3.0:1746129825.518612:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15798 00000100:00100000:3.0:1746129825.518620:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15800 00000100:00100000:3.0:1746129825.518624:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3298:x1830949054082432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129825.518665:0:3624:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:0.0:1746129825.518668:0:3624:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:0.0:1746129825.518670:0:3624:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518671:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129825.518671:0:3624:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518673:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129825.518673:0:3624:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5605 00002000:00010000:3.0:1746129825.518675:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746129825.518676:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746129825.518678:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129825.518689:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949054081920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (847us total) trans 21474841379 rc 0/0 00000100:00100000:3.0:1746129825.518690:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3298:x1830949054082432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (811us total) trans 21474841380 rc 0/0 00000100:00100000:0.0:1746129825.518694:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15799 00000100:00100000:3.0:1746129825.518695:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15800 00000100:00080000:3.0:1746129825.518721:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746129825.518724:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129825.518762:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129825.518779:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.518780:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3298:x1830949054082304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 340us (996us total) trans 21474841381 rc 0/0 00000100:00100000:3.0:1746129825.518785:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15796 00000100:00100000:0.0:1746129825.518790:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518792:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082048 00000100:00100000:3.0:1746129825.518794:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082048 00000100:00100000:0.0:1746129825.518801:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129825.518804:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082560 00000100:00100000:3.0:1746129825.518806:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082560 00000100:00100000:0.0:1746129825.518810:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746129825.518814:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15801 00000100:00100000:0.0:1746129825.518814:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054081664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518817:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3296:x1830949054082048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129825.518826:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129825.518834:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129825.518862:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129825.518877:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054081664 00000100:00100000:0.0:1746129825.518880:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054081664 00000100:00100000:0.0:1746129825.518890:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082176 00000100:00100000:0.0:1746129825.518891:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082176 00000100:00100000:0.0:1746129825.518899:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15802 00000100:00100000:0.0:1746129825.518903:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949054082560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518904:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949054082048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (125us total) trans 21474841382 rc 0/0 00000100:00100000:3.0:1746129825.518908:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15801 00000100:00100000:3.0:1746129825.518916:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15803 00000100:00100000:3.0:1746129825.518919:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3296:x1830949054081664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129825.518973:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746129825.518974:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949054082560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (171us total) trans 21474841383 rc 0/0 00002000:00010000:3.0:1746129825.518976:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518977:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129824 -> 1746129824 00000100:00100000:0.0:1746129825.518978:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15802 00002000:00010000:3.0:1746129825.518979:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129824 -> 1746129824 00002000:00010000:3.0:1746129825.518981:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2023 -> 2025 00000100:00100000:0.0:1746129825.518986:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15804 00000100:00100000:0.0:1746129825.518990:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949054082176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129825.518994:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949054081664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (167us total) trans 21474841384 rc 0/0 00000100:00100000:3.0:1746129825.518998:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15803 00000004:00080000:3.0:1746129825.519023:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092adb100/2, rc 0, transno 21474841384 00000100:00100000:3.0:1746129825.519029:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054081664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129825.519050:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6a00/2, rc 0, transno 21474841382 00000100:00100000:3.0:1746129825.519053:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082048:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129825.519059:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6ec380/2, rc 0, transno 21474841383 00000100:00100000:3.0:1746129825.519062:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082560:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129825.519068:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d5500/2, rc 0, transno 21474841385 00000100:00100000:0.0:1746129825.519069:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949054082176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (222us total) trans 21474841385 rc 0/0 00000100:00100000:3.0:1746129825.519070:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129825.519077:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15804 00000100:00100000:3.0:1746129825.519095:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1746129825.519098:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6680/2, rc 0, transno 17179874185 00000100:00100000:3.0:1746129825.519099:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129825.519101:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054081024:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129825.519107:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c4380/2, rc 0, transno 17179874186 00000100:00100000:0.0:1746129825.519109:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054081536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.519114:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129825.519114:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5180/2, rc 0, transno 17179874183 00000100:00100000:0.0:1746129825.519117:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054080640:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129825.519122:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7100/2, rc 0, transno 17179874184 00000100:00100000:0.0:1746129825.519125:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054081152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.519126:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054082688 00000100:00100000:3.0:1746129825.519128:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054082688 00000004:00080000:0.0:1746129825.519137:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7b80/2, rc 0, transno 17179874189 00000100:00100000:0.0:1746129825.519139:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054080896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.519140:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15805 00000100:00100000:3.0:1746129825.519143:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3296:x1830949054082688:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129825.519145:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5500/2, rc 0, transno 17179874190 00000100:00100000:0.0:1746129825.519147:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129825.519153:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad8a80/2, rc 0, transno 21474841379 00000100:00100000:0.0:1746129825.519155:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129825.519160:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f6efb80/2, rc 0, transno 21474841380 00000100:00100000:0.0:1746129825.519162:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054082432:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129825.519167:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800934d6300/2, rc 0, transno 21474841381 00000100:00100000:0.0:1746129825.519169:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054082304:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129825.519175:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092ad8700/2, rc 0, transno 21474841378 00000100:00100000:0.0:1746129825.519177:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129825.519182:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5880/2, rc 0, transno 17179874187 00000100:00100000:0.0:1746129825.519185:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054080768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129825.519190:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c4700/2, rc 0, transno 17179874188 00000100:00100000:0.0:1746129825.519192:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054081280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129825.519214:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3296:x1830949054082688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (99us total) trans 21474841386 rc 0/0 00000100:00100000:3.0:1746129825.519219:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15805 00000004:00080000:3.0:1746129825.519236:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adad880/2, rc 0, transno 21474841386 00000100:00100000:3.0:1746129825.519238:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054082688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129825.529481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.529513:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.529535:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.529554:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054501248 00000100:00100000:0.0:1746129825.529554:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054501120 00000100:00100000:1.0:1746129825.529560:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054501248 00000100:00100000:0.0:1746129825.529560:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054501120 00000100:00100000:1.0:1746129825.529591:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4658 00000100:00100000:1.0:1746129825.529603:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31732:x1830949054501248:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:0.0:1746129825.529667:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4659 00000100:00100000:0.0:1746129825.529672:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012babf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31736:x1830949054501120:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:1.0:1746129825.529694:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31732:x1830949054501248:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.529700:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4658 00000100:00100000:0.0:1746129825.529703:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012babf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31736:x1830949054501120:12345-192.168.204.31@tcp:49:cat.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.529707:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4659 00000100:00100000:0.0:1746129825.529737:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054501504 00000100:00100000:0.0:1746129825.529740:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054501504 00000100:00100000:0.0:1746129825.529755:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11110 00000100:00100000:0.0:1746129825.529759:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31739:x1830949054501504:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129825.529767:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.529785:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eec00/0x48868a4e43955ec2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356700 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.529883:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.529895:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.529905:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.529928:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.529937:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 9 pid: 14313 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746129825.529947:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054082816:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.529990:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.541351:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ef800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054082816:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.541371:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129825.541698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.541721:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054501632 00000100:00100000:0.0:1746129825.541726:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054501632 00010000:00010000:0.0:1746129825.541749:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 10 pid: 14313 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746129825.541770:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7896 00000100:00100000:0.0:1746129825.541775:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054501632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129825.541785:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129825.541789:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 10 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746129825.541798:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 10 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746129825.541814:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135c69400/0x48868a4e43955ead lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566eb expref: 10 pid: 14313 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746129825.541824:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129825.541828:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.541836:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.541841:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.541875:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129825.541905:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054501632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 129us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.541910:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7896 00010000:00010000:3.0:1746129825.543165:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.543174:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129825.543190:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129825.543340:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eec00/0x48868a4e43955ec2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356700 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.543353:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356700 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.543359:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.543361:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129825.543363:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef800, rc 0) 00000100:00100000:3.0:1746129825.543393:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31739:x1830949054501504:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 13632us (13878us total) trans 8589945128 rc 0/0 00000100:00100000:3.0:1746129825.543399:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11110 00000100:00100000:2.0:1746129825.543787:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.543814:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.543865:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054502016 00000100:00100000:3.0:1746129825.543868:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054501760 00000100:00100000:1.0:1746129825.543870:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054502016 00000100:00100000:3.0:1746129825.543871:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054501760 00002000:00100000:1.0:1746129825.543893:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504d180 x1830949054502016/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746129825.543894:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15806 00000100:00100000:3.0:1746129825.543899:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31731:x1830949054501760:12345-192.168.204.31@tcp:101:multiop.0 00002000:00100000:1.0:1746129825.543901:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d180 with x1830949054502016 ext(1048576->2097151) 00002000:00010000:1.0:1746129825.543904:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504d180 00010000:00010000:3.0:1746129825.543909:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129825.543915:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7094 00000100:00100000:1.0:1746129825.543919:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1963:x1830949054502016:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:3.0:1746129825.543921:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356707 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.543939:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.543946:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.543952:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 32 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.543958:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.543959:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.543962:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [749568->1048575] (req 749568->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 32 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.543982:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 32 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.543991:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 32 pid: 20441 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.544001:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054082944:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.544065:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.544073:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 26 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.544080:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.544103:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 10 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.544110:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 10 pid: 3624 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.544117:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.544130:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.550302:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054082944:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.550672:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.550753:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054502144 00000100:00100000:3.0:1746129825.550760:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054502144 00010000:00010000:3.0:1746129825.550786:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 33 pid: 20441 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746129825.551218:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7897 00000100:00100000:0.0:1746129825.551226:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949054502144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129825.551236:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129825.551254:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 33 pid: 20441 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746129825.551263:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 33 pid: 20441 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746129825.551279:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8f3ba00/0x48868a4e43955df0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35666d expref: 33 pid: 20441 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746129825.551295:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129825.551325:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054502144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.551330:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7897 00000100:00100000:0.0:1746129825.552891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.553110:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.553124:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054502400 00000100:00100000:3.0:1746129825.553127:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054502400 00000100:00100000:3.0:1746129825.553151:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11111 00000100:00100000:3.0:1746129825.553156:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31739:x1830949054502400:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129825.553172:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.553173:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129825.553188:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef800/0x48868a4e43955ec9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356700 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.553198:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.553201:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129825.553209:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e43955ede lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35670e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.553274:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553282:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553289:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553296:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553301:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553306:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553310:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3f200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129825.553313:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553319:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553326:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.553328:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129825.553331:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553335:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3f200/0x48868a4e43955ee5 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.553351:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e43955ede lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35670e expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.553356:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8fb6000/0x48868a4e43955ede lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35670e expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.553361:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb6000, rc 0) 00000100:00100000:3.0:1746129825.553384:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31739:x1830949054502400:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 228us (497us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129825.553389:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11111 00000100:00100000:0.0:1746129825.553588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.553607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.553624:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054502528 00000100:00100000:0.0:1746129825.553627:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054502528 00010000:00010000:0.0:1746129825.553640:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 27 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746129825.553655:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054502656 00000100:00100000:0.0:1746129825.553656:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054502656 00010000:00010000:0.0:1746129825.553664:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 11 pid: 3624 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.554733:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7898 00000100:00100000:3.0:1746129825.554740:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054502528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.554750:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.554765:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 27 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746129825.554774:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 27 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746129825.554793:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129825.554800:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7899 00000100:00100000:0.0:1746129825.554806:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054502656:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129825.554812:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054502528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (1225us total) trans 0 rc 0/0 00010000:00010000:0.0:1746129825.554812:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129825.554817:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7898 00010000:00010000:0.0:1746129825.554821:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 11 pid: 3624 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746129825.554830:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 11 pid: 3624 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746129825.554844:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022d200/0x48868a4e43955e59 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566b3 expref: 26 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746129825.554858:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244600/0x48868a4e43955d48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356635 expref: 11 pid: 3624 timeout: 871 lvb_type: 1 00010000:00010000:0.0:1746129825.554866:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129825.554868:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746129825.554871:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083072:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129825.554874:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.554880:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.554892:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.554899:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093361a00, rc 0) 00010000:00010000:0.0:1746129825.554901:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 31 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.554910:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f6ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054083328:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129825.554915:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31731:x1830949054501760:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11016us (11129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.554920:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15806 00000100:00100000:0.0:1746129825.554942:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a80c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.555494:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1963:x1830949054502016:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11573us (11677us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.555501:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7094 00002000:00100000:3.0:1746129825.555508:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504d180 x1830949054502016/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.555516:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d180 with x1830949054502016 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.555520:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504d180 00000100:00100000:1.0:1746129825.555663:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.555700:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054502784 00000100:00100000:3.0:1746129825.555705:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054502784 00000100:00100000:3.0:1746129825.555735:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15807 00000100:00100000:3.0:1746129825.555740:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31732:x1830949054502784:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129825.555748:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.555756:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356715 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.555769:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.555776:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.555782:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.555786:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.555788:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.555790:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3473408->4124671] (req 3473408->4124671) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.555803:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 30 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.555811:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 30 pid: 8436 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.555818:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083456:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.555860:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.555868:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.555874:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083584:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.555899:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.555905:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.555912:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d635f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083712:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.555925:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.556985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.557004:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054503040 00000100:00100000:3.0:1746129825.557009:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054503040 00002000:00100000:3.0:1746129825.557031:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504d880 x1830949054503040/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.557051:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d880 with x1830949054503040 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.557054:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504d880 00000100:00100000:3.0:1746129825.557067:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7095 00000100:00100000:3.0:1746129825.557072:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1962:x1830949054503040:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129825.558092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.558122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.558134:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054503552 00000100:00100000:3.0:1746129825.558139:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054503552 00002000:00100000:3.0:1746129825.558157:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (749568->753663) req@ffff88009f6ef800 x1830949054503552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.558165:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ef800 with x1830949054503552 ext(749568->753663) 00002000:00010000:3.0:1746129825.558169:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ef800 00000100:00100000:0.0:1746129825.558176:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054503296 00000100:00100000:0.0:1746129825.558178:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054503296 00000100:00100000:3.0:1746129825.558184:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7096 00000100:00100000:3.0:1746129825.558189:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054503552:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129825.558197:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4660 00000100:00100000:0.0:1746129825.558202:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31739:x1830949054503296:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:3.0:1746129825.558275:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054503552:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 84us (151us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129825.558281:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7096 00002000:00100000:3.0:1746129825.558285:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (749568->753663) req@ffff88009f6ef800 x1830949054503552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.558292:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ef800 with x1830949054503552 ext(749568->753663) 00002000:00010000:3.0:1746129825.558294:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ef800 00000100:00100000:2.0:1746129825.558449:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d636680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083456:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129825.558456:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083584:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.558933:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f6ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054083328:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129825.558947:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129825.558984:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054502656:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4178us (5375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.558992:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7899 00000100:00100000:0.0:1746129825.559115:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31739:x1830949054503296:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 911us (1025us total) trans 8589945129 rc 0/0 00000100:00100000:0.0:1746129825.559120:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4660 00000100:00100000:2.0:1746129825.559177:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d635f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054083712:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129825.559199:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3473408->4124671] (req 3473408->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.559211:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ec00, rc 0) 00000100:00100000:2.0:1746129825.559232:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31732:x1830949054502784:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3492us (3570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.559238:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15807 00000100:00100000:1.0:1746129825.560958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.560976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.560992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.561008:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054503680 00000100:00100000:1.0:1746129825.561012:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054503680 00010000:00010000:1.0:1746129825.561045:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 31 pid: 8436 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746129825.561065:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054503936 00000100:00100000:1.0:1746129825.561067:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054503936 00010000:00010000:1.0:1746129825.561077:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746129825.561088:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054503808 00000100:00100000:1.0:1746129825.561089:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054503808 00010000:00010000:1.0:1746129825.561096:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746129825.561109:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7900 00000100:00100000:1.0:1746129825.561115:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054503680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.561125:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129825.561178:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7901 00000100:00100000:1.0:1746129825.561183:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054503936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.561190:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.561198:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561208:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561228:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a12aa00/0x48868a4e43955d64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356651 expref: 10 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561239:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.561266:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054503936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.561271:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7901 00000100:00100000:1.0:1746129825.561283:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7902 00000100:00100000:1.0:1746129825.561288:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054503808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.561292:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.561298:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561305:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561316:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022c000/0x48868a4e43955e7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566cf expref: 27 pid: 1877 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561322:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.561332:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054503808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.561336:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7902 00010000:00010000:1.0:1746129825.561350:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 31 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561363:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 31 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561372:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022c800/0x48868a4e43955e1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356689 expref: 31 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.561380:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.561381:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.561387:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.561394:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.561418:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 25 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.561429:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054083840:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129825.561466:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.569342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.569384:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054083840:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129825.569399:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129825.569432:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054503680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8317us (8478us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.569441:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7900 00000100:00100000:3.0:1746129825.569968:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1962:x1830949054503040:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12895us (12983us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.569976:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7095 00002000:00100000:3.0:1746129825.569984:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504d880 x1830949054503040/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.569993:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504d880 with x1830949054503040 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.569998:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504d880 00000100:00100000:3.0:1746129825.570014:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054504192 00000100:00100000:3.0:1746129825.570019:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054504192 00002000:00100000:3.0:1746129825.570050:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3473408->3477503) req@ffff8800a504e300 x1830949054504192/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.570062:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e300 with x1830949054504192 ext(3473408->3477503) 00002000:00010000:3.0:1746129825.570065:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504e300 00000100:00100000:3.0:1746129825.570078:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7097 00000100:00100000:3.0:1746129825.570084:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054504192:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129825.570181:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054504192:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 97us (845us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129825.570186:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7097 00002000:00100000:3.0:1746129825.570190:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3473408->3477503) req@ffff8800a504e300 x1830949054504192/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.570197:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504e300 with x1830949054504192 ext(3473408->3477503) 00002000:00010000:3.0:1746129825.570199:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a504e300 00000100:00100000:0.0:1746129825.572798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.573537:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054504320 00000100:00100000:2.0:1746129825.573546:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054504320 00000100:00100000:2.0:1746129825.573580:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15808 00000100:00100000:2.0:1746129825.573586:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:31731:x1830949054504320:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129825.573599:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.573613:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35671c expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.573634:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.573642:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.573648:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 43 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.573653:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.573655:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.573658:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1519615] (req 1048576->1519615) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 43 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.573680:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 43 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.573690:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 43 pid: 8436 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746129825.573699:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054083968:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129825.573777:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.573784:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 31 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746129825.573791:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054084096:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129825.573811:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 10 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.573818:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 10 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746129825.573825:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054084224:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129825.573838:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.576877:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.577566:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054504576 00000100:00100000:0.0:1746129825.578624:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054504576 00002000:00100000:0.0:1746129825.578667:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b8e4e00 x1830949054504576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.578677:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4e00 with x1830949054504576 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.578681:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4e00 00000100:00100000:0.0:1746129825.578700:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7098 00000100:00100000:0.0:1746129825.578707:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:1964:x1830949054504576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129825.583943:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054083968:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.584254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.584268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.584286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.584300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.584323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.584340:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054505216 00000100:00100000:3.0:1746129825.584345:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054505216 00002000:00100000:3.0:1746129825.584375:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d634a80 x1830949054505216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.584383:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634a80 with x1830949054505216 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.584387:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d634a80 00000100:00100000:3.0:1746129825.584398:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054505472 00000100:00100000:3.0:1746129825.584400:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054505472 00002000:00100000:3.0:1746129825.584408:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4120576->4124671) req@ffff88012d636a00 x1830949054505472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.584414:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636a00 with x1830949054505472 ext(4120576->4124671) 00002000:00010000:3.0:1746129825.584417:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636a00 00000100:00100000:3.0:1746129825.584423:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054505344 00000100:00100000:3.0:1746129825.584424:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054505344 00002000:00100000:3.0:1746129825.584431:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d635f80 x1830949054505344/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.584436:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949054505344 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.584438:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:3.0:1746129825.584447:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7099 00000100:00100000:3.0:1746129825.584451:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054505216:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129825.585451:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7100 00000100:00100000:3.0:1746129825.585460:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054505472:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129825.585540:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054505472:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 82us (1239us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129825.585547:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7100 00002000:00100000:3.0:1746129825.585553:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4120576->4124671) req@ffff88012d636a00 x1830949054505472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.585561:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636a00 with x1830949054505472 ext(4120576->4124671) 00002000:00010000:3.0:1746129825.585565:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d636a00 00000100:00100000:3.0:1746129825.585582:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7101 00000100:00100000:3.0:1746129825.585586:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054505344:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129825.585829:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054084096:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129825.585837:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054084224:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129825.585884:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1519615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 45 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.585895:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013083ae00, rc 0) 00000100:00100000:2.0:1746129825.585909:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054504704 00000100:00100000:2.0:1746129825.585912:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054504704 00010000:00010000:2.0:1746129825.585927:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 46 pid: 8436 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746129825.585952:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054504832 00000100:00100000:2.0:1746129825.585954:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054504832 00010000:00010000:2.0:1746129825.585961:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 11 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746129825.585971:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7903 00000100:00100000:2.0:1746129825.585975:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+46:1964:x1830949054504704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129825.585982:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129825.585992:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 46 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.586000:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 46 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.586015:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a022cc00/0x48868a4e43955e05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356674 expref: 46 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.586022:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129825.586048:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+45:1964:x1830949054504704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 72us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.586053:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7903 00000100:00100000:2.0:1746129825.586063:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7904 00000100:00100000:2.0:1746129825.586067:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054504832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129825.586072:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129825.586078:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 11 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.586084:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 11 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.586093:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa86a00/0x48868a4e43955d56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35663c expref: 11 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.586100:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129825.586110:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054504832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.586114:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7904 00000100:00100000:2.0:1746129825.586346:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+44:31731:x1830949054504320:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12760us (14996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.586352:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15808 00000100:00100000:1.0:1746129825.589742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.589769:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054505728 00000100:00100000:1.0:1746129825.589776:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054505728 00010000:00010000:1.0:1746129825.589801:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 34 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746129825.589830:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7905 00000100:00100000:1.0:1746129825.589836:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1963:x1830949054505728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.589859:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.589877:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 34 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.589887:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 34 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.589904:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a022d400/0x48868a4e43955e60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566ba expref: 34 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.589915:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.589916:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.589922:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 43 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.589929:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 43 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.589952:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 43 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.589962:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054084352:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129825.590018:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.597151:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054084352:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129825.597168:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.597189:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1963:x1830949054505728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7351us (7453us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.597197:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7905 00000100:00100000:0.0:1746129825.597838:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1964:x1830949054504576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19130us (20966us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129825.597862:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7098 00002000:00100000:0.0:1746129825.597871:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b8e4e00 x1830949054504576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.597879:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4e00 with x1830949054504576 ext(1048576->2097151) 00002000:00010000:0.0:1746129825.597884:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e4e00 00000100:00100000:1.0:1746129825.601795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.601933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.601957:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054505984 00000100:00100000:0.0:1746129825.601960:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054506240 00000100:00100000:1.0:1746129825.601963:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054505984 00000100:00100000:0.0:1746129825.601963:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054506240 00000100:00100000:0.0:1746129825.601994:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4661 00002000:00100000:1.0:1746129825.601995:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1515520->1519615) req@ffff88012b8e6d80 x1830949054505984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746129825.601999:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31732:x1830949054506240:12345-192.168.204.31@tcp:35:multiop.0 00002000:00100000:1.0:1746129825.602004:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6d80 with x1830949054505984 ext(1515520->1519615) 00002000:00010000:1.0:1746129825.602008:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6d80 00000100:00100000:1.0:1746129825.602023:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7102 00000100:00100000:1.0:1746129825.602028:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949054505984:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129825.602153:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949054505984:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 124us (364us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129825.602159:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7102 00002000:00100000:1.0:1746129825.602164:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1515520->1519615) req@ffff88012b8e6d80 x1830949054505984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.602170:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6d80 with x1830949054505984 ext(1515520->1519615) 00002000:00010000:1.0:1746129825.602172:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b8e6d80 00000100:00100000:0.0:1746129825.602186:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31732:x1830949054506240:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 187us (253us total) trans 8589945130 rc 0/0 00000100:00100000:0.0:1746129825.602192:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4661 00000100:00100000:3.0:1746129825.605955:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054505216:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21497us (21662us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.605966:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7099 00002000:00100000:3.0:1746129825.605975:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012d634a80 x1830949054505216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.605984:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d634a80 with x1830949054505216 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.605989:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d634a80 00000100:00100000:1.0:1746129825.606998:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.607368:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d635f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054505344:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 21779us (23042us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.607375:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7101 00002000:00100000:3.0:1746129825.607381:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012d635f80 x1830949054505344/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.607388:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d635f80 with x1830949054505344 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.607392:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d635f80 00000100:00100000:3.0:1746129825.607407:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054506496 00000100:00100000:3.0:1746129825.607413:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054506496 00002000:00100000:3.0:1746129825.607436:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012b8e4a80 x1830949054506496/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.607443:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4a80 with x1830949054506496 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.607445:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e4a80 00000100:00100000:3.0:1746129825.607456:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7103 00000100:00100000:3.0:1746129825.607460:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054506496:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129825.622360:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.622869:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054506752 00000100:00100000:0.0:1746129825.622877:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054506752 00000100:00100000:0.0:1746129825.622923:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4662 00000100:00100000:0.0:1746129825.622930:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31731:x1830949054506752:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129825.623129:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31731:x1830949054506752:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 198us (776us total) trans 8589945131 rc 0/0 00000100:00100000:0.0:1746129825.623135:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4662 00000100:00100000:0.0:1746129825.624877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.624911:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054507008 00000100:00100000:0.0:1746129825.624915:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054507008 00002000:00100000:0.0:1746129825.624942:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f6ec000 x1830949054507008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.624950:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ec000 with x1830949054507008 ext(2097152->3145727) 00002000:00010000:0.0:1746129825.624954:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ec000 00000100:00100000:0.0:1746129825.624969:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7104 00000100:00100000:0.0:1746129825.624975:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054507008:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129825.627405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.631589:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054506496:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 24120us (24584us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.631599:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7103 00002000:00100000:3.0:1746129825.631608:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012b8e4a80 x1830949054506496/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.631617:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e4a80 with x1830949054506496 ext(1048576->2097151) 00002000:00010000:3.0:1746129825.631622:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e4a80 00000100:00100000:2.0:1746129825.632879:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054507264 00000100:00100000:2.0:1746129825.632888:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054507264 00002000:00100000:2.0:1746129825.632918:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f6edc00 x1830949054507264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 504/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.632927:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6edc00 with x1830949054507264 ext(3145728->4194303) 00002000:00010000:2.0:1746129825.632931:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6edc00 00000100:00100000:3.0:1746129825.632933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.632960:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054507520 00000100:00100000:2.0:1746129825.632963:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054507520 00000100:00100000:3.0:1746129825.632972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:2.0:1746129825.632974:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012d637480 x1830949054507520/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.632980:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637480 with x1830949054507520 ext(2097152->3145727) 00002000:00010000:2.0:1746129825.632983:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637480 00000100:00100000:3.0:1746129825.632988:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054507776 00000100:00100000:3.0:1746129825.632990:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054507776 00000100:00100000:2.0:1746129825.632993:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7105 00000100:00100000:2.0:1746129825.632999:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054507264:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:3.0:1746129825.633007:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012d636680 x1830949054507776/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.633013:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636680 with x1830949054507776 ext(3145728->4194303) 00002000:00010000:3.0:1746129825.633016:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d636680 00000100:00100000:3.0:1746129825.633027:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7106 00000100:00100000:3.0:1746129825.633046:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054507520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129825.633404:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7107 00000100:00100000:0.0:1746129825.633411:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054507776:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.646959:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054507008:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21977us (22080us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.646970:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7104 00002000:00100000:3.0:1746129825.646981:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f6ec000 x1830949054507008/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.646990:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ec000 with x1830949054507008 ext(2097152->3145727) 00002000:00010000:3.0:1746129825.646995:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6ec000 00000100:00100000:0.0:1746129825.648401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.648753:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054507904 00000100:00100000:2.0:1746129825.648760:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054507904 00000100:00100000:2.0:1746129825.648792:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15809 00000100:00100000:2.0:1746129825.648798:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054507904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.648811:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.648823:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013083a000/0x48868a4e43955efa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356723 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.648970:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054084480:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129825.649237:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.649436:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1961:x1830949054507520:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16402us (16501us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.649443:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7106 00002000:00100000:3.0:1746129825.649450:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012d637480 x1830949054507520/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.649457:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d637480 with x1830949054507520 ext(2097152->3145727) 00002000:00010000:3.0:1746129825.649461:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d637480 00000100:00100000:2.0:1746129825.650983:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054507264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17980us (23578us total) trans 0 rc 397312/397312 00000100:00100000:2.0:1746129825.650992:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7105 00002000:00100000:2.0:1746129825.650999:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009f6edc00 x1830949054507264/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 504/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 397312/397312 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.651007:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6edc00 with x1830949054507264 ext(3145728->4194303) 00002000:00010000:2.0:1746129825.651011:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f6edc00 00000100:00100000:0.0:1746129825.651107:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d636680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054507776:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17694us (18132us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129825.651115:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7107 00002000:00100000:0.0:1746129825.651120:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012d636680 x1830949054507776/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.651127:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d636680 with x1830949054507776 ext(3145728->4194303) 00002000:00010000:0.0:1746129825.651130:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d636680 00002000:00010000:2.0:1746129825.656914:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129825.656921:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129825.656923:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129825.656935:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5605 -> 5609 00000100:00100000:2.0:1746129825.656944:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054084480:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129825.656971:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013083a000/0x48868a4e43955efa lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356723 expref: 31 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.656983:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013083a000/0x48868a4e43955efa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356723 expref: 31 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.656996:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013083a000, rc 0) 00000100:00100000:2.0:1746129825.657150:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054507904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8350us (8749us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129825.657158:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15809 00000100:00100000:3.0:1746129825.661243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.661275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.661301:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508032 00000100:00100000:0.0:1746129825.661310:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508032 00000100:00100000:0.0:1746129825.661339:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508160 00000100:00100000:2.0:1746129825.661406:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15810 00000100:00100000:2.0:1746129825.661415:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054508032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.661430:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.661444:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013083aa00/0x48868a4e43955f01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35672a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.661489:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054084608:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129825.661555:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129825.663030:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508160 00000100:00100000:0.0:1746129825.663150:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.663200:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508288 00000100:00100000:0.0:1746129825.663203:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508288 00000100:00100000:0.0:1746129825.663226:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15811 00000100:00100000:0.0:1746129825.663233:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31737:x1830949054508288:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129825.663242:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.663253:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356738 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.663272:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.663279:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129825.663280:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129825.663283:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 31 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.663305:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 27 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.663316:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 27 pid: 3623 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746129825.663325:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ada300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054084736:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.663363:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129825.663457:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15812 00000100:00100000:0.0:1746129825.663461:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054508160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129825.663469:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.663480:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43955f0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356731 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.663504:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054084864:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129825.663527:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2c00 going to sleep for 11 seconds 00002000:00010000:2.0:1746129825.665387:0:3623:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129825.665392:0:3623:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129825.665394:0:3623:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129824 -> 1746129826 00000100:00100000:2.0:1746129825.665412:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054084608:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129825.665432:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013083aa00/0x48868a4e43955f01 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35672a expref: 27 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.665675:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013083aa00/0x48868a4e43955f01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35672a expref: 27 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.665687:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013083aa00, rc 0) 00000100:00100000:2.0:1746129825.665721:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054508032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4307us (4484us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129825.665728:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15810 00000001:00080000:1.0:1746129825.665988:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841367 is committed 00000001:00080000:1.0:1746129825.665999:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841357 is committed 00000001:00080000:1.0:1746129825.666005:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841377 is committed 00000001:00080000:1.0:1746129825.666063:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841368 is committed 00000001:00080000:1.0:1746129825.666073:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841347 is committed 00000001:00080000:1.0:1746129825.666106:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841348 is committed 00000100:00100000:0.0:1746129825.666363:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ada300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054084736:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129825.666381:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 13 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.666392:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858800, rc 0) 00000100:00100000:0.0:1746129825.668329:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31737:x1830949054508288:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5091us (5174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.668338:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15811 00002000:00010000:0.0:1746129825.668864:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129824 -> 1746129826 00002000:00010000:0.0:1746129825.668867:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129824 -> 1746129826 00002000:00010000:0.0:1746129825.668870:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129824 -> 1746129826 00000100:00100000:0.0:1746129825.669025:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092ad9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054084864:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129825.669063:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43955f0f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356731 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129825.669074:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43955f0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356731 expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129825.669082:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859800, rc 0) 00000100:00100000:0.0:1746129825.669300:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054508160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5837us (8023us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129825.669305:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15812 00000100:00100000:0.0:1746129825.671634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.671791:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508416 00000100:00100000:2.0:1746129825.671798:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508416 00002000:00100000:2.0:1746129825.671833:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3473408->4124671) req@ffff880092ad9180 x1830949054508416/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.671842:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9180 with x1830949054508416 ext(3473408->4124671) 00010000:00010000:2.0:1746129825.671875:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 8 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746129825.671887:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 8 pid: 3623 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746129825.671894:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad9180 00000100:00100000:2.0:1746129825.671926:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1918 00000100:00100000:2.0:1746129825.671932:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1962:x1830949054508416:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129825.675434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.675538:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508544 00000100:00100000:0.0:1746129825.675545:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508544 00000100:00100000:0.0:1746129825.675575:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15813 00000100:00100000:0.0:1746129825.675582:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31736:x1830949054508544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129825.675595:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.675608:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35673f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.675628:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129825.675630:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129825.675634:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->4931583] (req 4194304->4931583) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.675647:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->4931583] (req 4194304->4931583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.675656:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a343000, rc 0) 00000100:00100000:0.0:1746129825.675687:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31736:x1830949054508544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 105us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.675692:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15813 00000100:00100000:2.0:1746129825.691264:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054508416:12345-192.168.204.31@tcp:4:cat.0 Request processed in 19324us (19628us total) trans 21474841387 rc 0/0 00000100:00100000:2.0:1746129825.691275:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1918 00002000:00100000:2.0:1746129825.691288:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3473408->4124671) req@ffff880092ad9180 x1830949054508416/t21474841387(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/448 e 0 to 0 dl 1746129836 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.691297:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9180 with x1830949054508416 ext(3473408->4124671) 00010000:00010000:2.0:1746129825.691305:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 11 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746129825.691318:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 11 pid: 3623 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746129825.691324:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092ad9180 00000100:00100000:0.0:1746129825.697059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.697409:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508672 00000100:00100000:1.0:1746129825.697418:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508672 00010000:00010000:1.0:1746129825.697449:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 11 pid: 3623 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746129825.697484:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7906 00000100:00100000:1.0:1746129825.697492:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1963:x1830949054508672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.697505:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.697523:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 11 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.697534:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 11 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.697552:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ec00/0x48868a4e43955eec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3473408->4124671) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356715 expref: 11 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.697565:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.697567:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.697573:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.697580:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.697587:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.697589:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.697592:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.697598:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.697625:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.697637:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054084992:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129825.697733:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.697742:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054085120:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129825.697761:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.700220:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054084992:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129825.700230:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054085120:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129825.700243:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.700271:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054508672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2779us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.700279:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7906 00000001:00080000:0.0:1746129825.705306:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874187 is committed 00000001:00080000:0.0:1746129825.705319:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874173 is committed 00000001:00080000:0.0:1746129825.705337:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874174 is committed 00000001:00080000:0.0:1746129825.705385:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874153 is committed 00000001:00080000:0.0:1746129825.705414:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874190 is committed 00000001:00080000:0.0:1746129825.705423:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874155 is committed 00000100:00100000:0.0:1746129825.711815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.712142:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054508928 00000100:00100000:2.0:1746129825.712150:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054508928 00002000:00100000:2.0:1746129825.712187:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880094a4ce00 x1830949054508928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.712197:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ce00 with x1830949054508928 ext(4194304->4931583) 00002000:00010000:2.0:1746129825.712203:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4ce00 00000100:00100000:2.0:1746129825.712235:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7108 00000100:00100000:2.0:1746129825.712243:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054508928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129825.719208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.719246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.719260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.719289:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054509184 00000100:00100000:3.0:1746129825.719297:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054509184 00000100:00100000:0.0:1746129825.719299:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.719317:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054509696 00000100:00100000:0.0:1746129825.719320:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054509696 00002000:00100000:3.0:1746129825.719334:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094a4f800 x1830949054509184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.719337:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094a4fb80 x1830949054509696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.719342:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4f800 with x1830949054509184 ext(2097152->3145727) 00002000:00100000:0.0:1746129825.719344:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4fb80 with x1830949054509696 ext(3145728->4194303) 00002000:00010000:3.0:1746129825.719347:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4f800 00002000:00010000:0.0:1746129825.719348:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4fb80 00000100:00100000:0.0:1746129825.719360:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054509568 00000100:00100000:0.0:1746129825.719362:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054509568 00000100:00100000:3.0:1746129825.719364:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054509952 00000100:00100000:3.0:1746129825.719366:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054509952 00002000:00100000:0.0:1746129825.719370:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094a4c380 x1830949054509568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.719376:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949054509568 ext(2097152->3145727) 00002000:00100000:3.0:1746129825.719377:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094a4e680 x1830949054509952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746129825.719378:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c380 00002000:00100000:3.0:1746129825.719383:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e680 with x1830949054509952 ext(3145728->4194303) 00002000:00010000:3.0:1746129825.719385:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e680 00000100:00100000:0.0:1746129825.719388:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7109 00000100:00100000:0.0:1746129825.719393:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054509696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.719398:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7110 00000100:00100000:3.0:1746129825.719403:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054509184:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129825.719476:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7111 00000100:00100000:1.0:1746129825.719484:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054509568:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129825.719523:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7112 00000100:00100000:0.0:1746129825.719529:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054509952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.729281:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054508928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17023us (17457us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129825.729291:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7108 00002000:00100000:3.0:1746129825.729307:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880094a4ce00 x1830949054508928/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.729317:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4ce00 with x1830949054508928 ext(4194304->4931583) 00002000:00010000:3.0:1746129825.729322:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4ce00 00000100:00100000:0.0:1746129825.729842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.729879:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510208 00000100:00100000:0.0:1746129825.729885:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510208 00000100:00100000:0.0:1746129825.729912:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11112 00000100:00100000:0.0:1746129825.729918:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31744:x1830949054510208:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129825.729933:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.729948:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5400/0x48868a4e43955f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356746 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.730082:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.730092:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.730903:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.730918:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.730927:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.730932:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732334:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732344:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732350:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:0.0:1746129825.732358:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129825.732426:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732431:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732436:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732440:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eca5000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129825.732443:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732448:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732456:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:0.0:1746129825.732459:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129825.732462:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732466:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5000/0x48868a4e43955f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732491:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732495:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732500:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732504:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008eca4e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:0.0:1746129825.732506:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732510:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732516:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009b005100) 00010000:00010000:0.0:1746129825.732517:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746129825.732519:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732522:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca4e00/0x48868a4e43955f2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129825.732566:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5400/0x48868a4e43955f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.732579:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 11 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.732584:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129825.732586:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129825.732588:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca5e00, rc 0) 00000100:00100000:0.0:1746129825.732629:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31744:x1830949054510208:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2710us (2788us total) trans 8589945132 rc 0/0 00000100:00100000:0.0:1746129825.732636:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11112 00000100:00100000:0.0:1746129825.733051:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054509952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13521us (13751us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129825.733058:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7112 00002000:00100000:0.0:1746129825.733065:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094a4e680 x1830949054509952/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.733073:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4e680 with x1830949054509952 ext(3145728->4194303) 00002000:00010000:0.0:1746129825.733077:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4e680 00000100:00100000:0.0:1746129825.737940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.737956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.738173:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510336 00000100:00100000:0.0:1746129825.738180:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510336 00000100:00100000:0.0:1746129825.738219:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510464 00000100:00100000:0.0:1746129825.738221:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510464 00000100:00100000:0.0:1746129825.738236:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15814 00000100:00100000:2.0:1746129825.738242:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15815 00000100:00100000:0.0:1746129825.738243:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054510336:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129825.738247:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054510464:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.738255:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.738255:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.738268:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a12ac00/0x48868a4e43955f47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356754 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.738268:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008eca5a00/0x48868a4e43955f40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35674d expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129825.738282:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054509184:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18877us (19080us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.738290:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7110 00002000:00100000:3.0:1746129825.738298:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094a4f800 x1830949054509184/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129825.738302:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054085248:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129825.738302:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054085376:192.168.204.31@tcp:106: 00002000:00100000:3.0:1746129825.738307:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4f800 with x1830949054509184 ext(2097152->3145727) 00002000:00010000:3.0:1746129825.738311:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094a4f800 00000100:00100000:2.0:1746129825.738347:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.738356:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.742553:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054509568:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23062us (23284us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129825.742563:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7111 00002000:00100000:1.0:1746129825.742573:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094a4c380 x1830949054509568/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.742582:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4c380 with x1830949054509568 ext(2097152->3145727) 00002000:00010000:1.0:1746129825.742587:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4c380 00000100:00100000:2.0:1746129825.743003:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:3623:1830949054085248:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129825.743029:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a12ac00/0x48868a4e43955f47 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356754 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.743053:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a12ac00/0x48868a4e43955f47 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356754 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.743061:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12ac00, rc 0) 00000100:00100000:2.0:1746129825.743086:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054510464:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4837us (5127us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129825.743092:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15815 00000100:00100000:2.0:1746129825.743127:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054085376:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129825.743140:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008eca5a00/0x48868a4e43955f40 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35674d expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.743148:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008eca5a00/0x48868a4e43955f40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35674d expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.743155:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008eca5a00, rc 0) 00000100:00100000:2.0:1746129825.743170:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054510336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4928us (5239us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129825.743174:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15814 00000100:00100000:0.0:1746129825.746945:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054509696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 27543us (27689us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129825.746955:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7109 00002000:00100000:0.0:1746129825.746965:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880094a4fb80 x1830949054509696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.746973:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4fb80 with x1830949054509696 ext(3145728->4194303) 00002000:00010000:0.0:1746129825.746977:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094a4fb80 00000100:00100000:0.0:1746129825.751149:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.751194:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.751199:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510592 00000100:00100000:2.0:1746129825.751207:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510592 00000100:00100000:2.0:1746129825.751252:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510720 00000100:00100000:2.0:1746129825.751255:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510720 00000100:00100000:2.0:1746129825.751289:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15816 00000100:00100000:2.0:1746129825.751297:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054510592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.751312:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.751328:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683f200/0x48868a4e43955f4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35675b expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.751373:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054085504:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129825.751439:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15817 00000100:00100000:1.0:1746129825.751446:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054510720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.751454:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.751463:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e43955f55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356762 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.751488:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054085632:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129825.751490:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.751511:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.753900:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054085504:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129825.753900:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054085632:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129825.753926:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683f200/0x48868a4e43955f4e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35675b expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.753926:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e43955f55 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356762 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.753937:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3e00/0x48868a4e43955f55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356762 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.753938:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683f200/0x48868a4e43955f4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35675b expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.753947:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683f200, rc 0) 00010000:00010000:1.0:1746129825.753960:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3e00, rc 0) 00000100:00100000:2.0:1746129825.753989:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054510592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2692us (2846us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129825.753997:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15816 00000100:00100000:1.0:1746129825.754340:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1961:x1830949054510720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2893us (3144us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129825.754345:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15817 00000100:00100000:0.0:1746129825.755648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.755710:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510848 00000100:00100000:1.0:1746129825.755716:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510848 00000100:00100000:1.0:1746129825.755751:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15818 00000100:00100000:1.0:1746129825.755758:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:31744:x1830949054510848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129825.755769:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.755780:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356769 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.755801:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.755807:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129825.755809:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129825.755812:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1888256->2097151] (req 1888256->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.755835:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 19 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.755845:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 19 pid: 3623 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746129825.755873:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054085760:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129825.755933:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.757983:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054085760:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129825.758002:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1888256->2097151] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.758013:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b2c00, rc 0) 00000100:00100000:1.0:1746129825.758070:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31744:x1830949054510848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2311us (2423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.758076:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15818 00000100:00100000:0.0:1746129825.758737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.761637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.761714:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054510976 00000100:00100000:1.0:1746129825.761722:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054510976 00002000:00100000:1.0:1746129825.761767:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1519615) req@ffff880094a4f480 x1830949054510976/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.761776:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4f480 with x1830949054510976 ext(1048576->1519615) 00010000:00010000:1.0:1746129825.761784:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 20 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.761796:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 20 pid: 3623 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746129825.761802:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a4f480 00000100:00100000:0.0:1746129825.761906:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.761923:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054511488 00000100:00100000:0.0:1746129825.761926:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054511488 00000100:00100000:0.0:1746129825.761947:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4663 00000100:00100000:0.0:1746129825.761954:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31736:x1830949054511488:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129825.762125:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31736:x1830949054511488:12345-192.168.204.31@tcp:35:cat.0 Request processed in 170us (218us total) trans 8589945133 rc 0/0 00000100:00100000:0.0:1746129825.762131:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4663 00000100:00100000:2.0:1746129825.762611:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054511232 00000100:00100000:2.0:1746129825.762615:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054511232 00002000:00100000:2.0:1746129825.762632:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa0380 x1830949054511232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.762639:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0380 with x1830949054511232 ext(4194304->4931583) 00002000:00010000:2.0:1746129825.762643:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0380 00000100:00100000:1.0:1746129825.762643:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1919 00000100:00100000:1.0:1746129825.762649:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054510976:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129825.762663:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7113 00000100:00100000:2.0:1746129825.762667:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949054511232:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129825.769179:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949054511232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6502us (7539us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129825.769190:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7113 00002000:00100000:3.0:1746129825.769200:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009faa0380 x1830949054511232/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.769210:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa0380 with x1830949054511232 ext(4194304->4931583) 00002000:00010000:3.0:1746129825.769215:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009faa0380 00000100:00100000:1.0:1746129825.771197:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094a4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054510976:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8541us (12453us total) trans 17179874191 rc 0/0 00000100:00100000:1.0:1746129825.771207:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1919 00002000:00100000:1.0:1746129825.771217:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1519615) req@ffff880094a4f480 x1830949054510976/t17179874191(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/448 e 0 to 0 dl 1746129836 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.771225:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094a4f480 with x1830949054510976 ext(1048576->1519615) 00010000:00010000:1.0:1746129825.771234:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 22 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.771246:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 22 pid: 3623 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746129825.771252:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880094a4f480 00000100:00100000:0.0:1746129825.775023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.775202:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.775262:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054511744 00000100:00100000:2.0:1746129825.775269:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054511744 00000100:00100000:1.0:1746129825.775286:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054511616 00000100:00100000:1.0:1746129825.775290:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054511616 00010000:00010000:2.0:1746129825.775294:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 23 pid: 3623 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746129825.775724:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7907 00000100:00100000:2.0:1746129825.775730:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054511744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129825.775739:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129825.775755:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 23 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746129825.775763:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 23 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746129825.775779:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013083ae00/0x48868a4e43955ef3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1519615) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35671c expref: 23 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746129825.775804:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.775805:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129825.775810:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.775815:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.775840:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129825.775867:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054085888:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129825.775919:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.775980:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15819 00000100:00100000:1.0:1746129825.775987:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054511616:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.775997:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.776009:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43955f63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356770 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.776051:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054086016:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129825.776073:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.778448:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054085888:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129825.778462:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.778479:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054086016:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129825.778490:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054511744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2759us (3287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.778498:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7907 00010000:00010000:1.0:1746129825.778500:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43955f63 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356770 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.778512:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b3600/0x48868a4e43955f63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356770 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.778539:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801360b3600, rc 0) 00000100:00100000:1.0:1746129825.778559:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054511616:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2573us (3543us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129825.778565:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15819 00000100:00100000:0.0:1746129825.779437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.779643:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512000 00000100:00100000:1.0:1746129825.779649:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512000 00002000:00100000:1.0:1746129825.779680:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1888256->1892351) req@ffff88009faa3b80 x1830949054512000/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.779688:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3b80 with x1830949054512000 ext(1888256->1892351) 00002000:00010000:1.0:1746129825.779693:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa3b80 00000100:00100000:1.0:1746129825.779718:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7114 00000100:00100000:1.0:1746129825.779724:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054512000:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129825.779896:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054512000:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 171us (461us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129825.779902:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7114 00002000:00100000:1.0:1746129825.779907:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1888256->1892351) req@ffff88009faa3b80 x1830949054512000/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.779914:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009faa3b80 with x1830949054512000 ext(1888256->1892351) 00002000:00010000:1.0:1746129825.779916:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009faa3b80 00000100:00100000:0.0:1746129825.782265:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.782332:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512128 00000100:00100000:1.0:1746129825.782339:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512128 00000100:00100000:1.0:1746129825.782593:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15820 00000100:00100000:1.0:1746129825.782601:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054512128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.782616:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.782630:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c14a00/0x48868a4e43955f6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356777 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.782676:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054086144:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129825.782755:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129825.788813:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.789022:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512256 00000100:00100000:3.0:1746129825.789039:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512256 00000100:00100000:3.0:1746129825.789089:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15821 00000100:00100000:3.0:1746129825.789096:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31744:x1830949054512256:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:1.0:1746129825.789103:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054086144:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129825.789110:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.789124:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35677e expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.789125:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c14a00/0x48868a4e43955f6a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356777 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.789136:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c14a00/0x48868a4e43955f6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356777 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.789150:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 6 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.789157:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.789161:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c14a00, rc 0) 00010000:00010000:3.0:1746129825.789163:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.789168:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.789169:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129825.789172:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1048576->1105919] (req 1048576->1105919) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.789195:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129825.789198:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054512128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6597us (6940us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129825.789203:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15820 00010000:00010000:3.0:1746129825.789209:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.789220:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054086272:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.789280:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.789288:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.789295:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054086400:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.789317:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 6 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.789324:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 6 pid: 3624 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.789330:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054086528:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.789349:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.790784:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054086272:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.791494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.791549:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512384 00000100:00100000:2.0:1746129825.791554:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512384 00010000:00010000:2.0:1746129825.791578:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746129825.791614:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7908 00000100:00100000:2.0:1746129825.791620:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054512384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129825.791630:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129825.791646:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.791656:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.791677:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a022c400/0x48868a4e43955e0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35667b expref: 21 pid: 8436 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746129825.791704:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129825.791740:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1963:x1830949054512384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 120us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.791746:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7908 00000100:00100000:3.0:1746129825.793232:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054086400:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.793242:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054086528:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.793270:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->1105919] (req 1048576->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.793283:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1000, rc 0) 00000100:00100000:3.0:1746129825.793322:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31744:x1830949054512256:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4226us (4517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.793328:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15821 00000100:00100000:0.0:1746129825.795942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.795981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.796020:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512512 00000100:00100000:3.0:1746129825.796026:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512512 00010000:00010000:3.0:1746129825.796066:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 7 pid: 3624 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.796092:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512640 00000100:00100000:3.0:1746129825.796094:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512640 00010000:00010000:3.0:1746129825.796104:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746129825.796119:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7909 00000100:00100000:3.0:1746129825.796125:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054512512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.796137:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.796155:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 7 pid: 3624 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746129825.796171:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 7 pid: 3624 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746129825.796192:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5244200/0x48868a4e43955d4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356643 expref: 7 pid: 3624 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746129825.796208:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129825.796238:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054512512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 112us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.796243:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7909 00000100:00100000:1.0:1746129825.796280:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7910 00000100:00100000:1.0:1746129825.796287:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1964:x1830949054512640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.796295:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.796304:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.796312:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.796327:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a022d600/0x48868a4e43955e67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c1 expref: 9 pid: 10930 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746129825.796339:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.796341:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.796346:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 8 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.796353:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 8 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.796379:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 8 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.796389:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054086656:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129825.796427:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.797065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.797170:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054512896 00000100:00100000:0.0:1746129825.797174:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054512896 00000100:00100000:0.0:1746129825.797209:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4664 00000100:00100000:0.0:1746129825.797214:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012babd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31737:x1830949054512896:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129825.797374:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012babd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31737:x1830949054512896:12345-192.168.204.31@tcp:35:cat.0 Request processed in 159us (309us total) trans 8589945134 rc 0/0 00000100:00100000:0.0:1746129825.797380:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4664 00000100:00100000:1.0:1746129825.798984:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054086656:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129825.798996:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.799043:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054512640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2755us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.799051:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7910 00000100:00100000:0.0:1746129825.804429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.804539:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054513152 00000100:00100000:3.0:1746129825.804547:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054513152 00002000:00100000:3.0:1746129825.804588:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1101824->1105919) req@ffff880094d8f800 x1830949054513152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.804603:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f800 with x1830949054513152 ext(1101824->1105919) 00002000:00010000:3.0:1746129825.804607:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f800 00000100:00100000:3.0:1746129825.804636:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7115 00000100:00100000:3.0:1746129825.804643:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054513152:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129825.804841:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054513152:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 198us (419us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129825.804867:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7115 00002000:00100000:3.0:1746129825.804873:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1101824->1105919) req@ffff880094d8f800 x1830949054513152/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/4536 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.804879:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f800 with x1830949054513152 ext(1101824->1105919) 00002000:00010000:3.0:1746129825.804882:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8f800 00000100:00100000:0.0:1746129825.809315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.809407:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054513408 00000100:00100000:2.0:1746129825.809414:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054513408 00000100:00100000:2.0:1746129825.809447:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4665 00000100:00100000:2.0:1746129825.809454:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31744:x1830949054513408:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129825.809964:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31744:x1830949054513408:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 508us (656us total) trans 8589945135 rc 0/0 00000100:00100000:2.0:1746129825.809972:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4665 00000100:00100000:0.0:1746129825.844448:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.844603:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054513664 00000100:00100000:2.0:1746129825.844611:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054513664 00000100:00100000:2.0:1746129825.844709:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11113 00000100:00100000:2.0:1746129825.844717:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31749:x1830949054513664:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129825.844735:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.844750:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43955f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356785 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.844838:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845321:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845332:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845345:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845350:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845354:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845448:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845455:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845460:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129825.845468:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129825.845537:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845543:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845548:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845555:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12b800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129825.845558:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845564:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845573:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129825.845575:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129825.845578:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.845582:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b800/0x48868a4e43955f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846951:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846960:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846965:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846970:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a12ba00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129825.846973:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846978:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846988:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29a500) 00010000:00010000:2.0:1746129825.846990:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129825.846993:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.846997:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12ba00/0x48868a4e43955f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.847050:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12bc00/0x48868a4e43955f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 287 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.847061:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 286 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.847067:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.847069:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129825.847071:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12b600, rc 0) 00000100:00100000:2.0:1746129825.848343:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31749:x1830949054513664:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3622us (3897us total) trans 8589945136 rc 0/0 00000100:00100000:2.0:1746129825.848352:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11113 00000100:00100000:0.0:1746129825.880462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.880667:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054513920 00000100:00100000:2.0:1746129825.880675:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054513920 00000100:00100000:2.0:1746129825.882727:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11114 00000100:00100000:2.0:1746129825.882741:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31752:x1830949054513920:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.882762:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.882778:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12be00/0x48868a4e43955f9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35678c expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.882868:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.882879:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129825.882888:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129825.882897:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129825.882987:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12be00/0x48868a4e43955f9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.883019:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.883026:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.883041:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129825.883046:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a12a200, rc 0) 00000100:00100000:2.0:1746129825.883103:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31752:x1830949054513920:12345-192.168.204.31@tcp:101:cat.0 Request processed in 367us (2647us total) trans 8589945137 rc 0/0 00000100:00100000:2.0:1746129825.883109:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11114 00000100:00100000:0.0:1746129825.886200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.886471:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514048 00000100:00100000:3.0:1746129825.886478:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514048 00000100:00100000:3.0:1746129825.886527:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15822 00000100:00100000:3.0:1746129825.886535:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054514048:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129825.886549:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.886562:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ea1e00/0x48868a4e43955fb0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356793 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129825.886607:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054086784:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129825.886680:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.891690:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054086784:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129825.891726:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ea1e00/0x48868a4e43955fb0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356793 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.891741:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ea1e00/0x48868a4e43955fb0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356793 expref: 11 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129825.891769:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1e00, rc 0) 00000100:00100000:3.0:1746129825.893200:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054514048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6661us (7002us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129825.893208:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15822 00000100:00100000:2.0:1746129825.895684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.896148:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514176 00000100:00100000:3.0:1746129825.896156:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514176 00000100:00100000:3.0:1746129825.898617:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15823 00000100:00100000:3.0:1746129825.898633:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31752:x1830949054514176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129825.898649:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.898664:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35679a expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.898687:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.898694:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129825.898696:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129825.898699:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.898722:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 12 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.898737:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 12 pid: 3623 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746129825.898748:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054086912:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129825.903162:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129825.913172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.913258:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514304 00000100:00100000:1.0:1746129825.913265:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514304 00002000:00100000:1.0:1746129825.913301:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (749568->1048575) req@ffff88012b8e6a00 x1830949054514304/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.913318:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6a00 with x1830949054514304 ext(749568->1048575) 00010000:00010000:1.0:1746129825.913326:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 13 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.913338:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 13 pid: 3623 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746129825.913345:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b8e6a00 00000100:00100000:3.0:1746129825.913418:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054086912:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129825.913444:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.913457:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1200, rc 0) 00000100:00100000:1.0:1746129825.913811:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1920 00000100:00100000:1.0:1746129825.913818:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1963:x1830949054514304:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129825.914043:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31752:x1830949054514176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 15416us (18363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.914050:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15823 00000100:00100000:0.0:1746129825.927966:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054514304:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14134us (14788us total) trans 21474841388 rc 0/0 00000100:00100000:0.0:1746129825.927980:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1920 00002000:00100000:0.0:1746129825.927990:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (749568->1048575) req@ffff88012b8e6a00 x1830949054514304/t21474841388(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/448 e 0 to 0 dl 1746129836 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.927999:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e6a00 with x1830949054514304 ext(749568->1048575) 00010000:00010000:0.0:1746129825.928007:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 15 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746129825.928022:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 15 pid: 3623 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746129825.928038:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b8e6a00 00000100:00100000:0.0:1746129825.932318:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.933914:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514560 00000100:00100000:1.0:1746129825.933924:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514560 00010000:00010000:1.0:1746129825.933960:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 15 pid: 3623 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746129825.934575:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7911 00000100:00100000:1.0:1746129825.934583:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054514560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.934595:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.934614:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 15 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.934626:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 15 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.934643:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093361a00/0x48868a4e43955ed7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 749568->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356707 expref: 15 pid: 3623 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746129825.934671:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.934673:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.934679:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.934686:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.934716:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 10 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.934727:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054087040:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129825.935147:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.935630:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129825.935775:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514688 00000100:00100000:3.0:1746129825.935780:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514688 00000100:00100000:3.0:1746129825.935820:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11115 00000100:00100000:3.0:1746129825.935826:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31756:x1830949054514688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129825.935843:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129825.935871:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea0a00/0x48868a4e43955fbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567a1 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.935946:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.935960:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129825.935970:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129825.935979:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129825.936080:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea0a00/0x48868a4e43955fbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 289 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.936103:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 288 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129825.936110:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.936112:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746129825.936114:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1800, rc 0) 00000100:00100000:3.0:1746129825.936140:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31756:x1830949054514688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 313us (993us total) trans 8589945138 rc 0/0 00000100:00100000:3.0:1746129825.936145:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11115 00000100:00100000:1.0:1746129825.939346:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054087040:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129825.939364:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.939411:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130567050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054514560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4827us (7098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.939421:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7911 00000100:00100000:0.0:1746129825.939982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.940000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.940020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.940093:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514816 00000100:00100000:1.0:1746129825.940098:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514816 00000100:00100000:1.0:1746129825.940119:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054514944 00000100:00100000:1.0:1746129825.940120:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054514944 00000100:00100000:1.0:1746129825.940129:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054515072 00000100:00100000:1.0:1746129825.940131:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054515072 00000100:00100000:1.0:1746129825.940142:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15824 00000100:00100000:1.0:1746129825.940147:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054514816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.940160:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.940171:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567a8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129825.940187:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.940189:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129825.940195:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.940207:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.940215:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2c00, rc 0) 00000100:00100000:1.0:1746129825.940235:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054514816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129825.940239:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15825 00000100:00100000:0.0:1746129825.940246:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054514944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129825.940254:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.940263:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e43955fda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567af expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129825.940297:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054087168:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129825.940339:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129825.940619:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15824 00000100:00100000:1.0:1746129825.940631:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15826 00000100:00100000:1.0:1746129825.940637:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054515072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129825.940652:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129825.940660:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3a00/0x48868a4e43955fe1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567b6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129825.940680:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054087296:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129825.940701:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584540 going to sleep for 11 seconds 00002000:00010000:1.0:1746129825.941922:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129824 -> 1746129826 00002000:00010000:1.0:1746129825.941927:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129824 -> 1746129826 00002000:00010000:1.0:1746129825.941928:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129824 -> 1746129826 00000100:00100000:2.0:1746129825.941942:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093288380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054087168:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129825.941942:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f908a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054087296:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129825.941958:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e43955fda lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567af expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.941958:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3a00/0x48868a4e43955fe1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567b6 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129825.941967:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c0ff000/0x48868a4e43955fda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567af expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.941967:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3a00/0x48868a4e43955fe1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567b6 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129825.941985:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3a00, rc 0) 00010000:00010000:2.0:1746129825.941991:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0ff000, rc 0) 00000100:00100000:1.0:1746129825.942007:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054515072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1370us (1986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129825.942010:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009faa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054514944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1765us (2008us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129825.942012:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15826 00000100:00100000:2.0:1746129825.942018:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15825 00000100:00100000:0.0:1746129825.943717:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.943752:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.943787:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129825.943911:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054515456 00000100:00100000:3.0:1746129825.943918:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054515456 00002000:00100000:3.0:1746129825.943952:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880093288000 x1830949054515456/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.943960:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949054515456 ext(0->1048575) 00002000:00010000:3.0:1746129825.943964:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288000 00000100:00100000:3.0:1746129825.943976:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054515712 00000100:00100000:3.0:1746129825.943978:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054515712 00002000:00100000:3.0:1746129825.943989:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1105920->2097151) req@ffff880093288380 x1830949054515712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.943995:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949054515712 ext(1105920->2097151) 00002000:00010000:3.0:1746129825.943998:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288380 00000100:00100000:3.0:1746129825.944005:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054515584 00000100:00100000:3.0:1746129825.944007:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054515584 00002000:00100000:3.0:1746129825.944015:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1888255) req@ffff880095241f80 x1830949054515584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.944021:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949054515584 ext(1048576->1888255) 00002000:00010000:3.0:1746129825.944024:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095241f80 00000100:00100000:3.0:1746129825.944046:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7116 00000100:00100000:3.0:1746129825.944052:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054515456:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129825.944163:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7117 00000100:00100000:1.0:1746129825.944171:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054515712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129825.944517:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7118 00000100:00100000:2.0:1746129825.944524:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054515584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129825.945530:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.945546:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054516096 00000100:00100000:0.0:1746129825.945549:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054516096 00000100:00100000:0.0:1746129825.945573:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11116 00000100:00100000:0.0:1746129825.945578:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31757:x1830949054516096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129825.945589:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129825.945604:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fec00/0x48868a4e43955fe8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567bd expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.945672:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.945682:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.945688:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 287 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.945693:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129825.945714:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 287 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.945724:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 287 pid: 14313 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746129825.945734:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095243800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054087424:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129825.945790:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129825.945796:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 16 pid: 14313 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746129825.945803:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095243480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054087552:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.945818:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129825.945843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129825.945933:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054516352 00000100:00100000:0.0:1746129825.945936:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054516352 00002000:00100000:0.0:1746129825.945954:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880095240000 x1830949054516352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129825.945961:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240000 with x1830949054516352 ext(0->1048575) 00002000:00010000:0.0:1746129825.945965:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095240000 00000100:00100000:0.0:1746129825.945978:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7119 00000100:00100000:0.0:1746129825.945983:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054516352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129825.953765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129825.953814:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054516480 00000100:00100000:1.0:1746129825.953821:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054516480 00010000:00010000:1.0:1746129825.953875:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 288 pid: 14313 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129825.953912:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7912 00000100:00100000:1.0:1746129825.953920:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1964:x1830949054516480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129825.953933:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129825.953938:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 288 pid: 14313 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129825.953949:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 288 pid: 14313 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129825.953972:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129825.953976:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129825.953983:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129825.953989:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129825.954038:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:1964:x1830949054516480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129825.954045:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7912 00010000:00010000:2.0:1746129825.954130:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12b600/0x48868a4e43955f8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356785 expref: 287 pid: 14313 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129825.954154:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095243800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054087424:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129825.963817:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.963875:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095243480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054087552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129825.963896:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129825.963967:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054516608 00000100:00100000:3.0:1746129825.963973:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054516608 00010000:00010000:3.0:1746129825.964000:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 17 pid: 14313 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129825.964021:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7913 00000100:00100000:3.0:1746129825.964035:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054516608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129825.964046:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129825.964050:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 17 pid: 14313 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129825.964059:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 17 pid: 14313 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129825.964076:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eca5e00/0x48868a4e43955f32 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356746 expref: 17 pid: 14313 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129825.964090:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129825.964094:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.964101:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.964107:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129825.964122:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129825.964153:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054516608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 127us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129825.964159:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7913 00000100:00100000:2.0:1746129825.965652:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054515584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21124us (21859us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746129825.965661:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7118 00002000:00100000:2.0:1746129825.965669:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1888255) req@ffff880095241f80 x1830949054515584/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129825.965678:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241f80 with x1830949054515584 ext(1048576->1888255) 00002000:00010000:2.0:1746129825.965693:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095241f80 00010000:00010000:2.0:1746129825.965728:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129825.965735:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129825.965758:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:1.0:1746129825.965771:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054516352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19786us (19925us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129825.965778:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7119 00002000:00100000:1.0:1746129825.965783:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880095240000 x1830949054516352/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.965790:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095240000 with x1830949054516352 ext(0->1048575) 00002000:00010000:1.0:1746129825.965793:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095240000 00010000:00010000:2.0:1746129825.965898:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fec00/0x48868a4e43955fe8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.965923:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.965930:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129825.965932:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129825.965935:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c0fe800, rc 0) 00000100:00100000:1.0:1746129825.966232:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054515712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22062us (22479us total) trans 0 rc 991232/991232 00000100:00100000:1.0:1746129825.966238:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7117 00002000:00100000:1.0:1746129825.966243:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1105920->2097151) req@ffff880093288380 x1830949054515712/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 991232/991232 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129825.966249:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949054515712 ext(1105920->2097151) 00002000:00010000:1.0:1746129825.966252:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288380 00000100:00100000:2.0:1746129825.967286:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31757:x1830949054516096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 21705us (21756us total) trans 8589945139 rc 0/0 00000100:00100000:2.0:1746129825.967292:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11116 00000100:00100000:3.0:1746129825.969474:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054515456:12345-192.168.204.31@tcp:3:cat.0 Request processed in 25417us (25755us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129825.969482:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7116 00002000:00100000:3.0:1746129825.969490:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880093288000 x1830949054515456/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129825.969499:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949054515456 ext(0->1048575) 00002000:00010000:3.0:1746129825.969503:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288000 00000100:00100000:0.0:1746129825.991588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129825.992815:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054516736 00000100:00100000:2.0:1746129825.992827:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054516736 00000100:00100000:2.0:1746129825.993695:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15827 00000100:00100000:2.0:1746129825.993704:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31756:x1830949054516736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129825.993720:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129825.993734:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567c4 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.993758:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.993765:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129825.993766:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129825.993770:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.993838:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.993863:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 7 pid: 8437 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129825.993874:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054087680:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129825.994982:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129825.997044:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054087680:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129825.997067:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129825.997078:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4af800, rc 0) 00000100:00100000:2.0:1746129825.997110:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31756:x1830949054516736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3408us (5529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129825.997117:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15827 00000100:00100000:0.0:1746129825.998113:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.000387:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.000416:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054517120 00000100:00100000:3.0:1746129826.000423:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054517120 00002000:00100000:3.0:1746129826.000475:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a01ba300 x1830949054517120/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/0 e 0 to 0 dl 1746129836 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.000483:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01ba300 with x1830949054517120 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.000487:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01ba300 00000100:00100000:3.0:1746129826.000506:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7120 00000100:00100000:3.0:1746129826.000516:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054517120:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:2.0:1746129826.001041:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129826.001276:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054517248 00000100:00100000:0.0:1746129826.001281:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054517248 00002000:00100000:0.0:1746129826.001298:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008f908a80 x1830949054517248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129826.001306:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f908a80 with x1830949054517248 ext(3145728->4194303) 00002000:00010000:0.0:1746129826.001309:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f908a80 00000100:00100000:1.0:1746129826.001320:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.001466:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054516864 00000100:00100000:0.0:1746129826.001470:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054516864 00002000:00100000:0.0:1746129826.001489:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1888256->2097151) req@ffff88008f90b100 x1830949054516864/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129826.001495:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b100 with x1830949054516864 ext(1888256->2097151) 00010000:00010000:0.0:1746129826.001501:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 8 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746129826.001518:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 8 pid: 8437 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746129826.001524:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f90b100 00000100:00100000:0.0:1746129826.001536:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1921 00000100:00100000:0.0:1746129826.001541:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1964:x1830949054516864:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129826.001741:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7121 00000100:00100000:0.0:1746129826.001747:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054517248:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:2.0:1746129826.001779:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746129826.011021:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f90b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1964:x1830949054516864:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9473us (9694us total) trans 17179874192 rc 0/0 00000100:00100000:2.0:1746129826.011041:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1921 00002000:00100000:2.0:1746129826.011051:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1888256->2097151) req@ffff88008f90b100 x1830949054516864/t17179874192(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.011058:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f90b100 with x1830949054516864 ext(1888256->2097151) 00010000:00010000:2.0:1746129826.011067:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 10 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.011084:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 10 pid: 8437 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.011090:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f90b100 00000100:00100000:3.0:1746129826.015329:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054517120:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14810us (17210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.015339:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7120 00002000:00100000:3.0:1746129826.015347:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800a01ba300 x1830949054517120/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:566/0 lens 488/440 e 0 to 0 dl 1746129836 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.015355:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01ba300 with x1830949054517120 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.015360:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01ba300 00000100:00100000:0.0:1746129826.015684:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.015705:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054517504 00000100:00100000:0.0:1746129826.015711:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054517504 00010000:00010000:0.0:1746129826.015733:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 10 pid: 8437 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746129826.015766:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7914 00000100:00100000:0.0:1746129826.015772:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054517504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129826.015782:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129826.015798:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 10 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746129826.015808:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 10 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746129826.015827:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801360b2c00/0x48868a4e43955f5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1888256->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356769 expref: 10 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746129826.015842:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129826.015844:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129826.015868:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.015875:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.015898:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.015907:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054087808:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.015941:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054517248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14193us (15558us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.015948:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7121 00000100:00100000:0.0:1746129826.015950:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00002000:00100000:2.0:1746129826.015953:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008f908a80 x1830949054517248/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.015960:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f908a80 with x1830949054517248 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.015963:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f908a80 00000100:00100000:0.0:1746129826.024237:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.024299:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054517632 00000100:00100000:2.0:1746129826.024307:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054517632 00000100:00100000:2.0:1746129826.024363:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15828 00000100:00100000:2.0:1746129826.024370:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31757:x1830949054517632:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.024384:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.024399:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567cb expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.024431:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.024438:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.024448:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.024449:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.024453:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.024478:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.024494:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.024505:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054087936:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.024593:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.024601:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 14 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.024610:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054088064:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.024635:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.025215:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054087808:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.025227:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.025261:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054517504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9488us (9578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.025272:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7914 00000100:00100000:0.0:1746129826.035764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.035801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.035828:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054517888 00000100:00100000:2.0:1746129826.035836:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054517888 00002000:00100000:2.0:1746129826.035908:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a01b8000 x1830949054517888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.035916:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8000 with x1830949054517888 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.035926:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b8000 00000100:00100000:2.0:1746129826.035942:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7122 00000100:00100000:2.0:1746129826.035948:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054517888:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.036188:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054518016 00000100:00100000:1.0:1746129826.036192:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054518016 00000100:00100000:1.0:1746129826.036224:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15829 00000100:00100000:1.0:1746129826.036229:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054518016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.036236:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.036248:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567d2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.036262:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.036264:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.036270:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.036281:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.036290:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335c00, rc 0) 00000100:00100000:1.0:1746129826.036323:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054518016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 95us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.036328:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15829 00000100:00080000:3.0:1746129826.036425:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129826.036472:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054087936:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.036480:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054088064:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.036498:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3883008->4194303] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.036511:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e315600, rc 0) 00000100:00100000:1.0:1746129826.036526:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31757:x1830949054517632:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 12158us (12297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.036531:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15828 00000100:00100000:0.0:1746129826.040090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.040135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.040191:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054518144 00000100:00100000:3.0:1746129826.040198:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054518144 00000100:00100000:2.0:1746129826.040213:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054518272 00000100:00100000:2.0:1746129826.040217:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054518272 00010000:00010000:3.0:1746129826.040228:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.040252:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7915 00000100:00100000:3.0:1746129826.040258:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054518144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.040268:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.040283:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.040293:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.040313:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012a343000/0x48868a4e43955f16 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35673f expref: 12 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.040329:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.040515:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054518144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 256us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.040521:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7915 00010000:00010000:2.0:1746129826.040704:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.040734:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7916 00000100:00100000:2.0:1746129826.040739:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054518272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.040745:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.040754:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.040763:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.040834:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f858800/0x48868a4e43955f08 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356738 expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.040871:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.040873:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.040880:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.040887:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.040912:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.040923:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054088192:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.041227:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00080000:1.0:1746129826.041406:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129826.043222:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.043272:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054517888:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7322us (7512us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.043280:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7122 00002000:00100000:2.0:1746129826.043288:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a01b8000 x1830949054517888/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.043296:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8000 with x1830949054517888 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.043300:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b8000 00000100:00100000:1.0:1746129826.043386:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054518400 00000100:00100000:1.0:1746129826.043392:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054518400 00000100:00100000:1.0:1746129826.043429:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15830 00000100:00100000:1.0:1746129826.043435:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31752:x1830949054518400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.043446:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.043456:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567d9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.043473:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.043480:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.043481:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.043484:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4194304->4931583] (req 4194304->4931583) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.043503:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.043512:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.043526:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054088320:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.043568:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.043886:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054088192:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.043897:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.043915:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1964:x1830949054518272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3177us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.043925:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7916 00000100:00100000:0.0:1746129826.045711:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.045999:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054518656 00000100:00100000:2.0:1746129826.046005:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054518656 00002000:00100000:2.0:1746129826.046039:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3883008->3887103) req@ffff88013631a680 x1830949054518656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.046047:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631a680 with x1830949054518656 ext(3883008->3887103) 00010000:00010000:2.0:1746129826.046054:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.046064:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.046070:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013631a680 00000100:00100000:2.0:1746129826.046095:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1922 00000100:00100000:2.0:1746129826.046101:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054518656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.046176:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054088320:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.046189:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4931583] (req 4194304->4931583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.046200:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335400, rc 0) 00000100:00100000:1.0:1746129826.046224:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31752:x1830949054518400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2790us (3007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.046629:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15830 00000100:00100000:2.0:1746129826.046757:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054518656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 656us (1055us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.046763:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1922 00002000:00100000:2.0:1746129826.046768:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3883008->3887103) req@ffff88013631a680 x1830949054518656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.046775:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631a680 with x1830949054518656 ext(3883008->3887103) 00010000:00010000:2.0:1746129826.046779:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.046793:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.046799:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013631a680 00000100:00100000:0.0:1746129826.049407:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.049449:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054518784 00000100:00100000:1.0:1746129826.049456:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054518784 00000100:00100000:1.0:1746129826.049495:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15831 00000100:00100000:1.0:1746129826.049500:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31756:x1830949054518784:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.049512:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.049522:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567e0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.049542:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.049547:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.049548:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.049550:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.049574:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 9 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.049580:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 9 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.049587:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088448:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.049648:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.051267:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088448:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.051285:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.051297:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094334a00, rc 0) 00000100:00100000:1.0:1746129826.051334:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31756:x1830949054518784:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1833us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.051341:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15831 00000100:00100000:0.0:1746129826.052079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.052107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.052707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.052740:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519040 00000100:00100000:2.0:1746129826.052745:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519040 00000100:00100000:1.0:1746129826.052766:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519296 00000100:00100000:1.0:1746129826.052769:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519296 00002000:00100000:2.0:1746129826.052774:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3883008->4194303) req@ffff88013631b100 x1830949054519040/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.052782:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b100 with x1830949054519040 ext(3883008->4194303) 00010000:00010000:2.0:1746129826.052788:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.052788:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15832 00000100:00100000:1.0:1746129826.052793:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31757:x1830949054519296:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.052798:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.052802:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:2.0:1746129826.052804:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013631b100 00000100:00100000:2.0:1746129826.052812:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1923 00010000:00010000:1.0:1746129826.052812:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567e7 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.052816:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054519040:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:1.0:1746129826.052831:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 5 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.052837:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.052842:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.052871:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.052872:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.052875:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->3264511] (req 3145728->3264511) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 11 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.052894:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 21 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.052902:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 21 pid: 1140 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.052911:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088576:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.052956:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.052963:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 11 pid: 8435 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.052970:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094a4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088704:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.052988:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 5 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.052994:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 5 pid: 3624 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.053000:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088832:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.053011:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.053075:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519168 00000100:00100000:3.0:1746129826.053078:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519168 00002000:00100000:3.0:1746129826.053096:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1105919) req@ffff88013631ad80 x1830949054519168/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.053103:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631ad80 with x1830949054519168 ext(1048576->1105919) 00010000:00010000:3.0:1746129826.053107:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.053114:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.053120:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013631ad80 00000100:00100000:3.0:1746129826.053140:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1924 00000100:00100000:3.0:1746129826.053146:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054519168:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129826.055410:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.055537:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088832:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.056069:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f90b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088576:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.056077:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094a4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054088704:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.056101:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->3264511] (req 3145728->3264511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.056116:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094334c00, rc 0) 00000100:00100000:1.0:1746129826.056151:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31757:x1830949054519296:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3356us (3444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.056157:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15832 00000100:00100000:2.0:1746129826.056318:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519424 00000100:00100000:2.0:1746129826.056323:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519424 00010000:00010000:2.0:1746129826.056345:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.056376:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7917 00000100:00100000:2.0:1746129826.056383:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054519424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.056393:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.056407:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.056416:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.056434:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135676200/0x48868a4e43955d6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356658 expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.056448:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.056465:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054519424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.056470:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7917 00000100:00100000:0.0:1746129826.056519:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.056616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.056687:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519552 00000100:00100000:1.0:1746129826.056689:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519552 00000100:00100000:1.0:1746129826.056708:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15833 00000100:00100000:1.0:1746129826.056712:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31749:x1830949054519552:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129826.056721:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.056729:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567ee expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.056741:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.056745:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.056750:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746129826.056752:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.056772:0:1140:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.056779:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1892352->2097151] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 23 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.056785:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67400, rc 0) 00000100:00100000:1.0:1746129826.056801:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31749:x1830949054519552:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 88us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.056805:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15833 00000100:00100000:3.0:1746129826.057350:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054519168:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4203us (5241us total) trans 17179874193 rc 0/0 00000100:00100000:3.0:1746129826.057357:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1924 00002000:00100000:3.0:1746129826.057363:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->1105919) req@ffff88013631ad80 x1830949054519168/t17179874193(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.057370:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631ad80 with x1830949054519168 ext(1048576->1105919) 00010000:00010000:3.0:1746129826.057376:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 13 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.057384:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 13 pid: 1877 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.057389:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013631ad80 00000100:00100000:2.0:1746129826.057470:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054519040:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4653us (5392us total) trans 21474841389 rc 0/0 00000100:00100000:2.0:1746129826.057477:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1923 00002000:00100000:2.0:1746129826.057481:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3883008->4194303) req@ffff88013631b100 x1830949054519040/t21474841389(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.057488:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631b100 with x1830949054519040 ext(3883008->4194303) 00010000:00010000:2.0:1746129826.057494:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.057502:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.057511:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013631b100 00000100:00100000:2.0:1746129826.057527:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519680 00000100:00100000:2.0:1746129826.057529:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519680 00010000:00010000:2.0:1746129826.057539:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 23 pid: 1140 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.057553:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7918 00000100:00100000:2.0:1746129826.057557:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054519680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.057563:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.057570:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 23 pid: 1140 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.057578:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 23 pid: 1140 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.057590:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a022ce00/0x48868a4e43955e21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356690 expref: 23 pid: 1140 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.057598:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.057611:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054519680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.057616:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7918 00000100:00100000:0.0:1746129826.057763:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.057839:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519808 00000100:00100000:3.0:1746129826.057842:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519808 00010000:00010000:3.0:1746129826.057881:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 13 pid: 8435 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.057899:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7919 00000100:00100000:3.0:1746129826.057904:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054519808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.057909:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.057916:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 13 pid: 8435 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.057923:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 13 pid: 8435 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.057934:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d91a00/0x48868a4e43955e6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566d6 expref: 13 pid: 8435 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.058516:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.058518:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.058525:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.058536:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.058558:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.058569:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054089088:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129826.058619:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.061290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.061325:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054089088:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129826.061345:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.061382:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136318000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054519808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3477us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.061390:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7919 00000100:00100000:3.0:1746129826.061412:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054519936 00000100:00100000:3.0:1746129826.061417:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054519936 00010000:00010000:3.0:1746129826.061432:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.061449:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7920 00000100:00100000:3.0:1746129826.061455:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054519936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.061463:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.061478:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.061491:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.061507:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43955f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1105919) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35677e expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.061517:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.061518:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.061523:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.061530:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.061552:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 21 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.061560:0:10979:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 21 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.061568:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054089216:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129826.061629:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.061826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.062057:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054520064 00000100:00100000:2.0:1746129826.062060:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054520064 00010000:00010000:2.0:1746129826.062074:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.062096:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7921 00000100:00100000:2.0:1746129826.062101:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1963:x1830949054520064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.062112:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.062124:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.062131:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.062142:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e315600/0x48868a4e43956004 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3883008->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567cb expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.062150:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.062151:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.062154:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.062160:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.062174:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.062180:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054089344:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.062517:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.064782:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.064872:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054520320 00000100:00100000:2.0:1746129826.064878:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054520320 00002000:00100000:2.0:1746129826.064908:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3260416->3264511) req@ffff88013631bb80 x1830949054520320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.064916:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631bb80 with x1830949054520320 ext(3260416->3264511) 00002000:00010000:2.0:1746129826.064920:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631bb80 00000100:00100000:2.0:1746129826.065329:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7123 00000100:00100000:2.0:1746129826.065336:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054520320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.065472:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1963:x1830949054520320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 135us (694us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.065477:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7123 00002000:00100000:2.0:1746129826.065482:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3260416->3264511) req@ffff88013631bb80 x1830949054520320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.065489:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013631bb80 with x1830949054520320 ext(3260416->3264511) 00002000:00010000:2.0:1746129826.065492:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013631bb80 00000100:00100000:3.0:1746129826.066290:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054089216:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.066290:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054089344:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.066302:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129826.066306:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.066331:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136319c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054519936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4876us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.066331:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013631a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054520064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4229us (4504us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.066337:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7920 00000100:00100000:0.0:1746129826.066480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.066498:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7921 00000100:00100000:3.0:1746129826.066603:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054520576 00000100:00100000:3.0:1746129826.066607:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054520576 00002000:00100000:3.0:1746129826.066623:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a0096d80 x1830949054520576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.066630:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0096d80 with x1830949054520576 ext(1048576->2097151) 00010000:00010000:3.0:1746129826.066636:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.066647:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.066653:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0096d80 00000100:00100000:3.0:1746129826.066675:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1925 00000100:00100000:3.0:1746129826.066681:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054520576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129826.068196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.068945:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054520832 00000100:00100000:2.0:1746129826.068955:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054520832 00002000:00100000:2.0:1746129826.068982:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a0097480 x1830949054520832/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.068991:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097480 with x1830949054520832 ext(4194304->4931583) 00002000:00010000:2.0:1746129826.068996:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097480 00000100:00100000:2.0:1746129826.070368:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7124 00000100:00100000:2.0:1746129826.070378:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054520832:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129826.078720:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054520576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12031us (12232us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.078731:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1925 00002000:00100000:3.0:1746129826.078740:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a0096d80 x1830949054520576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.078749:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0096d80 with x1830949054520576 ext(1048576->2097151) 00010000:00010000:3.0:1746129826.078757:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.078775:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.078781:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0096d80 00000100:00100000:2.0:1746129826.082007:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054520832:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11623us (13806us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129826.082018:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7124 00002000:00100000:2.0:1746129826.082034:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800a0097480 x1830949054520832/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.082044:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0097480 with x1830949054520832 ext(4194304->4931583) 00002000:00010000:2.0:1746129826.082049:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0097480 00000100:00100000:0.0:1746129826.087687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.087742:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.087751:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054520960 00000100:00100000:1.0:1746129826.087759:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054520960 00000100:00100000:1.0:1746129826.087811:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15834 00000100:00100000:1.0:1746129826.087820:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054520960:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.087835:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.087873:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094335000/0x48868a4e4395602e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567f5 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.087894:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.087908:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094335000/0x48868a4e4395602e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567f5 expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.087917:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094335000/0x48868a4e4395602e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567f5 expref: 12 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.087931:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335000, rc 0) 00000100:00100000:1.0:1746129826.087989:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054520960:12345-192.168.204.31@tcp:101:cat.0 Request processed in 170us (311us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129826.087995:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15834 00000100:00100000:2.0:1746129826.088225:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521088 00000100:00100000:2.0:1746129826.088228:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521088 00010000:00010000:2.0:1746129826.088243:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.088257:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7922 00000100:00100000:2.0:1746129826.088261:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054521088:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.088268:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.088282:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.088291:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.088303:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094334a00/0x48868a4e43956019 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e0 expref: 22 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.088314:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.088316:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.088321:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.088332:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.088353:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.088363:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054089472:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.088407:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.091558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.091591:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.091616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.092314:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521216 00000100:00100000:0.0:1746129826.092316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.092322:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521216 00000100:00100000:1.0:1746129826.092372:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521344 00000100:00100000:1.0:1746129826.092375:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521344 00000100:00100000:1.0:1746129826.092385:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521472 00000100:00100000:1.0:1746129826.092387:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521472 00000100:00100000:3.0:1746129826.092389:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054089472:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129826.092404:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.092405:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521600 00000100:00100000:1.0:1746129826.092407:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521600 00000100:00100000:1.0:1746129826.092421:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15835 00000100:00100000:1.0:1746129826.092428:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054521472:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129826.092438:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054521088:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4175us (4695us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129826.092441:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129826.092445:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7922 00010000:00010000:1.0:1746129826.092453:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094335200/0x48868a4e43956035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35680a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.092755:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15836 00000100:00100000:0.0:1746129826.092762:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054521600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129826.092769:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129826.092776:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e4395603c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356811 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.092807:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054089600:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129826.092844:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.092971:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15837 00000100:00100000:2.0:1746129826.092976:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054521216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.092983:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.092989:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a4c400/0x48868a4e43956043 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3567fc expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.093008:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054089728:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129826.093047:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.093113:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054089856:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129826.093133:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.093205:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15838 00000100:00100000:1.0:1746129826.093211:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1963:x1830949054521344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.093218:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.093227:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356803 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.093238:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.093239:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.093246:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.093259:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.093267:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a022ce00, rc 0) 00000100:00100000:1.0:1746129826.093297:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054521344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 86us (1705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.093302:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15838 00000100:00100000:0.0:1746129826.094893:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.094956:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521728 00000100:00100000:2.0:1746129826.094962:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521728 00000100:00100000:0.0:1746129826.095218:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054089600:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129826.095238:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e4395603c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356811 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129826.095253:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67a00/0x48868a4e4395603c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356811 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129826.095294:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15839 00000100:00100000:2.0:1746129826.095300:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:31749:x1830949054521728:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.095313:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.095321:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356818 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.095337:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 5 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.095343:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.095349:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.095354:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.095355:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.095358:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->1884159] (req 1048576->1884159) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.095376:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.095385:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.095395:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054089984:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.095460:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 12 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.095468:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 12 pid: 1877 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.095474:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054090112:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.095494:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 5 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.095501:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 5 pid: 3624 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.095507:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054090240:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.095521:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.095543:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054089728:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129826.095555:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a4c400/0x48868a4e43956043 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567fc expref: 24 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129826.095741:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135b67a00, rc 0) 00000100:00100000:0.0:1746129826.095763:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054521600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3002us (3447us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129826.095768:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15836 00002000:00010000:1.0:1746129826.096049:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129824 -> 1746129826 00002000:00010000:1.0:1746129826.096053:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129824 -> 1746129826 00002000:00010000:1.0:1746129826.096054:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129824 -> 1746129826 00000100:00100000:1.0:1746129826.096066:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054089856:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129826.096081:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094335200/0x48868a4e43956035 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35680a expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.096089:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094335200/0x48868a4e43956035 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35680a expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.096103:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094335200, rc 0) 00000100:00100000:1.0:1746129826.096124:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054521472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3693us (4503us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129826.096128:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15835 00010000:00010000:2.0:1746129826.096271:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a4c400/0x48868a4e43956043 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567fc expref: 22 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.096281:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4c400, rc 0) 00000100:00100000:2.0:1746129826.096386:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1963:x1830949054521216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3409us (4836us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129826.096393:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15837 00000100:00100000:0.0:1746129826.100286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.100908:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.100976:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054089984:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.100985:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054090112:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.100993:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054090240:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.101019:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->1884159] (req 1048576->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.101044:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a4da00, rc 0) 00000100:00100000:2.0:1746129826.101088:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31749:x1830949054521728:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5787us (6198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.101096:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15839 00000100:00100000:3.0:1746129826.101517:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521984 00000100:00100000:3.0:1746129826.101523:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521984 00000100:00100000:3.0:1746129826.101534:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054521856 00000100:00100000:3.0:1746129826.101535:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054521856 00010000:00010000:3.0:1746129826.101558:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.101578:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7923 00000100:00100000:3.0:1746129826.101583:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054521856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.101594:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.101612:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.101621:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.101644:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022c600/0x48868a4e43955e13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356682 expref: 16 pid: 8436 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.101658:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.101677:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054521856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.101683:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7923 00010000:00010000:3.0:1746129826.101713:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.101727:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7924 00000100:00100000:3.0:1746129826.101732:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1964:x1830949054521984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.101738:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.101745:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.101751:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.101762:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5244000/0x48868a4e43955d5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35664a expref: 6 pid: 3624 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.101770:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.101782:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1964:x1830949054521984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.101789:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7924 00000100:00100000:1.0:1746129826.101899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00080000:2.0:1746129826.102056:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746129826.102137:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054522112 00000100:00100000:0.0:1746129826.102140:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054522112 00010000:00010000:0.0:1746129826.102153:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 13 pid: 1877 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746129826.102177:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7925 00000100:00100000:0.0:1746129826.102183:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054522112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129826.102189:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129826.102196:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 13 pid: 1877 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746129826.102204:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 13 pid: 1877 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746129826.102215:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022dc00/0x48868a4e43955e75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566c8 expref: 13 pid: 1877 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746129826.102229:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129826.102231:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129826.102236:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.102242:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.102265:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.102275:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0095f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054090368:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129826.102319:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.105948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.106041:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054522368 00000100:00100000:2.0:1746129826.106048:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054522368 00002000:00100000:2.0:1746129826.106080:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094d8f480 x1830949054522368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.106090:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949054522368 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.106095:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8f480 00000100:00100000:2.0:1746129826.106159:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7125 00000100:00100000:2.0:1746129826.106166:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054522368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.109623:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0095f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054090368:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129826.109643:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129826.109671:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054522112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7488us (7772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129826.109680:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7925 00000100:00100000:0.0:1746129826.112920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.113814:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054522368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7645us (7869us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.113824:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7125 00002000:00100000:2.0:1746129826.113836:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880094d8f480 x1830949054522368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.113845:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8f480 with x1830949054522368 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.113872:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8f480 00000100:00100000:2.0:1746129826.113892:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054522624 00000100:00100000:2.0:1746129826.113898:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054522624 00002000:00100000:2.0:1746129826.113925:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1880064->1884159) req@ffff8800a0095180 x1830949054522624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.113931:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095180 with x1830949054522624 ext(1880064->1884159) 00002000:00010000:2.0:1746129826.113934:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0095180 00000100:00100000:2.0:1746129826.114552:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7126 00000100:00100000:2.0:1746129826.114560:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054522624:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.114735:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054522624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 175us (1822us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.114741:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7126 00002000:00100000:2.0:1746129826.114746:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1880064->1884159) req@ffff8800a0095180 x1830949054522624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.114752:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095180 with x1830949054522624 ext(1880064->1884159) 00002000:00010000:2.0:1746129826.114755:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0095180 00000100:00100000:0.0:1746129826.116761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.116820:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054522880 00000100:00100000:2.0:1746129826.116827:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054522880 00000100:00100000:2.0:1746129826.116902:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4666 00000100:00100000:2.0:1746129826.116909:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31749:x1830949054522880:12345-192.168.204.31@tcp:35:multiop.0 00000100:00080000:0.0:1746129826.117071:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129826.117085:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31749:x1830949054522880:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 176us (330us total) trans 8589945140 rc 0/0 00000100:00100000:2.0:1746129826.117092:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4666 00000100:00100000:0.0:1746129826.120695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.124143:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054523008 00000100:00100000:2.0:1746129826.124155:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054523008 00000100:00100000:2.0:1746129826.124205:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15840 00000100:00100000:2.0:1746129826.124213:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31756:x1830949054523008:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.124228:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.124241:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35681f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.124265:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.124272:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129826.124273:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129826.124276:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.124300:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 10 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.124310:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 10 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.124320:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054090496:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.124400:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.125647:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054090496:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.125666:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.125677:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f400, rc 0) 00000100:00100000:2.0:1746129826.125704:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31756:x1830949054523008:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1492us (5017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.125710:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15840 00000100:00100000:0.0:1746129826.127722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.127806:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054523136 00000100:00100000:2.0:1746129826.127813:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054523136 00002000:00100000:2.0:1746129826.127877:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3264511) req@ffff8800a0095f80 x1830949054523136/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.127886:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095f80 with x1830949054523136 ext(3145728->3264511) 00010000:00010000:2.0:1746129826.127893:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 11 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.127907:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 11 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.127914:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0095f80 00000100:00100000:2.0:1746129826.127943:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1926 00000100:00100000:2.0:1746129826.127950:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054523136:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129826.132421:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054523136:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4464us (4697us total) trans 17179874194 rc 0/0 00000100:00100000:2.0:1746129826.132431:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1926 00002000:00100000:2.0:1746129826.132440:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->3264511) req@ffff8800a0095f80 x1830949054523136/t17179874194(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.132449:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095f80 with x1830949054523136 ext(3145728->3264511) 00010000:00010000:2.0:1746129826.132457:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.132468:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.132475:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0095f80 00000100:00100000:0.0:1746129826.137202:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.137296:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054523264 00000100:00100000:2.0:1746129826.137303:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054523264 00010000:00010000:2.0:1746129826.137333:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.138217:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7926 00000100:00100000:2.0:1746129826.138226:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054523264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.138238:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.138257:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.138268:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.138286:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094334c00/0x48868a4e43956020 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3264511) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567e7 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.138751:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.138753:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.138760:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.138767:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.138794:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.138803:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054090624:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.142332:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.144137:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054090624:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.144154:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.144199:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1964:x1830949054523264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5974us (7004us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.144209:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7926 00000100:00100000:0.0:1746129826.149082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.149114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.149146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.149362:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054523520 00000100:00100000:3.0:1746129826.149369:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054523520 00002000:00100000:3.0:1746129826.149409:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88008ec9c000 x1830949054523520/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.149417:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9c000 with x1830949054523520 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.149423:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9c000 00000100:00100000:3.0:1746129826.149449:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054523776 00000100:00100000:3.0:1746129826.149452:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054523776 00002000:00100000:3.0:1746129826.149462:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88008ec9ce00 x1830949054523776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.149469:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9ce00 with x1830949054523776 ext(3145728->4194303) 00002000:00010000:3.0:1746129826.149471:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9ce00 00000100:00100000:3.0:1746129826.149479:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054524032 00000100:00100000:3.0:1746129826.149481:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054524032 00002000:00100000:3.0:1746129826.149489:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008ec9d500 x1830949054524032/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.149495:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9d500 with x1830949054524032 ext(3145728->4194303) 00002000:00010000:3.0:1746129826.149497:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9d500 00000100:00100000:3.0:1746129826.149505:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7127 00000100:00100000:3.0:1746129826.149510:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054523520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.150054:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7128 00000100:00100000:2.0:1746129826.150061:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054523776:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.150257:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7129 00000100:00100000:1.0:1746129826.150266:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054524032:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.164914:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054523776:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14845us (15789us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.164925:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7128 00002000:00100000:2.0:1746129826.164936:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88008ec9ce00 x1830949054523776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.164946:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9ce00 with x1830949054523776 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.164951:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9ce00 00000100:00100000:3.0:1746129826.167683:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054523520:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18164us (18599us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.167693:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7127 00002000:00100000:3.0:1746129826.167701:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88008ec9c000 x1830949054523520/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.167709:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9c000 with x1830949054523520 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.167713:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9c000 00000100:00100000:0.0:1746129826.168828:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1963:x1830949054524032:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18560us (19677us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129826.168836:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7129 00002000:00100000:0.0:1746129826.168843:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88008ec9d500 x1830949054524032/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129826.168865:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9d500 with x1830949054524032 ext(3145728->4194303) 00002000:00010000:0.0:1746129826.168869:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9d500 00000100:00100000:0.0:1746129826.175021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.175120:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054524288 00000100:00100000:2.0:1746129826.175128:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054524288 00002000:00100000:2.0:1746129826.175165:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88008ec9df80 x1830949054524288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.175173:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9df80 with x1830949054524288 ext(4194304->4931583) 00002000:00010000:2.0:1746129826.175177:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9df80 00000100:00100000:2.0:1746129826.175254:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7130 00000100:00100000:2.0:1746129826.175261:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054524288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.185312:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1964:x1830949054524288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10042us (10289us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129826.185322:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7130 00002000:00100000:2.0:1746129826.185332:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88008ec9df80 x1830949054524288/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.185340:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9df80 with x1830949054524288 ext(4194304->4931583) 00002000:00010000:2.0:1746129826.185345:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9df80 00010000:00010000:2.0:1746129826.221765:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129826.233017:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.233562:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054524544 00000100:00100000:2.0:1746129826.233570:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054524544 00000100:00100000:2.0:1746129826.234168:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11117 00000100:00100000:2.0:1746129826.234175:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31764:x1830949054524544:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.234193:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.234208:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52c00/0x48868a4e4395605f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356826 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.234291:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234302:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234310:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234321:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234327:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234331:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234412:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234419:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234424:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129826.234430:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129826.234492:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234498:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234503:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234508:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb52800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.234511:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234516:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234524:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129826.234526:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129826.234530:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234534:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52800/0x48868a4e43956066 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234560:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234565:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234569:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234572:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a507e200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.234574:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234579:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234588:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29ad00) 00010000:00010000:2.0:1746129826.234589:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129826.234591:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234596:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507e200/0x48868a4e4395606d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.234626:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb52c00/0x48868a4e4395605f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 19 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.234636:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.234641:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.234643:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129826.234645:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a507f200, rc 0) 00000100:00100000:2.0:1746129826.234697:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31764:x1830949054524544:12345-192.168.204.31@tcp:101:cat.0 Request processed in 522us (1687us total) trans 8589945141 rc 0/0 00000100:00100000:2.0:1746129826.234703:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11117 00000100:00100000:0.0:1746129826.240131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.240213:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054524800 00000100:00100000:2.0:1746129826.240220:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054524800 00000100:00100000:2.0:1746129826.240269:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4667 00000100:00100000:2.0:1746129826.240276:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31764:x1830949054524800:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129826.240466:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31764:x1830949054524800:12345-192.168.204.31@tcp:35:cat.0 Request processed in 190us (341us total) trans 8589945142 rc 0/0 00000100:00100000:2.0:1746129826.240471:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4667 00000100:00100000:0.0:1746129826.244837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.244884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.244957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.245030:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054524928 00000100:00100000:1.0:1746129826.245038:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054524928 00000100:00100000:1.0:1746129826.245082:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054525184 00000100:00100000:1.0:1746129826.245085:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054525184 00000100:00100000:1.0:1746129826.245097:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054525056 00000100:00100000:1.0:1746129826.245098:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054525056 00000100:00100000:1.0:1746129826.245112:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15841 00000100:00100000:1.0:1746129826.245118:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054524928:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.245133:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.245147:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43956082 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35682d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129826.245188:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054090752:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129826.245260:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.245276:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15842 00000100:00100000:1.0:1746129826.245282:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054525184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.245289:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.245296:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35683b expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.245306:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.245307:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.245314:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.245326:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.245334:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fc00, rc 0) 00000100:00100000:1.0:1746129826.245354:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054525184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 72us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.245359:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15842 00000100:00100000:1.0:1746129826.245373:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15843 00000100:00100000:1.0:1746129826.245378:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054525056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.245383:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.245391:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956090 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356834 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129826.245412:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054090880:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129826.245430:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.248166:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054090752:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129826.248192:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43956082 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35682d expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.248203:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1f400/0x48868a4e43956082 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35682d expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.248226:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f400, rc 0) 00000100:00100000:1.0:1746129826.248261:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054524928:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3142us (3430us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129826.248268:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15841 00002000:00010000:2.0:1746129826.248344:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129826.248347:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129824 -> 1746129826 00002000:00010000:2.0:1746129826.248349:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129824 -> 1746129826 00000100:00100000:2.0:1746129826.248361:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054090880:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129826.248375:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956090 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356834 expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.248383:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956090 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356834 expref: 13 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.248409:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:2.0:1746129826.248428:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054525056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3050us (3471us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129826.248434:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15843 00000100:00100000:0.0:1746129826.250810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.252497:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054525440 00000100:00100000:3.0:1746129826.252507:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054525440 00000100:00100000:3.0:1746129826.252560:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11118 00000100:00100000:3.0:1746129826.252566:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+288:31766:x1830949054525440:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129826.252585:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.252600:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe400/0x48868a4e43956097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356842 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.252681:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252690:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252698:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252707:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252712:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252716:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252790:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252797:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252802:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129826.252809:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129826.252883:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252888:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252893:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252897:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6ff200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.252900:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252904:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252912:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129826.252914:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.252917:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252921:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e4395609e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252941:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252949:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252953:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252956:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6ff600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.252958:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252962:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252966:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244400) 00010000:00010000:3.0:1746129826.252968:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.252969:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.252973:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.253002:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe400/0x48868a4e43956097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 291 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.253012:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 290 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.253016:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129826.253018:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129826.253020:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ffa00, rc 0) 00000100:00100000:3.0:1746129826.253627:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31766:x1830949054525440:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1059us (2821us total) trans 8589945143 rc 0/0 00000100:00100000:3.0:1746129826.253634:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11118 00000100:00100000:0.0:1746129826.255186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.255235:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054525696 00000100:00100000:2.0:1746129826.255241:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054525696 00002000:00100000:2.0:1746129826.255272:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88008ec9f100 x1830949054525696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.255279:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f100 with x1830949054525696 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.255283:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9f100 00000100:00100000:2.0:1746129826.255307:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7131 00000100:00100000:2.0:1746129826.255312:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054525696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.271339:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054525696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16018us (16148us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.271350:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7131 00002000:00100000:2.0:1746129826.271360:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88008ec9f100 x1830949054525696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.271369:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9f100 with x1830949054525696 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.271374:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008ec9f100 00000100:00100000:0.0:1746129826.280582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.280649:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054525824 00000100:00100000:2.0:1746129826.280657:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054525824 00000100:00100000:2.0:1746129826.280705:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15844 00000100:00100000:2.0:1746129826.280711:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31764:x1830949054525824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.280726:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.280741:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356849 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.280764:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.280771:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129826.280772:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129826.280775:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.280798:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.280807:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 21 pid: 1140 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.280817:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054091008:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.280924:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.294101:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054091008:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.294127:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.294142:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb52c00, rc 0) 00000100:00100000:2.0:1746129826.294193:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31764:x1830949054525824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13481us (13617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.294201:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15844 00000100:00100000:0.0:1746129826.294761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.298101:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054525952 00000100:00100000:2.0:1746129826.298112:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054525952 00002000:00100000:2.0:1746129826.298155:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1892352->2097151) req@ffff88012b025f80 x1830949054525952/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.298163:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025f80 with x1830949054525952 ext(1892352->2097151) 00010000:00010000:2.0:1746129826.298171:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 22 pid: 1140 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.298184:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 22 pid: 1140 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.298190:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b025f80 00000100:00100000:2.0:1746129826.298228:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1927 00000100:00100000:2.0:1746129826.298235:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054525952:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129826.303527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.303600:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054526208 00000100:00100000:3.0:1746129826.303607:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054526208 00000100:00100000:3.0:1746129826.303641:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11119 00000100:00100000:3.0:1746129826.303647:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31768:x1830949054526208:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129826.303664:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.303678:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe400/0x48868a4e439560c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356850 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.303750:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303761:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303770:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303781:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303786:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303791:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303879:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e439560d6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303886:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e439560d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303892:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e439560d6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:3.0:1746129826.303899:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129826.303950:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303957:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303961:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303966:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6ff600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.303969:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303974:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303982:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129826.303984:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.303987:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.303991:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff600/0x48868a4e439560c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304015:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304019:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304036:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304039:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6ff200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.304041:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304045:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304051:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244200) 00010000:00010000:3.0:1746129826.304053:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.304055:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304059:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff200/0x48868a4e439560cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129826.304088:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6fe400/0x48868a4e439560c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356850 expref: 22 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.304098:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e439560d6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356850 expref: 21 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.304103:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129826.304105:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129826.304107:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ff000, rc 0) 00000100:00100000:3.0:1746129826.304142:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31768:x1830949054526208:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 495us (622us total) trans 8589945144 rc 0/0 00000100:00100000:3.0:1746129826.304148:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11119 00000100:00100000:0.0:1746129826.304507:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054525952:12345-192.168.204.31@tcp:4:cat.0 Request processed in 6270us (9745us total) trans 17179874195 rc 0/0 00000100:00100000:0.0:1746129826.304515:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1927 00002000:00100000:0.0:1746129826.304522:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1892352->2097151) req@ffff88012b025f80 x1830949054525952/t17179874195(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129826.304530:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025f80 with x1830949054525952 ext(1892352->2097151) 00010000:00010000:0.0:1746129826.304537:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 24 pid: 1140 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746129826.304548:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 24 pid: 1140 timeout: 872 lvb_type: 0 00002000:00010000:0.0:1746129826.304553:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b025f80 00000100:00100000:0.0:1746129826.306494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.306783:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054526336 00000100:00100000:2.0:1746129826.306790:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054526336 00000100:00100000:2.0:1746129826.307735:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 745 00000100:00100000:2.0:1746129826.307743:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054526336:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.307754:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.307772:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ff000/0x48868a4e439560d6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356850 expref: 21 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.307900:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.307942:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129826.308002:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.308007:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.308054:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054526336:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 312us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.308060:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 745 00000100:00100000:2.0:1746129826.308073:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054526464 00000100:00100000:2.0:1746129826.308075:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054526464 00010000:00010000:2.0:1746129826.308086:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 24 pid: 1140 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.308100:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7927 00000100:00100000:2.0:1746129826.308104:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054526464:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.308110:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.308125:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 24 pid: 1140 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.308133:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 24 pid: 1140 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.308146:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135b67400/0x48868a4e43956027 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1892352->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567ee expref: 24 pid: 1140 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.308157:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.308159:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.308165:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.308172:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.308198:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 13 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.308208:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054091136:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.308263:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.308277:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054526720 00000100:00100000:2.0:1746129826.308279:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054526720 00000100:00100000:2.0:1746129826.308301:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4668 00000100:00100000:2.0:1746129826.308305:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31768:x1830949054526720:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:0.0:1746129826.312599:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.312683:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31768:x1830949054526720:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 4374us (4738us total) trans 8589945145 rc 0/0 00000100:00100000:2.0:1746129826.312692:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4668 00000100:00100000:3.0:1746129826.312693:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054091136:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129826.312707:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.312718:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054526848 00000100:00100000:3.0:1746129826.312722:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054526464:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4618us (4823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.312723:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054526848 00000100:00100000:3.0:1746129826.312728:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7927 00000100:00100000:1.0:1746129826.313884:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15845 00000100:00100000:1.0:1746129826.313893:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31766:x1830949054526848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129826.313904:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.313916:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356857 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.313937:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.313945:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.313950:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.313951:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.313953:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1101824->1679359] (req 1101824->1679359) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.313973:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129826.313984:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 13 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.313993:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054091264:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.314068:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.314076:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.314083:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054091392:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.314103:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.316560:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054091264:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.316569:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054091392:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.316588:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1101824->1679359] (req 1101824->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.316602:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb6200, rc 0) 00000100:00100000:1.0:1746129826.316630:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31766:x1830949054526848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2739us (4039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.316637:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15845 00000100:00100000:0.0:1746129826.319604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.319638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.319656:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054527104 00000100:00100000:2.0:1746129826.319663:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054527104 00002000:00100000:2.0:1746129826.319696:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b024a80 x1830949054527104/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.319709:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949054527104 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.319714:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024a80 00000100:00100000:2.0:1746129826.320460:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7132 00000100:00100000:2.0:1746129826.320468:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054527104:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.320591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.320629:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054527232 00000100:00100000:3.0:1746129826.320633:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054527232 00010000:00010000:3.0:1746129826.320653:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 15 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.320669:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054527360 00000100:00100000:3.0:1746129826.320671:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054527360 00010000:00010000:3.0:1746129826.320685:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.320703:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7928 00000100:00100000:3.0:1746129826.320709:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054527232:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.320719:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.320731:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 15 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.320741:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 15 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.320758:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094335c00/0x48868a4e4395600b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d2 expref: 15 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.320817:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.320835:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7929 00000100:00100000:1.0:1746129826.320842:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054527360:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.320863:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.320873:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.320884:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.320895:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4af800/0x48868a4e43955ffd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567c4 expref: 24 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.320902:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054527232:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 192us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.320908:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7928 00010000:00010000:1.0:1746129826.320908:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.320910:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129826.320915:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.320923:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.320946:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129826.320955:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054091520:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129826.321005:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.323012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.323035:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054527616 00000100:00100000:1.0:1746129826.323039:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054527616 00002000:00100000:1.0:1746129826.323063:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1101824->1105919) req@ffff880094d8d180 x1830949054527616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.323072:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949054527616 ext(1101824->1105919) 00002000:00010000:1.0:1746129826.323075:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8d180 00000100:00100000:1.0:1746129826.323103:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7133 00000100:00100000:1.0:1746129826.323108:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054527616:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129826.323197:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054527616:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 87us (189us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129826.323202:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7133 00002000:00100000:1.0:1746129826.323207:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1101824->1105919) req@ffff880094d8d180 x1830949054527616/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.323214:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8d180 with x1830949054527616 ext(1101824->1105919) 00002000:00010000:1.0:1746129826.323216:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094d8d180 00000100:00100000:2.0:1746129826.323324:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054091520:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.323338:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.323356:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054527360:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2516us (2767us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.323361:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7929 00000100:00100000:2.0:1746129826.330310:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054527104:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9835us (10704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.330321:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7132 00002000:00100000:2.0:1746129826.330332:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b024a80 x1830949054527104/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.330341:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024a80 with x1830949054527104 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.330346:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b024a80 00000100:00100000:0.0:1746129826.336511:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.336670:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054527872 00000100:00100000:2.0:1746129826.336677:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054527872 00002000:00100000:2.0:1746129826.336708:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1675264->1679359) req@ffff88012b026680 x1830949054527872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.336716:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026680 with x1830949054527872 ext(1675264->1679359) 00002000:00010000:2.0:1746129826.336720:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b026680 00000100:00100000:2.0:1746129826.336748:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7134 00000100:00100000:2.0:1746129826.336754:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054527872:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129826.336937:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054527872:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 181us (431us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.336943:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7134 00002000:00100000:2.0:1746129826.336948:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1675264->1679359) req@ffff88012b026680 x1830949054527872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.336956:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026680 with x1830949054527872 ext(1675264->1679359) 00002000:00010000:2.0:1746129826.336958:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b026680 00000100:00100000:0.0:1746129826.342300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.342589:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054528000 00000100:00100000:1.0:1746129826.342597:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054528000 00000100:00100000:1.0:1746129826.342645:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15846 00000100:00100000:1.0:1746129826.342653:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31764:x1830949054528000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.342667:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.342681:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35685e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.342704:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.342711:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.342713:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129826.342717:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.342741:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.342751:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 14 pid: 8435 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.342761:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054091648:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129826.342830:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.348006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.348140:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054528256 00000100:00100000:2.0:1746129826.348147:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054528256 00000100:00100000:2.0:1746129826.348194:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4669 00000100:00100000:2.0:1746129826.348200:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31766:x1830949054528256:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129826.348411:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31766:x1830949054528256:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 210us (411us total) trans 8589945146 rc 0/0 00000100:00100000:2.0:1746129826.348418:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4669 00000100:00100000:1.0:1746129826.348837:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094d8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054091648:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.348888:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.348902:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7000, rc 0) 00000100:00100000:1.0:1746129826.348922:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31764:x1830949054528000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6270us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.348928:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15846 00000100:00100000:0.0:1746129826.354340:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.354440:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054528384 00000100:00100000:3.0:1746129826.354448:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054528384 00002000:00100000:3.0:1746129826.354492:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1884159) req@ffff88012b024e00 x1830949054528384/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.354502:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024e00 with x1830949054528384 ext(1048576->1884159) 00010000:00010000:3.0:1746129826.354516:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 15 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.354528:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 15 pid: 8435 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.354540:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b024e00 00000100:00100000:3.0:1746129826.354570:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1928 00000100:00100000:3.0:1746129826.354583:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054528384:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129826.367948:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054528384:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 13358us (13607us total) trans 21474841390 rc 0/0 00000100:00100000:3.0:1746129826.367959:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1928 00002000:00100000:3.0:1746129826.367969:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1884159) req@ffff88012b024e00 x1830949054528384/t21474841390(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.367983:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024e00 with x1830949054528384 ext(1048576->1884159) 00010000:00010000:3.0:1746129826.367991:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 17 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.368005:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 17 pid: 8435 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.368011:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b024e00 00000100:00100000:0.0:1746129826.373079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.373215:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054528512 00000100:00100000:2.0:1746129826.373222:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054528512 00010000:00010000:2.0:1746129826.373250:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 17 pid: 8435 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.375402:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7930 00000100:00100000:2.0:1746129826.375415:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054528512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.375432:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.375453:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 17 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.375465:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 17 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.375484:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130a4da00/0x48868a4e43956051 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356818 expref: 17 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.375514:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.375516:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.375523:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.375531:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.375556:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.375566:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054091776:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.375638:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.376135:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.376239:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054528640 00000100:00100000:3.0:1746129826.376244:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054528640 00000100:00100000:3.0:1746129826.376291:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11120 00000100:00100000:3.0:1746129826.376297:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31770:x1830949054528640:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129826.376313:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.376324:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efe00/0x48868a4e439560f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356865 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.376365:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00000100:00080000:0.0:1746129826.376404:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129826.379272:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379289:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379309:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379315:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379320:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379429:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379442:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.379448:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.379483:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.379494:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 20 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.379505:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054091904:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.379555:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.379743:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054091776:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.379758:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.379783:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949054528512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4372us (6710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.379792:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7930 00000100:00100000:0.0:1746129826.380632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.380695:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054528896 00000100:00100000:3.0:1746129826.380750:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054528896 00002000:00100000:3.0:1746129826.380785:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00ed80 x1830949054528896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.380793:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ed80 with x1830949054528896 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.380797:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ed80 00000100:00100000:3.0:1746129826.380826:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7135 00000100:00100000:3.0:1746129826.380833:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054528896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.382091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.382165:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054091904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.382185:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129826.382205:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529024 00000100:00100000:2.0:1746129826.382208:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529024 00010000:00010000:2.0:1746129826.382226:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 21 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.382245:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7931 00000100:00100000:2.0:1746129826.382250:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054529024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.382260:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.382264:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 21 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.382273:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 21 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.382290:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c0fe800/0x48868a4e43955fef lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567bd expref: 21 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.382304:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.382308:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.382316:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.382321:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.382337:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.383356:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054529024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1104us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.383363:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7931 00010000:00010000:2.0:1746129826.383408:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.383414:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129826.383445:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129826.383449:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129826.383468:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.383476:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.383484:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.383490:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.383495:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.383499:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918ef600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.383503:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384442:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384460:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129826.384462:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129826.384466:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384471:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e439560f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384482:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384486:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384490:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384494:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918efa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.384497:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384501:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384506:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244d00) 00010000:00010000:2.0:1746129826.384508:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129826.384509:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384513:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.384543:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efe00/0x48868a4e439560f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.384567:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.384572:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.384574:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129826.384576:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef000, rc 0) 00000100:00100000:2.0:1746129826.384611:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31770:x1830949054528640:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 8313us (8476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.384617:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11120 00000100:00100000:3.0:1746129826.394514:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054528896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13674us (13876us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.394524:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7135 00002000:00100000:3.0:1746129826.394534:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00ed80 x1830949054528896/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.394543:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ed80 with x1830949054528896 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.394547:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ed80 00000100:00100000:0.0:1746129826.394670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.394807:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529152 00000100:00100000:2.0:1746129826.394814:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529152 00000100:00100000:2.0:1746129826.394843:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15847 00000100:00100000:2.0:1746129826.394862:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054529152:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129826.394874:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.394892:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35686c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.394911:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.394913:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.394919:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 6 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.394932:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 6 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.394941:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befc00, rc 0) 00000100:00100000:2.0:1746129826.394977:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054529152:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 128us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.394982:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15847 00000100:00100000:0.0:1746129826.397347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.397382:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.397405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.397418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.398248:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.398404:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529280 00000100:00100000:3.0:1746129826.398412:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529280 00000100:00100000:3.0:1746129826.398446:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529408 00000100:00100000:3.0:1746129826.398448:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529408 00000100:00100000:3.0:1746129826.398459:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529536 00000100:00100000:3.0:1746129826.398460:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529536 00000100:00100000:3.0:1746129826.398472:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529664 00000100:00100000:3.0:1746129826.398473:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529664 00000100:00100000:3.0:1746129826.398480:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054529792 00000100:00100000:3.0:1746129826.398482:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054529792 00000100:00100000:3.0:1746129826.398494:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15848 00000100:00100000:3.0:1746129826.398501:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054529280:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129826.398513:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.398528:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e43956115 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356873 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.398570:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054092032:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.398640:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.398658:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15849 00000100:00100000:3.0:1746129826.398664:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054529408:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129826.398670:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.398676:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35687a expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.398685:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398687:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398694:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398707:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398716:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ee400, rc 0) 00000100:00100000:3.0:1746129826.398735:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054529408:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 73us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.398740:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15849 00000100:00100000:3.0:1746129826.398757:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15850 00000100:00100000:3.0:1746129826.398761:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054529536:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129826.398767:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.398775:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356881 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.398783:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398785:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398788:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398800:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398806:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eec00, rc 0) 00000100:00100000:3.0:1746129826.398840:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054529536:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 78us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.398845:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15850 00000100:00100000:3.0:1746129826.398871:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15851 00000100:00100000:3.0:1746129826.398876:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054529664:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129826.398882:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.398889:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356888 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.398900:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398901:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398907:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398914:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 8 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398921:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef200, rc 0) 00000100:00100000:3.0:1746129826.398935:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054529664:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 59us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.398939:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15851 00000100:00100000:3.0:1746129826.398951:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15852 00000100:00100000:3.0:1746129826.398955:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054529792:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129826.398961:0:3623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.398966:0:3623:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35688f expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.398973:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398974:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.398977:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398984:0:3623:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 9 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.398990:0:3623:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918efe00, rc 0) 00000100:00100000:3.0:1746129826.399003:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054529792:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 48us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.399008:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15852 00000100:00100000:3.0:1746129826.403252:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054092032:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.403286:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e43956115 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356873 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.403298:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e43956115 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356873 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.403310:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef600, rc 0) 00000100:00100000:3.0:1746129826.403362:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054529280:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 4861us (6021us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.403371:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15848 00000100:00100000:0.0:1746129826.406453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.406504:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054530048 00000100:00100000:2.0:1746129826.406513:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054530048 00000100:00100000:2.0:1746129826.406558:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11121 00000100:00100000:2.0:1746129826.406565:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31770:x1830949054530048:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129826.406582:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.406597:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43956138 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356896 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.406677:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.406690:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.406697:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.406724:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.406734:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 11 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.406746:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054092160:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.406826:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.413757:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.414732:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054530304 00000100:00100000:3.0:1746129826.414740:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054530304 00002000:00100000:3.0:1746129826.414782:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009b00df80 x1830949054530304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.414791:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949054530304 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.414795:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00df80 00000100:00100000:3.0:1746129826.414824:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7136 00000100:00100000:3.0:1746129826.414831:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054530304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.415027:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.415078:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.415145:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.415187:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.415210:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054531200 00000100:00100000:1.0:1746129826.415216:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054531200 00010000:00010000:1.0:1746129826.415240:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 12 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.415270:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7932 00000100:00100000:1.0:1746129826.415277:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054531200:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.415289:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.415296:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 12 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.415307:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 12 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.415326:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129826.415331:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.415340:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.415346:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.415362:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.415406:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1962:x1830949054531200:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 128us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.415413:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7932 00010000:00010000:2.0:1746129826.415691:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e43956107 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356865 expref: 11 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.415713:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054092160:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.415731:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.415739:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.415743:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129826.415761:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129826.415920:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e43956138 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356896 expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.415935:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356896 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.415941:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.415943:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129826.415945:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef000, rc 0) 00000100:00100000:2.0:1746129826.415980:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31770:x1830949054530048:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 9413us (9534us total) trans 8589945147 rc 0/0 00000100:00100000:2.0:1746129826.415987:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11121 00000100:00100000:2.0:1746129826.416045:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054530560 00000100:00100000:2.0:1746129826.416050:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054530560 00002000:00100000:2.0:1746129826.416070:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094d8c700 x1830949054530560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.416083:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c700 with x1830949054530560 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.416087:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8c700 00000100:00100000:2.0:1746129826.416110:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054530816 00000100:00100000:2.0:1746129826.416114:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054530816 00002000:00100000:2.0:1746129826.416131:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6ed500 x1830949054530816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.416137:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ed500 with x1830949054530816 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.416140:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ed500 00000100:00100000:2.0:1746129826.416154:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054531072 00000100:00100000:2.0:1746129826.416157:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054531072 00002000:00100000:2.0:1746129826.416171:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6eea00 x1830949054531072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.416178:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6eea00 with x1830949054531072 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.416180:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6eea00 00000100:00100000:2.0:1746129826.416196:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7137 00000100:00100000:2.0:1746129826.416203:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054530560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129826.417468:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7138 00000100:00100000:3.0:1746129826.417478:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054530816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.417543:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7139 00000100:00100000:2.0:1746129826.417551:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054531072:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.419381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.419615:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054531456 00000100:00100000:3.0:1746129826.419621:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054531456 00000100:00100000:3.0:1746129826.419666:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11122 00000100:00100000:3.0:1746129826.419672:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31773:x1830949054531456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.419686:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.419700:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efc00/0x48868a4e4395614d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35689d expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.419782:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419792:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419801:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419813:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419818:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419822:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419931:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e43956162 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419938:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e43956162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.419943:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e43956162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129826.419950:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129826.420014:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420037:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420042:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420047:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918efa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.420050:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420055:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420065:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129826.420067:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.420070:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420075:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efa00/0x48868a4e43956154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420094:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420098:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420102:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420106:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918ef000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.420108:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420112:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420118:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244100) 00010000:00010000:3.0:1746129826.420120:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.420122:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420125:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef000/0x48868a4e4395615b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.420156:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918efc00/0x48868a4e4395614d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35689d expref: 294 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.420167:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e43956162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35689d expref: 293 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.420172:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129826.420174:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129826.420175:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef600, rc 0) 00000100:00100000:3.0:1746129826.420202:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31773:x1830949054531456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 531us (828us total) trans 8589945148 rc 0/0 00000100:00100000:3.0:1746129826.420208:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11122 00000100:00100000:1.0:1746129826.431325:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.431626:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054531712 00000100:00100000:2.0:1746129826.431634:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054531712 00000100:00100000:2.0:1746129826.431669:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11123 00000100:00100000:2.0:1746129826.431676:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31770:x1830949054531712:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129826.431693:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.431697:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129826.431717:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef000/0x48868a4e4395613f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356896 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.431739:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.431743:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.431751:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054530304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16919us (18000us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746129826.431752:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43956170 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568a4 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.431759:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7136 00002000:00100000:3.0:1746129826.431768:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009b00df80 x1830949054530304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.431776:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949054530304 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.431780:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00df80 00010000:00010000:2.0:1746129826.432672:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432687:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432695:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432704:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432709:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432715:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432720:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bef800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.432723:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432729:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432739:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.432742:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129826.432744:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432748:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef800/0x48868a4e43956177 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.432771:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43956170 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568a4 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.432778:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e43956170 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568a4 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.432799:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee000, rc 0) 00000100:00100000:2.0:1746129826.432832:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31770:x1830949054531712:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 1156us (1514us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129826.432838:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11123 00000100:00100000:0.0:1746129826.437535:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.439404:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054531840 00000100:00100000:1.0:1746129826.439416:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054531840 00000100:00100000:1.0:1746129826.439462:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 746 00000100:00100000:1.0:1746129826.439471:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1964:x1830949054531840:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.439486:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.439510:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ef600/0x48868a4e43956162 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35689d expref: 293 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.439532:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129826.439537:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.440287:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054531072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 22733us (25139us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.440297:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7139 00002000:00100000:3.0:1746129826.440307:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6eea00 x1830949054531072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.440315:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6eea00 with x1830949054531072 ext(3145728->4194303) 00002000:00010000:3.0:1746129826.440319:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6eea00 00000100:00100000:2.0:1746129826.440911:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054530560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24705us (25891us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.440919:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7137 00002000:00100000:2.0:1746129826.440927:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880094d8c700 x1830949054530560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.440933:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094d8c700 with x1830949054530560 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.440937:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094d8c700 00000100:00100000:1.0:1746129826.441037:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1964:x1830949054531840:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1567us (3508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.441042:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 746 00000100:00100000:1.0:1746129826.441373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.441570:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.442152:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054530816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 24674us (27072us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.442159:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7138 00002000:00100000:3.0:1746129826.442168:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f6ed500 x1830949054530816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.442175:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ed500 with x1830949054530816 ext(2097152->3145727) 00002000:00010000:3.0:1746129826.442178:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ed500 00000100:00100000:2.0:1746129826.442517:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054532096 00000100:00100000:2.0:1746129826.442524:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054532096 00000100:00100000:2.0:1746129826.442557:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054532352 00000100:00100000:2.0:1746129826.442562:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054532352 00000100:00100000:2.0:1746129826.442581:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4670 00000100:00100000:2.0:1746129826.442589:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012babe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31770:x1830949054532096:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:1.0:1746129826.443223:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4671 00000100:00100000:1.0:1746129826.443233:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31773:x1830949054532352:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129826.443362:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31773:x1830949054532352:12345-192.168.204.31@tcp:35:cat.0 Request processed in 129us (1789us total) trans 8589945150 rc 0/0 00000100:00100000:1.0:1746129826.443369:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4671 00000100:00100000:2.0:1746129826.443535:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012babe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31770:x1830949054532096:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 175us (1390us total) trans 8589945149 rc 0/0 00000100:00100000:2.0:1746129826.443542:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4670 00000100:00100000:1.0:1746129826.449896:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.449972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.450080:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054532480 00000100:00100000:3.0:1746129826.450088:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054532480 00000100:00100000:3.0:1746129826.450138:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054532608 00000100:00100000:3.0:1746129826.450140:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054532608 00000100:00100000:3.0:1746129826.450155:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15853 00000100:00100000:3.0:1746129826.450161:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054532480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.450175:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.450189:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568ab expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.450205:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.450206:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.450213:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.450225:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.450234:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef600, rc 0) 00000100:00100000:3.0:1746129826.450269:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054532480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 108us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.450274:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15853 00000100:00100000:3.0:1746129826.450290:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15854 00000100:00100000:3.0:1746129826.450295:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1963:x1830949054532608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.450300:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.450308:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568b2 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.450317:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.450318:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.450322:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.450330:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.450335:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ef800, rc 0) 00000100:00100000:3.0:1746129826.450348:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1963:x1830949054532608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 54us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.450352:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15854 00000100:00100000:0.0:1746129826.451900:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.451955:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054532736 00000100:00100000:2.0:1746129826.451960:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054532736 00000100:00100000:2.0:1746129826.451981:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15855 00000100:00100000:2.0:1746129826.451987:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054532736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.451996:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.452004:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e4395618c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568b9 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.452047:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092288:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129826.452110:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.460657:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092288:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129826.460685:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e4395618c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b9 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.460698:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bee200/0x48868a4e4395618c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b9 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.460989:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee200, rc 0) 00000100:00100000:2.0:1746129826.461050:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054532736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9062us (9152us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129826.461059:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15855 00000100:00100000:0.0:1746129826.463900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.464553:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054532864 00000100:00100000:3.0:1746129826.464560:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054532864 00000100:00100000:3.0:1746129826.464598:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15856 00000100:00100000:3.0:1746129826.464606:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054532864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.464620:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.464634:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918efc00/0x48868a4e43956193 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568c0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.464681:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092416:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.464753:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00002000:00010000:3.0:1746129826.470179:0:1877:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129826 -> 1746129827 00000100:00100000:3.0:1746129826.470204:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092416:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.470295:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918efc00/0x48868a4e43956193 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568c0 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.470308:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918efc00/0x48868a4e43956193 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568c0 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.475354:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918efc00, rc 0) 00000100:00100000:3.0:1746129826.475444:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054532864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10834us (11546us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.475452:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15856 00000100:00100000:1.0:1746129826.475724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.476072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.476127:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054533120 00000100:00100000:3.0:1746129826.476133:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054533120 00002000:00100000:3.0:1746129826.476169:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880092ad9500 x1830949054533120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 504/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.476177:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9500 with x1830949054533120 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.476182:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9500 00000100:00100000:3.0:1746129826.476193:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054533248 00000100:00100000:3.0:1746129826.476195:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054533248 00002000:00100000:3.0:1746129826.476204:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092ada300 x1830949054533248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.476215:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949054533248 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.476218:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:3.0:1746129826.476227:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7140 00000100:00100000:3.0:1746129826.476234:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054533120:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129826.476779:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7141 00000100:00100000:3.0:1746129826.476786:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054533248:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.486152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.486248:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054533632 00000100:00100000:3.0:1746129826.486256:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054533632 00002000:00100000:3.0:1746129826.486293:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00dc00 x1830949054533632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.486302:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949054533632 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.486306:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:3.0:1746129826.486324:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7142 00000100:00100000:3.0:1746129826.486331:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054533632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.496079:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.496278:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054533760 00000100:00100000:3.0:1746129826.496286:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054533760 00000100:00100000:3.0:1746129826.496319:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15857 00000100:00100000:3.0:1746129826.496326:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054533760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.496341:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.496358:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6fe800/0x48868a4e4395619a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568c7 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.496403:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092544:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.496477:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.496715:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1964:x1830949054533120:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20480us (20991us total) trans 0 rc 471040/471040 00000100:00100000:2.0:1746129826.496722:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7140 00002000:00100000:2.0:1746129826.496731:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880092ad9500 x1830949054533120/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 504/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 471040/471040 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.496739:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9500 with x1830949054533120 ext(1048576->2097151) 00002000:00010000:2.0:1746129826.496742:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad9500 00000100:00100000:3.0:1746129826.497168:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054533248:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20382us (21095us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.497174:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7141 00002000:00100000:3.0:1746129826.497179:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff880092ada300 x1830949054533248/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.497186:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949054533248 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.497188:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:3.0:1746129826.501135:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054533632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14796us (14982us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129826.501145:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7142 00002000:00100000:3.0:1746129826.501155:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00dc00 x1830949054533632/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.501163:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949054533632 ext(1048576->2097151) 00002000:00010000:3.0:1746129826.501168:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:3.0:1746129826.511915:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092544:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.511948:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6fe800/0x48868a4e4395619a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568c7 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.511962:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6fe800/0x48868a4e4395619a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568c7 expref: 14 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.511974:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6fe800, rc 0) 00000100:00100000:3.0:1746129826.512032:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054533760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 15705us (15962us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.512040:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15857 00000100:00100000:0.0:1746129826.559300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.559363:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054533888 00000100:00100000:3.0:1746129826.559371:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054533888 00000100:00100000:3.0:1746129826.559417:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15858 00000100:00100000:3.0:1746129826.559424:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31768:x1830949054533888:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129826.559437:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.559451:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568ce expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.559474:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.559481:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.559487:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.559492:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.559493:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.559495:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2473984->3145727] (req 2473984->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.559516:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.559525:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.559536:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092672:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.559632:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 6 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.559639:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 6 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.559647:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092800:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.559669:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.559677:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 23 pid: 8435 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.559684:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092928:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.559699:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.565510:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092672:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.565522:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092800:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.565529:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054092928:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.565560:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2473984->3145727] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.565582:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b154800, rc 0) 00000100:00100000:3.0:1746129826.565628:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31768:x1830949054533888:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6203us (6335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.565635:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15858 00000100:00100000:0.0:1746129826.566690:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.566729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.566803:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054534144 00000100:00100000:1.0:1746129826.566808:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054534144 00010000:00010000:1.0:1746129826.566832:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.566884:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054534016 00000100:00100000:1.0:1746129826.566887:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054534016 00010000:00010000:1.0:1746129826.566895:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 7 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.566910:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7933 00000100:00100000:2.0:1746129826.566919:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054534144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.566930:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.566949:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.566959:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.566976:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1fc00/0x48868a4e43956089 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35683b expref: 14 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.566991:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.567014:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1962:x1830949054534144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 97us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.567316:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7934 00000100:00100000:1.0:1746129826.567323:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054534016:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.567330:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.567339:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 7 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.567347:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 7 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.567358:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918efe00/0x48868a4e43956131 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35688f expref: 7 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.567370:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.567387:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054534016:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.567392:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7934 00000100:00100000:2.0:1746129826.567422:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7933 00000100:00100000:0.0:1746129826.572615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.573444:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054534272 00000100:00100000:3.0:1746129826.573452:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054534272 00010000:00010000:3.0:1746129826.573486:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 24 pid: 8435 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.573527:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7935 00000100:00100000:3.0:1746129826.573535:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054534272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.573548:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.573566:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 24 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.573577:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 24 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.573596:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a507f400/0x48868a4e43956058 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35681f expref: 24 pid: 8435 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.575731:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.575737:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.575747:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.575762:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.575799:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.575811:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054093056:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129826.576012:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.581837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.581886:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054534528 00000100:00100000:2.0:1746129826.581894:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054534528 00000100:00100000:3.0:1746129826.581905:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054093056:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129826.581925:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746129826.581930:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2473984->2478079) req@ffff88012c043100 x1830949054534528/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.581939:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043100 with x1830949054534528 ext(2473984->2478079) 00002000:00010000:2.0:1746129826.581943:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043100 00000100:00100000:3.0:1746129826.581956:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054534272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8422us (9351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.581962:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7143 00000100:00100000:3.0:1746129826.581964:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7935 00000100:00100000:2.0:1746129826.581969:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054534528:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129826.582112:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1964:x1830949054534528:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 143us (279us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.582118:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7143 00002000:00100000:2.0:1746129826.582122:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f4:0x0] (2473984->2478079) req@ffff88012c043100 x1830949054534528/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.582129:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043100 with x1830949054534528 ext(2473984->2478079) 00002000:00010000:2.0:1746129826.582132:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043100 00000100:00100000:0.0:1746129826.586539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.586724:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054534784 00000100:00100000:2.0:1746129826.586730:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054534784 00000100:00100000:2.0:1746129826.586780:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11124 00000100:00100000:2.0:1746129826.586787:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31778:x1830949054534784:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.586807:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.586822:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439561a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568d5 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.586931:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.586945:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.586953:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.586965:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.586970:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.586975:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587068:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587075:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587080:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129826.587088:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129826.587162:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587168:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587174:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587178:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093beec00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.587182:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587187:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587196:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129826.587199:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129826.587202:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587206:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093beec00/0x48868a4e439561af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587230:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587235:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587239:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587243:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093bee200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129826.587245:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587249:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587255:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e29a500) 00010000:00010000:2.0:1746129826.587257:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129826.587258:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587265:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee200/0x48868a4e439561b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.587293:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bef600/0x48868a4e439561a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 296 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.587302:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 295 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.587308:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.587310:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129826.587312:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee000, rc 0) 00000100:00100000:2.0:1746129826.587361:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31778:x1830949054534784:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 575us (832us total) trans 8589945151 rc 0/0 00000100:00100000:2.0:1746129826.587368:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11124 00000100:00100000:0.0:1746129826.594078:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.594136:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054534912 00000100:00100000:3.0:1746129826.594144:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054534912 00000100:00100000:3.0:1746129826.594192:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15859 00000100:00100000:3.0:1746129826.594199:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31768:x1830949054534912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129826.594212:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.594288:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568dc expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.594314:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.594322:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 7 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.594329:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.594335:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.594337:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.594340:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3506175] (req 3145728->3506175) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.594365:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 16 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.594375:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 16 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.594385:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054093184:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.594468:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 7 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.594476:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 7 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746129826.594483:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054093312:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.594505:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.594515:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.594522:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054093440:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.594535:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.611938:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.612241:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535040 00000100:00100000:2.0:1746129826.612249:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535040 00000100:00100000:2.0:1746129826.612302:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15860 00000100:00100000:2.0:1746129826.612309:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31778:x1830949054535040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.612324:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.612339:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568e3 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.612364:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.612372:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.612379:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.612385:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.612386:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.612389:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1359872->1785855] (req 1359872->1785855) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.612411:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.612421:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 5 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.612431:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054093568:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.612513:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.612522:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 24 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.612530:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054093696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.612553:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 12 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.612566:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.612573:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054093824:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.612587:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.614746:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054093184:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.614757:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054093312:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.614764:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054093440:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.614790:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3506175] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.614803:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e78000, rc 0) 00000100:00100000:3.0:1746129826.614841:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31768:x1830949054534912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 20642us (20769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.614868:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15859 00000100:00100000:0.0:1746129826.618257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.618297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.618357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.618369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.618387:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535296 00000100:00100000:0.0:1746129826.618393:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535296 00010000:00010000:0.0:1746129826.618421:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 8 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.618426:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535168 00000100:00100000:1.0:1746129826.618430:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535168 00000100:00100000:0.0:1746129826.618443:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535424 00010000:00010000:1.0:1746129826.618444:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746129826.618445:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535424 00010000:00010000:0.0:1746129826.618455:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 6 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.618459:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535680 00000100:00100000:1.0:1746129826.618461:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535680 00000100:00100000:0.0:1746129826.618472:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7936 00010000:00010000:1.0:1746129826.618475:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746129826.618478:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054535296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129826.618486:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7937 00010000:00010000:0.0:1746129826.618488:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129826.618491:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054535168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.618498:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.618507:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746129826.618507:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 8 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.618516:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.618564:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7938 00000100:00100000:3.0:1746129826.618570:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7939 00000100:00100000:2.0:1746129826.618571:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054535424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.618579:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129826.618580:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054535680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.618588:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.618592:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 6 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.618597:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.618600:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 6 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746129826.619011:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 8 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.619194:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094335400/0x48868a4e43956012 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567d9 expref: 14 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.619211:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.619245:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130566050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054535168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 752us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.619251:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7937 00000100:00100000:1.0:1746129826.619319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.619333:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535552 00000100:00100000:1.0:1746129826.619336:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535552 00010000:00010000:1.0:1746129826.619346:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 25 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.619359:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7940 00000100:00100000:1.0:1746129826.619363:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054535552:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.619371:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129826.619400:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918ef200/0x48868a4e4395612a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356888 expref: 8 pid: 3623 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746129826.619415:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129826.619437:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054535296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 959us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129826.619442:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7936 00010000:00010000:3.0:1746129826.621901:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 13 pid: 20441 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.621926:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.621956:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1963:x1830949054535680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3380us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.621962:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7939 00010000:00010000:2.0:1746129826.622500:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129826.622508:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 25 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.622518:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 25 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.622528:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129826.622530:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054535424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3959us (4171us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129826.622530:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746129826.622535:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7938 00010000:00010000:2.0:1746129826.622574:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918ee400/0x48868a4e4395611c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35687a expref: 5 pid: 3623 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.622587:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054093568:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.622596:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918ef600/0x48868a4e4395617e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ab expref: 25 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.622608:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054093696:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.622616:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb52c00/0x48868a4e439560ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356849 expref: 12 pid: 20441 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.622623:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054093824:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129826.622707:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129826.622715:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.622756:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129826.622796:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.622803:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef800, rc 0) 00010000:00010000:1.0:1746129826.622804:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.622806:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054535808 00000100:00100000:3.0:1746129826.622812:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054535808 00000100:00100000:1.0:1746129826.622815:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054093952:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.622820:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31778:x1830949054535040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 10513us (10890us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.622825:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15860 00010000:00010000:3.0:1746129826.622833:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 17 pid: 20441 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.622860:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.622868:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7941 00000100:00100000:3.0:1746129826.622875:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054535808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.622883:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.622898:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 17 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.622907:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 17 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.622920:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a022ce00/0x48868a4e4395604a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356803 expref: 17 pid: 20441 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746129826.622932:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.622933:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.622937:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.622948:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.622966:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.622973:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054094080:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129826.623029:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.624595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.624697:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054536064 00000100:00100000:1.0:1746129826.624701:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054536064 00002000:00100000:1.0:1746129826.624727:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1359872->1363967) req@ffff8800a504dc00 x1830949054536064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.624734:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949054536064 ext(1359872->1363967) 00002000:00010000:1.0:1746129826.624738:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:1.0:1746129826.624768:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7144 00000100:00100000:1.0:1746129826.624773:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054536064:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129826.624905:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054536064:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 131us (312us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129826.625052:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054093952:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129826.625062:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129826.625078:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1963:x1830949054535552:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5715us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129826.625088:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7940 00000100:00100000:2.0:1746129826.625167:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054094080:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.625177:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.625190:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054535808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2317us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.625195:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7941 00000100:00100000:1.0:1746129826.625615:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7144 00002000:00100000:1.0:1746129826.625622:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1359872->1363967) req@ffff8800a504dc00 x1830949054536064/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.625629:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504dc00 with x1830949054536064 ext(1359872->1363967) 00002000:00010000:1.0:1746129826.625632:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504dc00 00000100:00100000:0.0:1746129826.630712:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.630754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.630812:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054536576 00000100:00100000:1.0:1746129826.630812:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054536320 00000100:00100000:3.0:1746129826.630819:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054536576 00000100:00100000:1.0:1746129826.630819:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054536320 00002000:00100000:3.0:1746129826.630878:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1781760->1785855) req@ffff88012c043b80 x1830949054536576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.630879:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3502080->3506175) req@ffff88012c042300 x1830949054536320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.630886:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043b80 with x1830949054536576 ext(1781760->1785855) 00002000:00100000:1.0:1746129826.630886:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042300 with x1830949054536320 ext(3502080->3506175) 00002000:00010000:3.0:1746129826.630890:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043b80 00002000:00010000:1.0:1746129826.630890:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c042300 00000100:00100000:1.0:1746129826.631257:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7145 00000100:00100000:3.0:1746129826.631264:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7146 00000100:00100000:1.0:1746129826.631265:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054536320:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129826.631271:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054536576:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129826.631666:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054536576:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 395us (910us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129826.631666:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054536320:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 400us (958us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129826.631672:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7146 00002000:00100000:3.0:1746129826.631678:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1781760->1785855) req@ffff88012c043b80 x1830949054536576/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.631685:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043b80 with x1830949054536576 ext(1781760->1785855) 00002000:00010000:3.0:1746129826.631687:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043b80 00000100:00100000:1.0:1746129826.631799:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7145 00002000:00100000:1.0:1746129826.631805:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3502080->3506175) req@ffff88012c042300 x1830949054536320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.631812:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042300 with x1830949054536320 ext(3502080->3506175) 00002000:00010000:1.0:1746129826.631816:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c042300 00000100:00100000:0.0:1746129826.634751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.634826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.634888:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054536832 00000100:00100000:3.0:1746129826.634896:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054536832 00000100:00100000:3.0:1746129826.634946:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537088 00000100:00100000:3.0:1746129826.634949:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537088 00000100:00100000:3.0:1746129826.634967:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4672 00000100:00100000:3.0:1746129826.634973:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31778:x1830949054536832:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:1.0:1746129826.635083:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4673 00000100:00100000:1.0:1746129826.635091:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31768:x1830949054537088:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129826.635193:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31778:x1830949054536832:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 219us (447us total) trans 8589945152 rc 0/0 00000100:00100000:1.0:1746129826.635194:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31768:x1830949054537088:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 104us (367us total) trans 8589945153 rc 0/0 00000100:00100000:3.0:1746129826.635199:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4672 00000100:00100000:1.0:1746129826.635202:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4673 00000100:00100000:0.0:1746129826.673395:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.673885:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537216 00000100:00100000:2.0:1746129826.673893:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537216 00000100:00100000:0.0:1746129826.674407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.674805:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537344 00000100:00100000:2.0:1746129826.674809:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537344 00000100:00100000:2.0:1746129826.674834:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15861 00000100:00100000:2.0:1746129826.674841:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054537216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.674875:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.674889:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e439561d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568ea expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.674934:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054094208:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129826.675022:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.675045:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15862 00000100:00100000:2.0:1746129826.675050:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054537344:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.675057:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.675066:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439561e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568f1 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.675090:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054094336:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129826.675109:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00002000:00010000:2.0:1746129826.681441:0:20441:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime: 1746129826 -> 1746129827 00002000:00010000:2.0:1746129826.681448:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129826 -> 1746129827 00002000:00010000:2.0:1746129826.681450:0:20441:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime: 1746129826 -> 1746129827 00000100:00100000:2.0:1746129826.681470:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054094336:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129826.681498:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439561e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568f1 expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.681510:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439561e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568f1 expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.681522:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befa00, rc 0) 00002000:00010000:3.0:1746129826.682886:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime: 1746129826 -> 1746129827 00002000:00010000:3.0:1746129826.682891:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129826 -> 1746129827 00002000:00010000:3.0:1746129826.682892:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime: 1746129826 -> 1746129827 00000100:00100000:3.0:1746129826.682912:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054094208:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.682934:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e439561d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ea expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.682948:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093befe00/0x48868a4e439561d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ea expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.682962:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befe00, rc 0) 00000100:00100000:2.0:1746129826.684486:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054537344:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9429us (10074us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129826.684496:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15862 00000100:00100000:3.0:1746129826.684589:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054537216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9747us (11200us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.684595:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15861 00000100:00100000:0.0:1746129826.696831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.696938:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537600 00000100:00100000:1.0:1746129826.696946:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537600 00002000:00100000:1.0:1746129826.696981:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012c041180 x1830949054537600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 504/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.696990:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041180 with x1830949054537600 ext(1048576->2097151) 00002000:00010000:1.0:1746129826.696995:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c041180 00000100:00100000:1.0:1746129826.697031:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7147 00000100:00100000:1.0:1746129826.697039:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054537600:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.705100:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054537600:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8053us (8266us total) trans 0 rc 622592/622592 00000100:00100000:1.0:1746129826.705110:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7147 00002000:00100000:1.0:1746129826.705120:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012c041180 x1830949054537600/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 504/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 622592/622592 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.705129:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041180 with x1830949054537600 ext(1048576->2097151) 00002000:00010000:1.0:1746129826.705133:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c041180 00000100:00100000:0.0:1746129826.712348:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.712396:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.712494:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537728 00000100:00100000:3.0:1746129826.712501:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537728 00000100:00100000:2.0:1746129826.712528:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537856 00000100:00100000:2.0:1746129826.712531:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537856 00000100:00100000:3.0:1746129826.712551:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15863 00000100:00100000:3.0:1746129826.712558:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054537728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.712575:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.712589:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b154000/0x48868a4e439561e7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568f8 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.712608:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15864 00000100:00100000:2.0:1746129826.712613:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054537856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.712620:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.712628:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439561ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3568ff expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.712636:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054094464:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129826.712647:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054094592:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.712698:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.712757:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.714311:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054094464:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.714340:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b154000/0x48868a4e439561e7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568f8 expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.714350:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b154000/0x48868a4e439561e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568f8 expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.714374:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b154000, rc 0) 00000100:00100000:3.0:1746129826.714410:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1964:x1830949054537728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1851us (2068us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.714416:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15863 00000100:00100000:3.0:1746129826.715140:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054094592:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.715157:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439561ee lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ff expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.715166:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439561ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ff expref: 24 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.715174:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befa00, rc 0) 00000100:00100000:3.0:1746129826.715192:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054537856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2578us (2795us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.715197:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15864 00000100:00100000:0.0:1746129826.718993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.719059:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054537984 00000100:00100000:3.0:1746129826.719067:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054537984 00000100:00100000:3.0:1746129826.719116:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15865 00000100:00100000:3.0:1746129826.719124:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31784:x1830949054537984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.719138:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.719153:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356906 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.719176:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.719186:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129826.719187:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129826.719190:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.719213:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 12 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.719223:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.719233:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054094720:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.719972:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.721987:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054094720:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.722033:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 17 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.722048:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907400, rc 0) 00000100:00100000:3.0:1746129826.722099:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31784:x1830949054537984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2975us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.722107:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15865 00000100:00100000:0.0:1746129826.722687:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.723071:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054538112 00000100:00100000:1.0:1746129826.723077:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054538112 00002000:00100000:1.0:1746129826.723107:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3506175) req@ffff88009b00fb80 x1830949054538112/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.723116:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054538112 ext(3145728->3506175) 00010000:00010000:1.0:1746129826.723122:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 13 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.723132:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 13 pid: 1877 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746129826.723137:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00fb80 00000100:00100000:1.0:1746129826.723163:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1929 00000100:00100000:1.0:1746129826.723169:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054538112:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129826.730783:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054538112:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 7606us (8090us total) trans 21474841391 rc 0/0 00000100:00100000:1.0:1746129826.730794:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1929 00002000:00100000:1.0:1746129826.730804:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3506175) req@ffff88009b00fb80 x1830949054538112/t21474841391(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.730813:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054538112 ext(3145728->3506175) 00010000:00010000:1.0:1746129826.730823:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.730836:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746129826.730842:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00fb80 00000100:00100000:0.0:1746129826.733714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.733823:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054538240 00000100:00100000:2.0:1746129826.733830:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054538240 00010000:00010000:2.0:1746129826.733889:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.733917:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7942 00000100:00100000:2.0:1746129826.733924:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054538240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.733935:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.733952:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.733964:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.733987:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e78000/0x48868a4e439561cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3506175) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568dc expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.734801:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.734804:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.734811:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.734819:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.734929:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.734941:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054094848:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.735023:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.737100:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054094848:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.737115:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.737156:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054538240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3230us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.737164:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7942 00000100:00100000:0.0:1746129826.740300:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.740669:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054538496 00000100:00100000:1.0:1746129826.740678:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054538496 00002000:00100000:1.0:1746129826.740716:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009207c700 x1830949054538496/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.740726:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c700 with x1830949054538496 ext(2097152->3145727) 00002000:00010000:1.0:1746129826.740731:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207c700 00000100:00100000:1.0:1746129826.740761:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7148 00000100:00100000:1.0:1746129826.740768:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054538496:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.753540:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.753680:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054538752 00000100:00100000:3.0:1746129826.753687:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054538752 00000100:00100000:3.0:1746129826.753730:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11125 00000100:00100000:3.0:1746129826.753737:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31787:x1830949054538752:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.753755:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.753770:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906a00/0x48868a4e439561fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35690d expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.753784:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054538496:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13016us (13491us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.753791:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7148 00002000:00100000:2.0:1746129826.753798:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009207c700 x1830949054538496/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.753806:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207c700 with x1830949054538496 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.753809:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207c700 00010000:00010000:3.0:1746129826.753866:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.753877:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.753885:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.753896:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.753901:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.753909:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.753994:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754001:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754007:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129826.754134:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129826.754221:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754228:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754234:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754239:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f907800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.754242:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754248:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754256:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129826.754259:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.754262:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754424:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907800/0x48868a4e43956203 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754443:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754448:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754452:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754456:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f907000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129826.754458:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754462:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754468:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244200) 00010000:00010000:3.0:1746129826.754471:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129826.754473:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754477:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f907000/0x48868a4e4395620a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.754513:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906a00/0x48868a4e439561fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.754523:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 23 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.754545:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129826.754547:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129826.754549:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f906c00, rc 0) 00000100:00100000:3.0:1746129826.755008:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31787:x1830949054538752:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1271us (1473us total) trans 8589945154 rc 0/0 00000100:00100000:3.0:1746129826.755025:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11125 00000100:00100000:0.0:1746129826.758389:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.758540:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054538880 00000100:00100000:3.0:1746129826.758548:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054538880 00000100:00100000:3.0:1746129826.758664:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15866 00000100:00100000:3.0:1746129826.758672:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31784:x1830949054538880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.758688:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.758702:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356914 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.758726:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.758733:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129826.758735:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129826.758738:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.758763:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 11 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.758772:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 11 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.758782:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054094976:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.759304:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.759518:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.759572:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539136 00000100:00100000:0.0:1746129826.759575:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539136 00000100:00100000:0.0:1746129826.759654:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4674 00000100:00100000:0.0:1746129826.759660:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31787:x1830949054539136:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:0.0:1746129826.759802:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31787:x1830949054539136:12345-192.168.204.31@tcp:35:cat.0 Request processed in 142us (284us total) trans 8589945155 rc 0/0 00000100:00100000:0.0:1746129826.759808:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4674 00000100:00100000:0.0:1746129826.761398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.761476:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054094976:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.761500:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.761513:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f907600, rc 0) 00000100:00100000:2.0:1746129826.761800:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539264 00000100:00100000:2.0:1746129826.761805:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539264 00002000:00100000:2.0:1746129826.761842:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2473984->3145727) req@ffff88009207dc00 x1830949054539264/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.761870:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949054539264 ext(2473984->3145727) 00010000:00010000:2.0:1746129826.761876:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.761887:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 12 pid: 1877 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.761892:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207dc00 00000100:00100000:2.0:1746129826.761916:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1930 00000100:00100000:2.0:1746129826.761923:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1961:x1830949054539264:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129826.762305:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31784:x1830949054538880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3538us (3828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.762312:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15866 00000100:00100000:0.0:1746129826.762397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.762412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.762423:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539392 00000100:00100000:0.0:1746129826.762426:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539392 00000100:00100000:0.0:1746129826.762530:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15867 00000100:00100000:0.0:1746129826.762536:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:1961:x1830949054539392:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129826.762546:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129826.762557:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d5dfa00/0x48868a4e43956226 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35691b expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129826.762589:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054095104:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.762619:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539648 00000100:00100000:3.0:1746129826.762622:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539648 00000100:00100000:0.0:1746129826.762629:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.762640:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15868 00000100:00100000:3.0:1746129826.762644:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054539648:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129826.762649:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129826.762650:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.762659:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356929 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.762669:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.762670:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.762677:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.762688:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129826.762698:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129826.762699:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b154200, rc 0) 00000100:00100000:2.0:1746129826.762790:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539520 00000100:00100000:2.0:1746129826.762794:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539520 00000100:00100000:2.0:1746129826.762808:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539776 00000100:00100000:2.0:1746129826.762810:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539776 00000100:00100000:1.0:1746129826.762813:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15869 00000100:00100000:1.0:1746129826.762819:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054539520:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129826.762828:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129826.762835:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093724a00/0x48868a4e43956234 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356922 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129826.762869:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054095232:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129826.762901:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.764291:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15870 00000100:00100000:2.0:1746129826.764303:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054539776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.764315:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.764325:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e4395623b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356930 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.764365:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054095360:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.764478:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054539648:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1831us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.764483:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15868 00000100:00100000:2.0:1746129826.764571:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd480 going to sleep for 11 seconds 00002000:00010000:0.0:1746129826.765341:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129826 -> 1746129827 00002000:00010000:0.0:1746129826.765345:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129826 -> 1746129827 00000100:00100000:0.0:1746129826.765358:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054095104:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129826.765378:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d5dfa00/0x48868a4e43956226 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35691b expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129826.765387:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d5dfa00/0x48868a4e43956226 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35691b expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129826.765395:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d5dfa00, rc 0) 00000100:00100000:0.0:1746129826.765418:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054539392:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2882us (3021us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129826.765423:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15867 00002000:00010000:2.0:1746129826.765957:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129826 -> 1746129827 00002000:00010000:2.0:1746129826.765960:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129826 -> 1746129827 00002000:00010000:2.0:1746129826.765962:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129826 -> 1746129827 00000100:00100000:2.0:1746129826.765971:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054095232:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129826.765988:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093724a00/0x48868a4e43956234 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356922 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.765995:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093724a00/0x48868a4e43956234 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356922 expref: 17 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.766027:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093724a00, rc 0) 00000100:00100000:2.0:1746129826.766056:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054539520:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3237us (3405us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129826.766061:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15869 00000100:00100000:3.0:1746129826.768396:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054095360:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.768420:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e4395623b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356930 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.768431:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bef600/0x48868a4e4395623b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356930 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.768455:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bef600, rc 0) 00000100:00100000:3.0:1746129826.768501:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054539776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4201us (5799us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.768507:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15870 00000100:00100000:1.0:1746129826.774445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.774695:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054539904 00000100:00100000:3.0:1746129826.774703:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054539904 00000100:00100000:3.0:1746129826.774917:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15871 00000100:00100000:3.0:1746129826.774925:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31787:x1830949054539904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.774940:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.774956:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356937 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.774980:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.774988:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129826.774990:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129826.774992:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.775027:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.775036:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 23 pid: 8437 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.775046:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054095488:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.775614:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.776287:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054539264:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 14361us (14890us total) trans 17179874196 rc 0/0 00000100:00100000:2.0:1746129826.776296:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1930 00002000:00100000:2.0:1746129826.776304:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2473984->3145727) req@ffff88009207dc00 x1830949054539264/t17179874196(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.776311:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207dc00 with x1830949054539264 ext(2473984->3145727) 00010000:00010000:2.0:1746129826.776319:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 16 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.776329:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 16 pid: 1877 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746129826.776334:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207dc00 00000100:00100000:3.0:1746129826.780916:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054095488:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.780951:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.780965:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f906a00, rc 0) 00000100:00100000:3.0:1746129826.781022:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31787:x1830949054539904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6089us (7970us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.781030:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15871 00000100:00100000:0.0:1746129826.781347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.781412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.781530:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054540032 00000100:00100000:3.0:1746129826.781535:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054540032 00000100:00100000:2.0:1746129826.781556:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054540160 00000100:00100000:2.0:1746129826.781559:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054540160 00002000:00100000:3.0:1746129826.781564:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1101824->1679359) req@ffff88009207df80 x1830949054540032/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746129826.781572:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00002000:00100000:3.0:1746129826.781578:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949054540032 ext(1101824->1679359) 00010000:00010000:3.0:1746129826.781582:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 24 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.781591:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 24 pid: 8437 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.781597:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207df80 00000100:00100000:2.0:1746129826.781600:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7943 00000100:00100000:2.0:1746129826.781606:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054540160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129826.781612:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1931 00010000:00010000:2.0:1746129826.781616:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129826.781617:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054540032:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:2.0:1746129826.781633:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.781640:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.781657:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b154800/0x48868a4e439561a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2473984->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568ce expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.781671:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.781672:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.781678:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.781689:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.781710:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.781719:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054095616:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.781775:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.789603:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054095616:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.789622:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.789670:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054540160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8063us (8323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.789680:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7943 00000100:00100000:0.0:1746129826.792021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.792052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.792088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.792232:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054540544 00000100:00100000:2.0:1746129826.792238:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054540544 00002000:00100000:2.0:1746129826.792268:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009207d880 x1830949054540544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.792277:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949054540544 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.792281:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d880 00000100:00100000:2.0:1746129826.792293:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054540672 00000100:00100000:2.0:1746129826.792295:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054540672 00002000:00100000:2.0:1746129826.792302:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009207e300 x1830949054540672/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.792308:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949054540672 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.792310:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:2.0:1746129826.792322:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054540928 00000100:00100000:2.0:1746129826.792324:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054540928 00002000:00100000:2.0:1746129826.792333:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009207f100 x1830949054540928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.792338:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949054540928 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.792341:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:2.0:1746129826.792350:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7149 00000100:00100000:2.0:1746129826.792355:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054540544:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.792617:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7150 00000100:00100000:1.0:1746129826.792625:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054540672:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.793247:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7151 00000100:00100000:0.0:1746129826.793254:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054540928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129826.793411:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054540032:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11793us (11998us total) trans 17179874197 rc 0/0 00000100:00100000:3.0:1746129826.793418:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1931 00002000:00100000:3.0:1746129826.793424:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1101824->1679359) req@ffff88009207df80 x1830949054540032/t17179874197(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.793430:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207df80 with x1830949054540032 ext(1101824->1679359) 00010000:00010000:3.0:1746129826.793436:0:25617:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 30 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746129826.793447:0:25617:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 30 pid: 8437 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746129826.793453:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009207df80 00000100:00100000:0.0:1746129826.803497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.803594:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054541056 00000100:00100000:2.0:1746129826.803601:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054541056 00010000:00010000:2.0:1746129826.803632:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 30 pid: 8437 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.803658:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7944 00000100:00100000:2.0:1746129826.803663:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054541056:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.803674:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.803693:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 30 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.803704:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 30 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.803722:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb6200/0x48868a4e439560e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1101824->1679359) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356857 expref: 30 pid: 8437 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.803743:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.803745:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.803750:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.803757:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.803787:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.803799:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054095744:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.803898:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.804752:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054540544:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12394us (12744us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.804758:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7149 00002000:00100000:2.0:1746129826.804764:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009207d880 x1830949054540544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.804770:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207d880 with x1830949054540544 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.804773:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207d880 00000100:00100000:2.0:1746129826.805995:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054095744:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.806007:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.806051:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054541056:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2386us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.806061:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7944 00000100:00100000:0.0:1746129826.806137:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054540928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12877us (14041us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129826.806145:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7151 00002000:00100000:0.0:1746129826.806152:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009207f100 x1830949054540928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129826.806159:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207f100 with x1830949054540928 ext(3145728->4194303) 00002000:00010000:0.0:1746129826.806163:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207f100 00000100:00100000:1.0:1746129826.807265:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054540672:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14638us (15209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.807272:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7150 00002000:00100000:1.0:1746129826.807278:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009207e300 x1830949054540672/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.807289:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e300 with x1830949054540672 ext(3145728->4194303) 00002000:00010000:1.0:1746129826.807291:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e300 00000100:00100000:0.0:1746129826.812088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.812144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.812229:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054541312 00000100:00100000:1.0:1746129826.812237:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054541312 00002000:00100000:1.0:1746129826.812270:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009207ea00 x1830949054541312/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.812279:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949054541312 ext(1048576->2097151) 00002000:00010000:1.0:1746129826.812284:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207ea00 00000100:00100000:1.0:1746129826.812301:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7152 00000100:00100000:1.0:1746129826.812307:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054541312:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129826.812441:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054541440 00000100:00100000:3.0:1746129826.812446:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054541440 00000100:00100000:3.0:1746129826.812473:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15872 00000100:00100000:3.0:1746129826.812477:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054541440:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.812485:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.812498:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35693e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.812513:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.812514:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.812520:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.812532:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.812541:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87bc00, rc 0) 00000100:00100000:3.0:1746129826.812575:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054541440:12345-192.168.204.31@tcp:101:cat.0 Request processed in 97us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.812580:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15872 00000100:00100000:1.0:1746129826.822410:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054541312:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10093us (10321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.822421:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7152 00002000:00100000:1.0:1746129826.822431:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009207ea00 x1830949054541312/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.822440:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207ea00 with x1830949054541312 ext(1048576->2097151) 00002000:00010000:1.0:1746129826.822444:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207ea00 00000100:00100000:0.0:1746129826.822837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.822948:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054541696 00000100:00100000:1.0:1746129826.822955:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054541696 00002000:00100000:1.0:1746129826.822982:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009207fb80 x1830949054541696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.822989:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207fb80 with x1830949054541696 ext(4194304->4931583) 00002000:00010000:1.0:1746129826.822992:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207fb80 00000100:00100000:1.0:1746129826.823029:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7153 00000100:00100000:1.0:1746129826.823037:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054541696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.826992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.827080:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054541824 00000100:00100000:2.0:1746129826.827088:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054541824 00000100:00100000:2.0:1746129826.827136:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15873 00000100:00100000:2.0:1746129826.827144:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31787:x1830949054541824:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.827159:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.827174:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356945 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.827201:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 25 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.827208:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129826.827210:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129826.827213:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.827242:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 25 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.827252:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 25 pid: 7976 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.827263:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054095872:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.827341:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.828902:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1964:x1830949054541696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5861us (6061us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129826.828911:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7153 00002000:00100000:1.0:1746129826.828919:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009207fb80 x1830949054541696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.828928:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207fb80 with x1830949054541696 ext(4194304->4931583) 00002000:00010000:1.0:1746129826.828932:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009207fb80 00000100:00100000:2.0:1746129826.829380:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054095872:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.829400:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.829412:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217c00, rc 0) 00000100:00100000:2.0:1746129826.829433:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31787:x1830949054541824:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2291us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.829439:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15873 00000100:00100000:0.0:1746129826.829750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.829871:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054541952 00000100:00100000:1.0:1746129826.829875:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054541952 00002000:00100000:1.0:1746129826.829897:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1359872->1785855) req@ffff88012ffb0000 x1830949054541952/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.829905:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb0000 with x1830949054541952 ext(1359872->1785855) 00010000:00010000:1.0:1746129826.829910:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 26 pid: 7976 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.829919:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 26 pid: 7976 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746129826.829924:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ffb0000 00000100:00100000:1.0:1746129826.829939:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1932 00000100:00100000:1.0:1746129826.829943:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054541952:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129826.839936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.840186:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054542080 00000100:00100000:3.0:1746129826.840195:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054542080 00000100:00100000:3.0:1746129826.840239:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15874 00000100:00100000:3.0:1746129826.840247:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054542080:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.840266:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.840283:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43956257 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35694c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129826.840333:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054096000:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129826.840393:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.848948:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054541952:12345-192.168.204.31@tcp:4:cat.0 Request processed in 18993us (19188us total) trans 17179874198 rc 0/0 00000100:00100000:1.0:1746129826.848961:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1932 00002000:00100000:1.0:1746129826.848972:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1359872->1785855) req@ffff88012ffb0000 x1830949054541952/t17179874198(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/448 e 0 to 0 dl 1746129837 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.848981:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb0000 with x1830949054541952 ext(1359872->1785855) 00010000:00010000:1.0:1746129826.848992:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 30 pid: 7976 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.849007:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 30 pid: 7976 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746129826.849024:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ffb0000 00000100:00100000:3.0:1746129826.851529:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054096000:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129826.851603:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43956257 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35694c expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.851616:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87a200/0x48868a4e43956257 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35694c expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.851637:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87a200, rc 0) 00000100:00100000:3.0:1746129826.852079:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054542080:12345-192.168.204.31@tcp:101:cat.0 Request processed in 11832us (12148us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129826.852087:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15874 00000100:00100000:0.0:1746129826.858257:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.858465:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054542208 00000100:00100000:2.0:1746129826.858473:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054542208 00010000:00010000:2.0:1746129826.858503:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 28 pid: 7976 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746129826.858919:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.861573:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7945 00000100:00100000:2.0:1746129826.861588:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054542208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.861604:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.861626:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 28 pid: 7976 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.861640:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 28 pid: 7976 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.861659:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bef800/0x48868a4e439561d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1359872->1785855) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568e3 expref: 28 pid: 7976 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.861678:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.861679:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.861686:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.861693:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.861721:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.861732:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054096128:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.861802:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.861884:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054542336 00000100:00100000:3.0:1746129826.861891:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054542336 00000100:00100000:3.0:1746129826.861919:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15875 00000100:00100000:3.0:1746129826.861924:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054542336:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129826.861935:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.861943:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356953 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.861955:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.861956:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.861960:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.861970:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129826.861982:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87b000, rc 0) 00000100:00100000:3.0:1746129826.862002:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054542336:12345-192.168.204.31@tcp:101:cat.0 Request processed in 77us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.862007:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15875 00000100:00100000:0.0:1746129826.862925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.862984:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054542592 00000100:00100000:3.0:1746129826.862988:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054542592 00000100:00100000:3.0:1746129826.863021:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11126 00000100:00100000:3.0:1746129826.863027:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31790:x1830949054542592:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129826.863040:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.863049:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43956265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35695a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.863115:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.863126:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 297 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.863133:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 23 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.863139:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129826.863157:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 23 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.863171:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 23 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.863179:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054096256:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.865057:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 297 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.865069:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 297 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746129826.865078:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054096384:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.866654:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129826.870502:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054096256:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.870513:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054096384:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.870541:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129826.870609:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054096128:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129826.870619:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.870654:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054542208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9071us (12404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.870664:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7945 00000100:00100000:0.0:1746129826.875418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.875466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.875485:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054543104 00000100:00100000:0.0:1746129826.875492:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054543104 00000100:00100000:0.0:1746129826.875525:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11127 00000100:00100000:0.0:1746129826.875530:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31792:x1830949054543104:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129826.875550:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129826.875564:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d4400/0x48868a4e43956273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356961 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.875637:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129826.875647:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129826.875655:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129826.875722:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.875866:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054542848 00000100:00100000:1.0:1746129826.875869:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054542848 00010000:00010000:1.0:1746129826.875886:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 298 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.875912:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054542720 00000100:00100000:1.0:1746129826.875915:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054542720 00010000:00010000:1.0:1746129826.875923:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 26 pid: 1851 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746129826.875935:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7946 00000100:00100000:1.0:1746129826.875940:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054542848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.875947:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.875950:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 298 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.875963:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 298 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.875978:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093bee000/0x48868a4e439561bd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568d5 expref: 298 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.875993:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129826.875997:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.876001:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.876005:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.876048:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949054542848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 107us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.876053:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7946 00000100:00100000:1.0:1746129826.876067:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7947 00000100:00100000:1.0:1746129826.876071:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054542720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.876078:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.876081:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 26 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.876090:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 26 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.876099:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f906c00/0x48868a4e43956211 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35690d expref: 26 pid: 1851 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746129826.876107:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129826.876110:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.876115:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.876119:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129826.876125:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129826.876129:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129826.876134:0:10980:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129826.876150:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129826.876165:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054542720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 93us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.876170:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7947 00010000:00010000:2.0:1746129826.876396:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129826.876403:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129826.876415:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129826.876509:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a800/0x48868a4e43956265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 298 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.876524:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 297 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.876534:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129826.876536:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129826.876538:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87a200, rc 0) 00000100:00100000:2.0:1746129826.876565:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31790:x1830949054542592:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 13538us (13642us total) trans 8589945156 rc 0/0 00000100:00100000:2.0:1746129826.876571:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11126 00010000:00010000:0.0:1746129826.877080:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:0.0:1746129826.877087:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:0.0:1746129826.877096:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129826.877147:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d4400/0x48868a4e43956273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 26 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.877162:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 25 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129826.877167:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:0.0:1746129826.877168:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129826.877170:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d5200, rc 0) 00000100:00100000:0.0:1746129826.877189:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31792:x1830949054543104:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1659us (1723us total) trans 8589945157 rc 0/0 00000100:00100000:0.0:1746129826.877194:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11127 00000100:00100000:2.0:1746129826.877269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.877503:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054543360 00000100:00100000:0.0:1746129826.877507:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054543360 00002000:00100000:0.0:1746129826.877529:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a504fb80 x1830949054543360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129826.877536:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949054543360 ext(1048576->2097151) 00002000:00010000:0.0:1746129826.877539:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504fb80 00000100:00100000:0.0:1746129826.877560:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7154 00000100:00100000:0.0:1746129826.877565:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054543360:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129826.888514:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.888605:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054543488 00000100:00100000:2.0:1746129826.888613:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054543488 00000100:00100000:2.0:1746129826.888662:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15876 00000100:00100000:2.0:1746129826.888669:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31790:x1830949054543488:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.888683:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.888697:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356968 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.888721:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.888728:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 6 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.888734:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.888739:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.888742:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.888744:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [503808->589823] (req 503808->589823) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.888767:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.888777:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.888786:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054096512:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.888886:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 6 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.888893:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 6 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.888899:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054096640:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.888927:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 14 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.888933:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 14 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.888940:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054096768:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.888955:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.889925:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054543360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12354us (12651us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.889934:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7154 00002000:00100000:1.0:1746129826.889943:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a504fb80 x1830949054543360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.889951:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504fb80 with x1830949054543360 ext(1048576->2097151) 00002000:00010000:1.0:1746129826.889956:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504fb80 00000100:00100000:0.0:1746129826.899524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.900111:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054096512:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.900121:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054096640:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.900126:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054096768:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.900153:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [503808->589823] (req 503808->589823) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.900168:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216c00, rc 0) 00000100:00100000:2.0:1746129826.900219:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31790:x1830949054543488:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11550us (11713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.900226:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15876 00000100:00100000:0.0:1746129826.900901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.901458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.901535:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054543744 00000100:00100000:1.0:1746129826.901541:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054543744 00010000:00010000:1.0:1746129826.901562:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 7 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.901588:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054543616 00000100:00100000:1.0:1746129826.901590:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054543616 00010000:00010000:1.0:1746129826.901596:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746129826.901608:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7948 00000100:00100000:1.0:1746129826.901612:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054543744:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.901621:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.901635:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 7 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.901643:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 7 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746129826.901659:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093befc00/0x48868a4e4395610e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35686c expref: 7 pid: 8437 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746129826.901698:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7949 00000100:00100000:2.0:1746129826.901703:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054543616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.901708:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.901714:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.901722:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.901730:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2c00/0x48868a4e43955fd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a8 expref: 18 pid: 8437 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746129826.901740:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.901757:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054543616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 55us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.901761:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7949 00000100:00100000:2.0:1746129826.901932:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054543872 00000100:00100000:2.0:1746129826.901934:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054543872 00010000:00010000:2.0:1746129826.901943:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746129826.901956:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7950 00000100:00100000:2.0:1746129826.901959:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054543872:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129826.901964:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129826.901970:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.901977:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.901986:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ea1200/0x48868a4e43955fb7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35679a expref: 15 pid: 1877 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746129826.901992:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.901993:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.901998:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.902005:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.902034:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.902047:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054096896:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129826.902791:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.902835:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.902912:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054543744:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1298us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129826.902918:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7948 00000100:00100000:0.0:1746129826.905652:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054096896:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129826.905669:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129826.905698:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1962:x1830949054543872:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3737us (4239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129826.905705:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7950 00000100:00100000:0.0:1746129826.910904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.910944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.911023:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054544128 00000100:00100000:2.0:1746129826.911032:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054544128 00000100:00100000:1.0:1746129826.911061:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054544384 00000100:00100000:1.0:1746129826.911065:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054544384 00002000:00100000:2.0:1746129826.911067:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (503808->507903) req@ffff88012ffb2a00 x1830949054544128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.911076:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb2a00 with x1830949054544128 ext(503808->507903) 00002000:00100000:1.0:1746129826.911078:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ffb2d80 x1830949054544384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746129826.911080:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb2a00 00002000:00100000:1.0:1746129826.911083:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb2d80 with x1830949054544384 ext(2097152->3145727) 00002000:00010000:1.0:1746129826.911086:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb2d80 00000100:00100000:2.0:1746129826.911107:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7155 00000100:00100000:1.0:1746129826.911111:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7156 00000100:00100000:2.0:1746129826.911114:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054544128:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129826.911115:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054544384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.911244:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054544128:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (347us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.911250:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7155 00002000:00100000:2.0:1746129826.911254:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ed:0x0] (503808->507903) req@ffff88012ffb2a00 x1830949054544128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.911260:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb2a00 with x1830949054544128 ext(503808->507903) 00002000:00010000:2.0:1746129826.911262:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb2a00 00000100:00100000:0.0:1746129826.913258:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.913306:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054544640 00000100:00100000:3.0:1746129826.913311:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054544640 00002000:00100000:3.0:1746129826.913339:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (585728->589823) req@ffff88012ffb3100 x1830949054544640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.913347:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb3100 with x1830949054544640 ext(585728->589823) 00002000:00010000:3.0:1746129826.913351:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb3100 00000100:00100000:3.0:1746129826.913377:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7157 00000100:00100000:3.0:1746129826.913384:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054544640:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129826.913482:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054544640:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 99us (229us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129826.913487:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7157 00002000:00100000:3.0:1746129826.913491:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (585728->589823) req@ffff88012ffb3100 x1830949054544640/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129826.913498:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb3100 with x1830949054544640 ext(585728->589823) 00002000:00010000:3.0:1746129826.913500:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb3100 00000100:00100000:1.0:1746129826.922254:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1961:x1830949054544384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11129us (11301us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.922265:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7156 00002000:00100000:1.0:1746129826.922273:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ffb2d80 x1830949054544384/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.922281:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb2d80 with x1830949054544384 ext(2097152->3145727) 00002000:00010000:1.0:1746129826.922287:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb2d80 00000100:00100000:0.0:1746129826.931734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.933504:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054544768 00000100:00100000:2.0:1746129826.933512:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054544768 00000100:00100000:2.0:1746129826.933572:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15877 00000100:00100000:2.0:1746129826.933581:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31787:x1830949054544768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.933597:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.933613:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35696f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.933637:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.933639:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.933647:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.933659:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.933669:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093bee000, rc 0) 00000100:00100000:2.0:1746129826.933712:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31787:x1830949054544768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 132us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.933718:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15877 00000100:00100000:0.0:1746129826.944919:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.946575:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.947268:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.947373:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054545024 00000100:00100000:1.0:1746129826.947381:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054545024 00000100:00100000:2.0:1746129826.947406:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054545280 00000100:00100000:2.0:1746129826.947409:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054545280 00002000:00100000:1.0:1746129826.947419:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ffb3800 x1830949054545024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.947421:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ffb3b80 x1830949054545280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.947428:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb3b80 with x1830949054545280 ext(3145728->4194303) 00002000:00100000:1.0:1746129826.947428:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb3800 with x1830949054545024 ext(2097152->3145727) 00002000:00010000:2.0:1746129826.947432:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ffb3b80 00002000:00010000:1.0:1746129826.947432:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ffb3800 00000100:00100000:1.0:1746129826.947452:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054545536 00000100:00100000:1.0:1746129826.947454:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054545536 00002000:00100000:1.0:1746129826.947465:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012e850000 x1830949054545536/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.947470:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850000 with x1830949054545536 ext(3145728->4194303) 00002000:00010000:1.0:1746129826.947474:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e850000 00000100:00100000:2.0:1746129826.947475:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7158 00000100:00100000:2.0:1746129826.947481:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054545024:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.947495:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7159 00000100:00100000:1.0:1746129826.947499:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054545280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129826.947530:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7160 00000100:00100000:2.0:1746129826.947534:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054545536:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129826.962720:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054545024:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15230us (17799us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.962730:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7158 00002000:00100000:1.0:1746129826.962740:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ffb3800 x1830949054545024/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.962749:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb3800 with x1830949054545024 ext(2097152->3145727) 00002000:00010000:1.0:1746129826.962754:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ffb3800 00000100:00100000:2.0:1746129826.965932:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054545536:12345-192.168.204.31@tcp:3:cat.0 Request processed in 18389us (18656us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129826.965942:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7160 00002000:00100000:2.0:1746129826.965951:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012e850000 x1830949054545536/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.965960:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850000 with x1830949054545536 ext(3145728->4194303) 00002000:00010000:2.0:1746129826.965965:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e850000 00000100:00100000:0.0:1746129826.968243:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.968307:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054545664 00000100:00100000:3.0:1746129826.968319:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054545664 00000100:00100000:3.0:1746129826.968368:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15878 00000100:00100000:3.0:1746129826.968375:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31792:x1830949054545664:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129826.968389:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129826.968403:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356976 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.968426:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.968434:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.968440:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.968442:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129826.968445:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.968476:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.968486:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129826.968496:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054097024:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.968650:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.968659:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 27 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129826.968667:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054097152:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.968703:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129826.970752:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054545280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23238us (24316us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.970766:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7159 00002000:00100000:1.0:1746129826.970775:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ffb3b80 x1830949054545280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.970785:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb3b80 with x1830949054545280 ext(3145728->4194303) 00010000:00010000:1.0:1746129826.970794:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129826.970805:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746129826.970812:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012ffb3b80 00000100:00100000:0.0:1746129826.970933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.971346:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054545792 00000100:00100000:2.0:1746129826.971353:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054545792 00000100:00100000:2.0:1746129826.971386:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15879 00000100:00100000:2.0:1746129826.971392:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31787:x1830949054545792:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.971405:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.971420:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35697d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.971442:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.971444:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.971451:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.971466:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.971476:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093befa00, rc 0) 00000100:00100000:2.0:1746129826.971494:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31787:x1830949054545792:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.971499:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15879 00000100:00100000:3.0:1746129826.971618:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054097024:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129826.971631:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054097152:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129826.971659:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129826.971667:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00e00, rc 0) 00000100:00100000:3.0:1746129826.971684:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31792:x1830949054545664:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3311us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.971693:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15878 00000100:00100000:0.0:1746129826.978127:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.978623:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.978681:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054545920 00000100:00100000:1.0:1746129826.978689:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054545920 00000100:00100000:2.0:1746129826.978702:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054546048 00000100:00100000:2.0:1746129826.978707:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054546048 00010000:00010000:1.0:1746129826.978719:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 28 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129826.978723:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129826.978753:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7951 00000100:00100000:1.0:1746129826.978759:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054545920:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129826.978770:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129826.978788:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 28 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129826.978799:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 28 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129826.978819:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f907600/0x48868a4e4395621f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356914 expref: 28 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129826.978869:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.978893:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7952 00000100:00100000:2.0:1746129826.978899:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054546048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129826.978902:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054545920:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 144us (782us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129826.978907:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129826.978908:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7951 00010000:00010000:2.0:1746129826.978916:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129826.978925:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129826.978936:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093bee000/0x48868a4e43956296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35696f expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129826.978948:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.978950:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.978957:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.978964:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.978989:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.979004:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054097280:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129826.979067:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129826.980528:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129826.980676:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054546304 00000100:00100000:1.0:1746129826.980681:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054546304 00002000:00100000:1.0:1746129826.980709:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012e850e00 x1830949054546304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.980718:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850e00 with x1830949054546304 ext(3145728->4194303) 00002000:00010000:1.0:1746129826.980722:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e850e00 00000100:00100000:1.0:1746129826.980749:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7161 00000100:00100000:1.0:1746129826.980755:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054546304:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129826.983932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.983951:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054546560 00000100:00100000:2.0:1746129826.983957:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054546560 00002000:00100000:2.0:1746129826.983990:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3072000->3076095) req@ffff88012c040a80 x1830949054546560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/0 e 0 to 0 dl 1746129837 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.983999:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040a80 with x1830949054546560 ext(3072000->3076095) 00002000:00010000:2.0:1746129826.984003:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c040a80 00000100:00100000:2.0:1746129826.984031:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7162 00000100:00100000:2.0:1746129826.984037:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054546560:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129826.984158:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054546560:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 121us (232us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129826.984164:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7162 00002000:00100000:2.0:1746129826.984169:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3072000->3076095) req@ffff88012c040a80 x1830949054546560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/4536 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129826.984175:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040a80 with x1830949054546560 ext(3072000->3076095) 00002000:00010000:2.0:1746129826.984177:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c040a80 00000100:00100000:3.0:1746129826.984282:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054097280:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129826.984297:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129826.984318:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054546048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5419us (5695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.984325:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7952 00000100:00100000:1.0:1746129826.991925:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054546304:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11160us (11392us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129826.991936:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7161 00002000:00100000:1.0:1746129826.991946:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012e850e00 x1830949054546304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:567/0 lens 488/440 e 0 to 0 dl 1746129837 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129826.991954:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850e00 with x1830949054546304 ext(3145728->4194303) 00002000:00010000:1.0:1746129826.991959:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e850e00 00000100:00100000:0.0:1746129826.992186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129826.992245:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054546688 00000100:00100000:2.0:1746129826.992252:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054546688 00000100:00100000:2.0:1746129826.992292:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15880 00000100:00100000:2.0:1746129826.992299:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31792:x1830949054546688:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129826.992315:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.992328:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356984 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.992352:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.992359:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.992365:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.992366:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129826.992370:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3674111] (req 3145728->3674111) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.992396:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129826.992408:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129826.992419:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054097408:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.992490:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 16 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.992498:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 16 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129826.992506:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054097536:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.992525:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129826.995142:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054097408:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129826.995153:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054097536:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129826.995176:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3674111] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129826.995190:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217400, rc 0) 00000100:00100000:2.0:1746129826.995237:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31792:x1830949054546688:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2938us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129826.995245:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15880 00000100:00100000:0.0:1746129826.998784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129826.999296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129826.999501:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054546816 00000100:00100000:3.0:1746129826.999509:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054546816 00010000:00010000:3.0:1746129826.999544:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129826.999565:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7953 00000100:00100000:3.0:1746129826.999570:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054546816:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129826.999580:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129826.999596:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129826.999605:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129826.999623:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b154200/0x48868a4e4395622d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356929 expref: 15 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129826.999639:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129826.999660:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054546944 00000100:00100000:2.0:1746129826.999664:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054546944 00000100:00100000:3.0:1746129826.999669:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054546816:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129826.999674:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7953 00000100:00100000:2.0:1746129826.999684:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15881 00000100:00100000:2.0:1746129826.999688:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054546944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129826.999700:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129826.999710:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a1ef400/0x48868a4e439562b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf35698b expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129826.999747:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054097664:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129826.999793:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.001473:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.001528:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547072 00000100:00100000:2.0:1746129827.001533:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547072 00000100:00100000:2.0:1746129827.001567:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15882 00000100:00100000:2.0:1746129827.001572:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054547072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.001581:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.001592:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5216600/0x48868a4e439562b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356992 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.001607:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.001614:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216600/0x48868a4e439562b9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356992 expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.001624:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216600/0x48868a4e439562b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356992 expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.001646:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216600, rc 0) 00000100:00100000:2.0:1746129827.001671:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054547072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 99us (203us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129827.001676:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15882 00000100:00100000:0.0:1746129827.002619:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.002660:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547200 00000100:00100000:3.0:1746129827.002664:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547200 00000100:00100000:3.0:1746129827.002688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15883 00000100:00100000:3.0:1746129827.002693:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054547200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.002701:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.002710:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa00c00/0x48868a4e439562c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356999 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.002727:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00c00/0x48868a4e439562c0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356999 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.002736:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00c00/0x48868a4e439562c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356999 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.002745:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00c00, rc 0) 00002000:00010000:2.0:1746129827.002746:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime: 1746129826 -> 1746129827 00002000:00010000:2.0:1746129827.002750:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime: 1746129826 -> 1746129827 00002000:00010000:2.0:1746129827.002752:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime: 1746129826 -> 1746129827 00000100:00100000:2.0:1746129827.002767:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054097664:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129827.002776:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054547200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 82us (159us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129827.002781:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15883 00010000:00010000:2.0:1746129827.002785:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a1ef400/0x48868a4e439562b2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35698b expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.002794:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a1ef400/0x48868a4e439562b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35698b expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.002802:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a1ef400, rc 0) 00000100:00100000:2.0:1746129827.002820:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:1964:x1830949054546944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3131us (3525us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129827.002829:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15881 00000100:00100000:0.0:1746129827.011593:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.011639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.011714:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547328 00000100:00100000:2.0:1746129827.011722:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547328 00010000:00010000:2.0:1746129827.011750:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 17 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.011770:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547456 00000100:00100000:3.0:1746129827.011774:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547456 00000100:00100000:2.0:1746129827.011775:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7954 00000100:00100000:2.0:1746129827.011781:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054547328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.011793:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129827.011798:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15884 00000100:00100000:3.0:1746129827.011803:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31787:x1830949054547456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.011812:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 17 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.011814:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.011822:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 17 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.011825:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569a0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.011838:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f907400/0x48868a4e439561f5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356906 expref: 17 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.011839:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.011841:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.011866:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.011878:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.011880:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.012217:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.012224:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.012236:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.012245:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00000, rc 0) 00010000:00010000:2.0:1746129827.012252:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.012263:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054097792:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.012295:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31787:x1830949054547456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 491us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.012299:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15884 00000100:00100000:2.0:1746129827.012523:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.018042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.018080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.018167:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c040380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054097792:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129827.018185:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.018288:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547584 00000100:00100000:3.0:1746129827.018294:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547584 00000100:00100000:3.0:1746129827.018337:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547712 00000100:00100000:3.0:1746129827.018338:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547712 00000100:00100000:3.0:1746129827.018359:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15885 00000100:00100000:3.0:1746129827.018365:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054547584:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.018377:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.018389:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01000/0x48868a4e439562ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569a7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.018411:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01000/0x48868a4e439562ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a7 expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.018419:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01000/0x48868a4e439562ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a7 expref: 18 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129827.018470:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15886 00000100:00100000:1.0:1746129827.018475:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054547712:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.018481:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.018488:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f33e00/0x48868a4e439562d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569ae expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.018496:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054547328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6713us (6909us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129827.018499:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f33e00/0x48868a4e439562d5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ae expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129827.018505:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7954 00010000:00010000:1.0:1746129827.018505:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f33e00/0x48868a4e439562d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ae expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.018514:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33e00, rc 0) 00000100:00100000:1.0:1746129827.018529:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054547712:12345-192.168.204.31@tcp:101:cat.0 Request processed in 55us (449us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.018533:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15886 00010000:00010000:3.0:1746129827.018571:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01000, rc 0) 00000100:00100000:3.0:1746129827.018588:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054547584:12345-192.168.204.31@tcp:101:cat.0 Request processed in 223us (554us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129827.018593:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15885 00000100:00100000:2.0:1746129827.027909:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.028490:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.028685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.028700:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054548096 00000100:00100000:1.0:1746129827.028707:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054548096 00002000:00100000:1.0:1746129827.028745:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3670016->3674111) req@ffff88012c040380 x1830949054548096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.028754:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040380 with x1830949054548096 ext(3670016->3674111) 00002000:00010000:1.0:1746129827.028759:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040380 00000100:00100000:2.0:1746129827.028999:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.029043:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054547968 00000100:00100000:1.0:1746129827.029046:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054547968 00002000:00100000:1.0:1746129827.029059:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012c040700 x1830949054547968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.029066:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949054547968 ext(4194304->4931583) 00002000:00010000:1.0:1746129827.029070:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:1.0:1746129827.029085:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054548480 00000100:00100000:1.0:1746129827.029087:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054548480 00002000:00100000:1.0:1746129827.029099:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012c043480 x1830949054548480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 504/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.029104:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043480 with x1830949054548480 ext(0->1048575) 00002000:00010000:1.0:1746129827.029107:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c043480 00000100:00100000:1.0:1746129827.029117:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7163 00000100:00100000:1.0:1746129827.029123:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054548096:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.029259:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054548096:12345-192.168.204.31@tcp:3:cat.0 Request processed in 135us (1357us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129827.029265:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7163 00002000:00100000:1.0:1746129827.029270:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3670016->3674111) req@ffff88012c040380 x1830949054548096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.029277:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040380 with x1830949054548096 ext(3670016->3674111) 00002000:00010000:1.0:1746129827.029280:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040380 00000100:00100000:1.0:1746129827.029292:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7164 00000100:00100000:1.0:1746129827.029296:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054547968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.030108:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7165 00000100:00100000:1.0:1746129827.030113:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054548480:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.031557:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054548736 00000100:00100000:3.0:1746129827.031565:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054548736 00000100:00100000:2.0:1746129827.031569:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129827.031595:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012c042a00 x1830949054548736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.031604:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042a00 with x1830949054548736 ext(1048576->2097151) 00002000:00010000:3.0:1746129827.031608:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c042a00 00000100:00100000:3.0:1746129827.031632:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054548992 00000100:00100000:3.0:1746129827.031635:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054548992 00002000:00100000:3.0:1746129827.031648:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012c043800 x1830949054548992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.031654:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043800 with x1830949054548992 ext(1048576->2097151) 00002000:00010000:3.0:1746129827.031657:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043800 00000100:00100000:3.0:1746129827.031668:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7166 00000100:00100000:3.0:1746129827.031674:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054548736:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.032711:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7167 00000100:00100000:3.0:1746129827.032719:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054548992:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.041280:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054547968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11974us (12782us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129827.041291:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7164 00002000:00100000:1.0:1746129827.041303:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012c040700 x1830949054547968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.041312:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040700 with x1830949054547968 ext(4194304->4931583) 00002000:00010000:1.0:1746129827.041316:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c040700 00000100:00100000:3.0:1746129827.071130:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054548736:12345-192.168.204.31@tcp:3:cat.0 Request processed in 39447us (42122us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.071142:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7166 00002000:00100000:3.0:1746129827.071152:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012c042a00 x1830949054548736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.071162:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042a00 with x1830949054548736 ext(1048576->2097151) 00002000:00010000:3.0:1746129827.071168:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c042a00 00000100:00100000:0.0:1746129827.071188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.071234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.071256:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549120 00000100:00100000:0.0:1746129827.071260:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.071263:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549120 00000100:00100000:1.0:1746129827.071287:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549376 00000100:00100000:1.0:1746129827.071289:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549376 00000100:00100000:2.0:1746129827.071294:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549248 00000100:00100000:2.0:1746129827.071301:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549248 00000100:00100000:1.0:1746129827.071301:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15887 00000100:00100000:1.0:1746129827.071306:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054549120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.071318:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129827.071328:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15888 00000100:00100000:2.0:1746129827.071333:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054549376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.071333:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f33000/0x48868a4e439562dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569b5 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.071343:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.071354:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858a00/0x48868a4e439562e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569c3 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.071377:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054097920:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129827.071381:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f858a00/0x48868a4e439562e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569c3 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.071393:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858a00/0x48868a4e439562e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569c3 expref: 18 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.071414:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858a00, rc 0) 00000100:00100000:1.0:1746129827.071431:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.071505:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054549376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 171us (270us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.071508:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15889 00000100:00100000:1.0:1746129827.071514:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054549248:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.071520:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.071526:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f33200/0x48868a4e439562ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569bc expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.071534:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15888 00010000:00010000:1.0:1746129827.071539:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f33200/0x48868a4e439562ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569bc expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.071546:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f33200/0x48868a4e439562ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569bc expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.071556:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33200, rc 0) 00000100:00100000:0.0:1746129827.075312:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054548480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 45192us (46620us total) trans 0 rc 962560/962560 00000100:00100000:0.0:1746129827.075322:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7165 00002000:00100000:0.0:1746129827.075332:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012c043480 x1830949054548480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 504/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 962560/962560 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.075340:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043480 with x1830949054548480 ext(0->1048575) 00002000:00010000:0.0:1746129827.075345:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c043480 00000100:00100000:2.0:1746129827.075509:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054548992:12345-192.168.204.31@tcp:3:cat.0 Request processed in 42791us (43942us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.075516:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7167 00002000:00100000:2.0:1746129827.075521:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012c043800 x1830949054548992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.075528:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c043800 with x1830949054548992 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.075531:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c043800 00000100:00100000:1.0:1746129827.075565:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054549248:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4048us (4302us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.075577:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15889 00000100:00100000:1.0:1746129827.077835:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054097920:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129827.077888:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f33000/0x48868a4e439562dc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569b5 expref: 16 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.077901:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f33000/0x48868a4e439562dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569b5 expref: 16 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.077910:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33000, rc 0) 00000100:00100000:1.0:1746129827.077955:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1964:x1830949054549120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6648us (6767us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.077963:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15887 00000100:00100000:0.0:1746129827.080973:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.081018:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.081059:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.081079:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549504 00000100:00100000:2.0:1746129827.081086:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549504 00000100:00100000:2.0:1746129827.081130:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549760 00000100:00100000:2.0:1746129827.081133:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549760 00000100:00100000:1.0:1746129827.081702:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549632 00000100:00100000:1.0:1746129827.081707:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549632 00000100:00100000:1.0:1746129827.081729:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15890 00000100:00100000:1.0:1746129827.081735:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054549504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.081750:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.081764:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f33c00/0x48868a4e439562f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569ca expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.081810:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054098048:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129827.081924:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.081943:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15891 00000100:00100000:1.0:1746129827.081948:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054549760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.081956:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.081965:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f33600/0x48868a4e439562f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569d8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.081981:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f33600/0x48868a4e439562f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569d8 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.081990:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f33600/0x48868a4e439562f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569d8 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.082000:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33600, rc 0) 00000100:00100000:1.0:1746129827.082031:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054549760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 82us (1022us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.082036:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15891 00000100:00100000:1.0:1746129827.082050:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15892 00000100:00100000:1.0:1746129827.082055:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054549632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.082060:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.082066:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f32600/0x48868a4e439562ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569d1 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.082079:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f32600/0x48868a4e439562ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569d1 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.082085:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f32600/0x48868a4e439562ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569d1 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.082092:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f32600, rc 0) 00000100:00100000:1.0:1746129827.082106:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054549632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 50us (1046us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.082110:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15892 00000100:00100000:1.0:1746129827.084697:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054098048:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129827.084723:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f33c00/0x48868a4e439562f1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ca expref: 16 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.084735:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f33c00/0x48868a4e439562f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ca expref: 16 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.084744:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33c00, rc 0) 00000100:00100000:1.0:1746129827.085543:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054549504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3796us (4565us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.085553:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15890 00000100:00100000:0.0:1746129827.087722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.087786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.090104:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054549888 00000100:00100000:1.0:1746129827.090113:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054549888 00000100:00100000:1.0:1746129827.090155:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550016 00000100:00100000:1.0:1746129827.090158:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550016 00000100:00100000:1.0:1746129827.090173:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15893 00000100:00100000:1.0:1746129827.090179:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054549888:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.090193:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.090208:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f33200/0x48868a4e43956306 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569df expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.090213:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15894 00000100:00100000:2.0:1746129827.090224:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054550016:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.090235:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.090235:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f33200/0x48868a4e43956306 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569df expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.090244:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f33200/0x48868a4e43956306 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569df expref: 17 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.090247:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f858200/0x48868a4e4395630d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569e6 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.090253:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33200, rc 0) 00010000:00010000:2.0:1746129827.090268:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f858200/0x48868a4e4395630d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569e6 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.090277:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f858200/0x48868a4e4395630d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569e6 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.090304:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f858200, rc 0) 00000100:00100000:1.0:1746129827.090306:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054549888:12345-192.168.204.31@tcp:101:cat.0 Request processed in 126us (2589us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.090311:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15893 00000100:00100000:2.0:1746129827.090360:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054550016:12345-192.168.204.31@tcp:101:cat.0 Request processed in 138us (2574us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129827.090366:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15894 00000100:00100000:1.0:1746129827.094482:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.094526:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550144 00000100:00100000:3.0:1746129827.094532:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550144 00000100:00100000:3.0:1746129827.094576:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15895 00000100:00100000:3.0:1746129827.094582:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:31797:x1830949054550144:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.094596:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.094608:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569ed expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.094627:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.094629:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.094634:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.094646:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.094655:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea0200, rc 0) 00000100:00100000:3.0:1746129827.095048:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31797:x1830949054550144:12345-192.168.204.31@tcp:101:cat.0 Request processed in 465us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.095057:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15895 00000100:00100000:0.0:1746129827.102425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.103465:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550400 00000100:00100000:2.0:1746129827.103474:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550400 00002000:00100000:2.0:1746129827.103518:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012e851180 x1830949054550400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.103528:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e851180 with x1830949054550400 ext(2097152->3145727) 00002000:00010000:2.0:1746129827.103533:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e851180 00000100:00100000:2.0:1746129827.103554:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7168 00000100:00100000:2.0:1746129827.103562:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054550400:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129827.119355:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054550400:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15787us (16931us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.119365:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7168 00002000:00100000:2.0:1746129827.119374:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012e851180 x1830949054550400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.119382:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e851180 with x1830949054550400 ext(2097152->3145727) 00002000:00010000:2.0:1746129827.119387:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e851180 00000100:00100000:0.0:1746129827.129539:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.131302:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550528 00000100:00100000:3.0:1746129827.131311:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550528 00000100:00100000:3.0:1746129827.131349:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15896 00000100:00100000:3.0:1746129827.131356:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31797:x1830949054550528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.131371:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.131386:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569f4 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.131410:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.131416:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.131418:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.131422:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.131445:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 16 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.131455:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.131464:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054098176:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.132539:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.138728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.138841:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054098176:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.138934:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550656 00000100:00100000:2.0:1746129827.138939:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550656 00002000:00100000:2.0:1746129827.138973:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3072000->3145727) req@ffff88009c678380 x1830949054550656/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.138987:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678380 with x1830949054550656 ext(3072000->3145727) 00010000:00010000:2.0:1746129827.138995:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 17 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.139017:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 17 pid: 8435 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746129827.139023:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c678380 00000100:00100000:2.0:1746129827.139052:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1933 00000100:00100000:2.0:1746129827.139059:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054550656:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:3.0:1746129827.139743:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.139756:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1e00, rc 0) 00000100:00100000:3.0:1746129827.139801:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31797:x1830949054550528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8444us (10269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.139809:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15896 00000100:00100000:0.0:1746129827.146480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.147381:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550784 00000100:00100000:3.0:1746129827.147388:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550784 00000100:00100000:3.0:1746129827.147425:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15897 00000100:00100000:3.0:1746129827.147432:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31799:x1830949054550784:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129827.147445:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.147460:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf3569fb expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.147482:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.147489:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.147495:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.147496:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.147499:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1335296->2097151] (req 1335296->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.147522:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.147531:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.147542:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054098304:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.147618:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.147625:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.147633:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054098432:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.147648:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.147798:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054550656:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8738us (9078us total) trans 17179874199 rc 0/0 00000100:00100000:2.0:1746129827.147806:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1933 00002000:00100000:2.0:1746129827.147814:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3072000->3145727) req@ffff88009c678380 x1830949054550656/t17179874199(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.147823:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678380 with x1830949054550656 ext(3072000->3145727) 00010000:00010000:2.0:1746129827.147828:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.147837:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746129827.147842:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c678380 00000100:00100000:0.0:1746129827.151305:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.151339:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054098304:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.151349:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054098432:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.151376:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [1335296->2097151] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.151377:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129827.151390:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ea1000, rc 0) 00000100:00100000:3.0:1746129827.151423:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31799:x1830949054550784:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3992us (4950us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.151430:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15897 00000100:00100000:2.0:1746129827.151541:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054550912 00000100:00100000:1.0:1746129827.151541:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054551040 00000100:00100000:2.0:1746129827.151546:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054550912 00000100:00100000:1.0:1746129827.151546:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054551040 00010000:00010000:2.0:1746129827.151569:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.151589:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7955 00000100:00100000:2.0:1746129827.151595:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054550912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.151604:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.151621:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.151631:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.151648:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87b000/0x48868a4e4395625e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356953 expref: 29 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.151663:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.151682:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054550912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.151687:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7955 00010000:00010000:1.0:1746129827.151881:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.151901:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7956 00000100:00100000:1.0:1746129827.151907:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054551040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.151913:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.151921:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.151928:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.151939:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e4395629d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3072000->3145727] (req 3072000->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356976 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.151949:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.151951:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.151956:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.151962:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.151983:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 28 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.151993:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054098560:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129827.152037:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.152504:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.152651:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054551168 00000100:00100000:2.0:1746129827.152655:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054551168 00010000:00010000:2.0:1746129827.152665:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.152678:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7957 00000100:00100000:2.0:1746129827.152683:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054551168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.152691:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.152698:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.152705:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.152715:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217c00/0x48868a4e43956250 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356945 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.152722:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.152723:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.152726:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.152732:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.152746:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.152753:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054098688:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129827.152775:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.157261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.157320:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054551424 00000100:00100000:3.0:1746129827.157337:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054551424 00002000:00100000:3.0:1746129827.157381:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009c679500 x1830949054551424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129827.157384:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054098560:192.168.204.31@tcp:105: 00002000:00100000:3.0:1746129827.157390:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679500 with x1830949054551424 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.157393:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c679500 00010000:00010000:1.0:1746129827.157398:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.157410:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7169 00000100:00100000:3.0:1746129827.157417:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054551424:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129827.157436:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054551040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5531us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.157444:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7956 00000100:00100000:2.0:1746129827.159418:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c041f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054098688:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129827.159435:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.159468:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054551168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6784us (6963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.159477:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7957 00000100:00100000:2.0:1746129827.159580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.160182:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054551680 00000100:00100000:0.0:1746129827.160187:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054551680 00002000:00100000:0.0:1746129827.160219:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1335296->1339391) req@ffff88012c041f80 x1830949054551680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.160228:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949054551680 ext(1335296->1339391) 00002000:00010000:0.0:1746129827.160232:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c041f80 00000100:00100000:0.0:1746129827.160260:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7170 00000100:00100000:0.0:1746129827.160267:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054551680:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129827.160472:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054551680:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 204us (890us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129827.160478:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7170 00002000:00100000:0.0:1746129827.160483:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1335296->1339391) req@ffff88012c041f80 x1830949054551680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.160490:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c041f80 with x1830949054551680 ext(1335296->1339391) 00002000:00010000:0.0:1746129827.160492:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c041f80 00000100:00100000:3.0:1746129827.168812:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1964:x1830949054551424:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11388us (11552us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.168823:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7169 00002000:00100000:3.0:1746129827.168831:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009c679500 x1830949054551424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.168839:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679500 with x1830949054551424 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.168844:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c679500 00000100:00100000:0.0:1746129827.170430:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.170497:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054551808 00000100:00100000:3.0:1746129827.170504:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054551808 00000100:00100000:3.0:1746129827.170535:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15898 00000100:00100000:3.0:1746129827.170542:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:31799:x1830949054551808:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129827.170555:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.170570:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a02 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.170594:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.170601:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.170607:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.170611:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.170613:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.170616:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1048576->1073151] (req 1048576->1073151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.170639:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 5 pid: 3623 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.170648:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 5 pid: 3623 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.170658:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054098816:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.170733:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 18 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.170740:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 18 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.170748:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054098944:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.170768:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.170781:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 14 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.170932:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054099072:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.170972:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.174433:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054098816:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.174444:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054098944:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.174884:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.175108:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054551936 00000100:00100000:2.0:1746129827.175114:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054551936 00010000:00010000:2.0:1746129827.175140:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 6 pid: 3623 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.175176:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7958 00000100:00100000:2.0:1746129827.175182:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054551936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.175192:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.175210:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 6 pid: 3623 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.175219:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 6 pid: 3623 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.175237:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918eec00/0x48868a4e43956123 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356881 expref: 6 pid: 3623 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.175253:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.175283:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054551936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.175289:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7958 00000100:00100000:3.0:1746129827.175380:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054099072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.175405:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->1073151] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.175415:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3a00, rc 0) 00000100:00100000:3.0:1746129827.175546:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31799:x1830949054551808:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5004us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.175552:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15898 00000100:00100000:0.0:1746129827.175869:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.175925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.176104:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054552192 00000100:00100000:3.0:1746129827.176107:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054552192 00000100:00100000:3.0:1746129827.176125:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15899 00000100:00100000:3.0:1746129827.176135:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31797:x1830949054552192:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.176148:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.176157:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a09 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.176171:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.176176:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.176178:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.176181:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 19 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.176202:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 14 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.176211:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 14 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.176221:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054099200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.176264:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.176308:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054552064 00000100:00100000:2.0:1746129827.176311:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054552064 00010000:00010000:2.0:1746129827.176322:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 20 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.176338:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7959 00000100:00100000:2.0:1746129827.176344:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054552064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.176349:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.176357:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 20 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.176365:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 20 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.176375:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918ef800/0x48868a4e43956185 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3568b2 expref: 20 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.176383:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.176396:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054552064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 53us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.176401:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7959 00000100:00100000:0.0:1746129827.177016:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.177085:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054552320 00000100:00100000:3.0:1746129827.177088:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054552320 00010000:00010000:3.0:1746129827.177100:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 15 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.177125:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7960 00000100:00100000:3.0:1746129827.177131:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054552320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.177137:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.177144:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 15 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.177151:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 15 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.177162:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7000/0x48868a4e439560eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35685e expref: 15 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.177176:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.177178:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.177183:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.177189:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.177205:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.177213:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054099328:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.177246:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.177713:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054099200:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.177727:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.177735:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2600, rc 0) 00000100:00100000:3.0:1746129827.177767:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:31797:x1830949054552192:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1631us (1842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.177773:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15899 00000100:00100000:2.0:1746129827.178743:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.178826:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054552448 00000100:00100000:3.0:1746129827.178830:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054552448 00002000:00100000:3.0:1746129827.178874:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3674111) req@ffff88012c040000 x1830949054552448/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.178888:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949054552448 ext(3145728->3674111) 00010000:00010000:3.0:1746129827.178893:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.178902:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 15 pid: 8435 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.178907:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c040000 00000100:00100000:3.0:1746129827.178920:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1934 00000100:00100000:3.0:1746129827.178926:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1961:x1830949054552448:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129827.179773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.179932:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054099328:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.179945:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.179967:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054552320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2837us (2962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.179974:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7960 00000100:00100000:2.0:1746129827.180137:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054552704 00000100:00100000:2.0:1746129827.180141:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054552704 00002000:00100000:2.0:1746129827.180158:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1069056->1073151) req@ffff88009c67a680 x1830949054552704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.180166:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67a680 with x1830949054552704 ext(1069056->1073151) 00002000:00010000:2.0:1746129827.180169:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67a680 00000100:00100000:2.0:1746129827.180344:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7171 00000100:00100000:2.0:1746129827.180351:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054552704:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129827.181878:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054552704:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1522us (2102us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129827.181885:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7171 00002000:00100000:2.0:1746129827.181892:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ef:0x0] (1069056->1073151) req@ffff88009c67a680 x1830949054552704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.181900:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67a680 with x1830949054552704 ext(1069056->1073151) 00002000:00010000:2.0:1746129827.181903:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67a680 00000100:00100000:3.0:1746129827.192512:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054552448:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13577us (13762us total) trans 21474841392 rc 0/0 00000100:00100000:3.0:1746129827.192524:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1934 00002000:00100000:3.0:1746129827.192534:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->3674111) req@ffff88012c040000 x1830949054552448/t21474841392(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.192542:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c040000 with x1830949054552448 ext(3145728->3674111) 00010000:00010000:3.0:1746129827.192552:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.192570:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.192577:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c040000 00000100:00100000:0.0:1746129827.194614:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.194721:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054552832 00000100:00100000:3.0:1746129827.194728:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054552832 00010000:00010000:3.0:1746129827.194766:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.194897:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7961 00000100:00100000:3.0:1746129827.194905:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054552832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.194917:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.194935:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.194946:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.194965:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e439562ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3145728->3686399] (req 3145728->3674111) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356984 expref: 16 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.194991:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.194992:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.194997:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.195113:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.195136:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 17 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.195145:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054099456:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.195206:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.198878:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054099456:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.198903:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.198956:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1962:x1830949054552832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4051us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.198966:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7961 00000100:00100000:0.0:1746129827.202977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.203042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.203373:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553216 00000100:00100000:3.0:1746129827.203384:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553216 00002000:00100000:3.0:1746129827.203422:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009c67ad80 x1830949054553216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.203430:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67ad80 with x1830949054553216 ext(3145728->4194303) 00002000:00010000:3.0:1746129827.203435:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c67ad80 00000100:00100000:3.0:1746129827.203448:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553344 00000100:00100000:3.0:1746129827.203450:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553344 00002000:00100000:3.0:1746129827.203458:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009c67b100 x1830949054553344/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.203464:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67b100 with x1830949054553344 ext(3145728->4194303) 00002000:00010000:3.0:1746129827.203468:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67b100 00000100:00100000:3.0:1746129827.203488:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7172 00000100:00100000:3.0:1746129827.203494:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054553216:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129827.205561:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7173 00000100:00100000:0.0:1746129827.205573:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054553344:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129827.223250:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054553216:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 19747us (20274us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.223260:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7172 00002000:00100000:3.0:1746129827.223268:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009c67ad80 x1830949054553216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.223277:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67ad80 with x1830949054553216 ext(3145728->4194303) 00002000:00010000:3.0:1746129827.223282:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c67ad80 00000100:00100000:1.0:1746129827.223563:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054553344:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 17992us (20518us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.223571:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7173 00002000:00100000:1.0:1746129827.223576:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009c67b100 x1830949054553344/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.223583:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67b100 with x1830949054553344 ext(3145728->4194303) 00002000:00010000:1.0:1746129827.223586:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67b100 00010000:00010000:2.0:1746129827.223963:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129827.231436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.231520:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553472 00000100:00100000:3.0:1746129827.231528:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553472 00000100:00100000:3.0:1746129827.232392:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15900 00000100:00100000:3.0:1746129827.232402:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054553472:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.232418:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.232433:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2400/0x48868a4e43956337 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a10 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.232474:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054099584:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129827.232557:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.237386:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1877:1830949054099584:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129827.237423:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2400/0x48868a4e43956337 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a10 expref: 16 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.237435:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2400/0x48868a4e43956337 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a10 expref: 16 pid: 1877 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129827.237599:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.237627:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.238670:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.238704:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553600 00000100:00100000:1.0:1746129827.238710:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553600 00000100:00100000:0.0:1746129827.238741:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129827.238774:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff2400, rc 0) 00000100:00100000:1.0:1746129827.238930:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553728 00000100:00100000:1.0:1746129827.238933:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553728 00000100:00100000:0.0:1746129827.238946:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553856 00000100:00100000:0.0:1746129827.238949:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553856 00000100:00100000:1.0:1746129827.238951:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054553984 00000100:00100000:1.0:1746129827.238953:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054553984 00000100:00100000:0.0:1746129827.238970:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15901 00000100:00100000:1.0:1746129827.238976:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15902 00000100:00100000:0.0:1746129827.238977:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054553600:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129827.238982:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054553728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.238990:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.238990:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.239001:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fb4600/0x48868a4e43956345 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a1e expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.239001:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cae1800/0x48868a4e4395633e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a17 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.239046:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054099712:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129827.239046:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c679180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054099840:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129827.239102:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15903 00000100:00100000:3.0:1746129827.239110:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054553856:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.239115:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.239121:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a25 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.239129:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.239131:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.239136:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.239147:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.239155:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3c00, rc 0) 00000100:00100000:2.0:1746129827.239193:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15904 00000100:00100000:2.0:1746129827.239199:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054553984:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.239204:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.239210:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a2c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.239218:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.239219:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.239223:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.239232:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.239238:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859800, rc 0) 00000100:00100000:0.0:1746129827.240643:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.240967:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.241025:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054553472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8623us (9593us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.241033:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15900 00000100:00100000:3.0:1746129827.241136:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054553856:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2026us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.241142:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15903 00000100:00100000:2.0:1746129827.241148:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054553984:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1948us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.241157:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15904 00000100:00100000:0.0:1746129827.242209:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.242297:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c679180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054099840:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129827.242320:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cae1800/0x48868a4e4395633e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a17 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.242338:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cae1800/0x48868a4e4395633e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a17 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.242350:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae1800, rc 0) 00000100:00100000:0.0:1746129827.242371:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054553600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3394us (4772us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129827.242376:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15901 00000100:00100000:1.0:1746129827.242607:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054554240 00000100:00100000:1.0:1746129827.242612:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054554240 00002000:00100000:1.0:1746129827.242638:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800926a0000 x1830949054554240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.242646:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a0000 with x1830949054554240 ext(4194304->4931583) 00002000:00010000:1.0:1746129827.242650:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a0000 00002000:00010000:1.0:1746129827.243595:0:4589:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime: 1746129826 -> 1746129827 00002000:00010000:1.0:1746129827.243600:0:4589:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129826 -> 1746129827 00002000:00010000:1.0:1746129827.243601:0:4589:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime: 1746129826 -> 1746129827 00000100:00100000:1.0:1746129827.243614:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054099712:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129827.243630:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fb4600/0x48868a4e43956345 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a1e expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.243639:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fb4600/0x48868a4e43956345 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a1e expref: 17 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.243649:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4600, rc 0) 00000100:00100000:1.0:1746129827.243670:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054553728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4688us (6042us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.243675:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15902 00000100:00100000:1.0:1746129827.243691:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7174 00000100:00100000:1.0:1746129827.243696:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054554240:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.249009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.249137:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054554368 00000100:00100000:1.0:1746129827.249145:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054554368 00000100:00100000:1.0:1746129827.249177:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15905 00000100:00100000:1.0:1746129827.249182:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31805:x1830949054554368:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.249196:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.249209:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a33 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.249231:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.249237:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129827.249238:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129827.249241:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.249262:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.249270:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.249280:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054099968:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.250898:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054554240:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7195us (8685us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129827.250906:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7174 00002000:00100000:2.0:1746129827.250914:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff8800926a0000 x1830949054554240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.250923:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a0000 with x1830949054554240 ext(4194304->4931583) 00002000:00010000:2.0:1746129827.250927:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a0000 00000100:00100000:1.0:1746129827.251297:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.251917:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054099968:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129827.251938:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.251951:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:1.0:1746129827.252991:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31805:x1830949054554368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3801us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.252999:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15905 00000100:00100000:2.0:1746129827.253047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.253197:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054554496 00000100:00100000:0.0:1746129827.253203:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054554496 00002000:00100000:0.0:1746129827.253233:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (503808->589823) req@ffff88012c042d80 x1830949054554496/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.253241:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042d80 with x1830949054554496 ext(503808->589823) 00010000:00010000:0.0:1746129827.253247:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.253257:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746129827.253263:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c042d80 00000100:00100000:0.0:1746129827.253288:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1935 00000100:00100000:0.0:1746129827.253294:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1961:x1830949054554496:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129827.256448:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.256664:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054554624 00000100:00100000:1.0:1746129827.256673:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054554624 00000100:00100000:1.0:1746129827.256707:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15906 00000100:00100000:1.0:1746129827.256714:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054554624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.256730:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.256746:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e43956361 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a3a expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.256794:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054100096:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129827.256887:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.257528:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054554496:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4232us (4479us total) trans 21474841393 rc 0/0 00000100:00100000:2.0:1746129827.257537:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1935 00002000:00100000:2.0:1746129827.257544:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (503808->589823) req@ffff88012c042d80 x1830949054554496/t21474841393(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.257552:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c042d80 with x1830949054554496 ext(503808->589823) 00010000:00010000:2.0:1746129827.257591:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 22 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.257603:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 22 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746129827.257609:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c042d80 00000100:00100000:1.0:1746129827.260227:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054100096:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129827.260256:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e43956361 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a3a expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.260269:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e43956361 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a3a expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.260292:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:1.0:1746129827.260340:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054554624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3626us (3901us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.260351:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15906 00000100:00100000:0.0:1746129827.263428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.263727:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054554752 00000100:00100000:3.0:1746129827.263735:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054554752 00010000:00010000:3.0:1746129827.263763:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 20 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.263795:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7962 00000100:00100000:3.0:1746129827.263800:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054554752:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.263811:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.263827:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 20 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.263836:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 20 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.263871:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e4395628f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 503808->589823) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356968 expref: 20 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.263891:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.263893:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.263898:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.263904:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.263929:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.263939:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054100224:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.263990:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.264507:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.267409:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054554880 00000100:00100000:1.0:1746129827.267419:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054554880 00000100:00100000:1.0:1746129827.267567:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15907 00000100:00100000:1.0:1746129827.267575:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054554880:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.267590:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.267603:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a41 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.267621:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.267623:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.267630:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.267642:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.267650:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1f200, rc 0) 00000100:00100000:1.0:1746129827.267696:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054554880:12345-192.168.204.31@tcp:101:cat.0 Request processed in 122us (3190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.267702:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15907 00000100:00100000:3.0:1746129827.269258:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054100224:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.269279:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.269312:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054554752:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5511us (5889us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.269322:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7962 00000100:00100000:0.0:1746129827.274987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.277218:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555136 00000100:00100000:2.0:1746129827.277230:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555136 00002000:00100000:2.0:1746129827.277273:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800926a1180 x1830949054555136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.277282:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a1180 with x1830949054555136 ext(0->1048575) 00002000:00010000:2.0:1746129827.277287:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a1180 00000100:00100000:2.0:1746129827.277319:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7175 00000100:00100000:2.0:1746129827.277325:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054555136:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129827.287079:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054555136:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9745us (12091us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.287090:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7175 00002000:00100000:2.0:1746129827.287099:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff8800926a1180 x1830949054555136/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.287108:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a1180 with x1830949054555136 ext(0->1048575) 00002000:00010000:2.0:1746129827.287112:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a1180 00000100:00100000:0.0:1746129827.301276:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.302558:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555264 00000100:00100000:2.0:1746129827.302567:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555264 00000100:00100000:2.0:1746129827.302616:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15908 00000100:00100000:2.0:1746129827.302623:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31805:x1830949054555264:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.302637:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.302653:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a48 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.302677:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.302684:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.302686:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.302689:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.302713:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 27 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.302723:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 27 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.302733:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054100352:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.304622:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.304647:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054100352:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.304664:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.304676:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7000, rc 0) 00000100:00100000:2.0:1746129827.306232:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31805:x1830949054555264:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3601us (4956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.306241:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15908 00000100:00100000:0.0:1746129827.306512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.306766:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555392 00000100:00100000:3.0:1746129827.306774:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555392 00002000:00100000:3.0:1746129827.306809:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1335296->2097151) req@ffff8800926a1880 x1830949054555392/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.306817:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a1880 with x1830949054555392 ext(1335296->2097151) 00010000:00010000:3.0:1746129827.306825:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 28 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.306837:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 28 pid: 1877 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.306843:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800926a1880 00000100:00100000:3.0:1746129827.306887:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1936 00000100:00100000:3.0:1746129827.306894:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054555392:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129827.325239:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054555392:12345-192.168.204.31@tcp:4:cat.0 Request processed in 18336us (18719us total) trans 17179874200 rc 0/0 00000100:00100000:3.0:1746129827.325251:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1936 00002000:00100000:3.0:1746129827.325260:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f3:0x0] (1335296->2097151) req@ffff8800926a1880 x1830949054555392/t17179874200(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.325270:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a1880 with x1830949054555392 ext(1335296->2097151) 00010000:00010000:3.0:1746129827.325278:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 30 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.325297:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 30 pid: 1877 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.325303:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800926a1880 00000100:00100000:0.0:1746129827.334454:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.334514:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555520 00000100:00100000:2.0:1746129827.334523:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555520 00000100:00100000:2.0:1746129827.334566:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15909 00000100:00100000:2.0:1746129827.334573:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31810:x1830949054555520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129827.334586:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.334598:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a4f expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.334625:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.334632:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.334638:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.334642:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.334644:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.334647:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2568192->2945023] (req 2568192->2945023) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.334667:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.334675:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 21 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.334684:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054100480:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.334760:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 16 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.334767:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 16 pid: 8435 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.334778:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054100608:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.334795:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 21 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.334801:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 21 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.334806:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054100736:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.334817:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.336488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.336679:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c042680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054100480:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.336688:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054100608:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.336872:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555648 00000100:00100000:3.0:1746129827.336877:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555648 00010000:00010000:3.0:1746129827.336903:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 30 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.336938:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7963 00000100:00100000:3.0:1746129827.336945:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054555648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.336954:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.336978:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 30 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.336988:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 30 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.337014:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1000/0x48868a4e43956322 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1335296->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569fb expref: 30 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.337037:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.337039:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.337045:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.337056:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.337078:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.337087:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054100864:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.337154:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8780 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.338321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.338336:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555776 00000100:00100000:1.0:1746129827.338339:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555776 00010000:00010000:1.0:1746129827.338357:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 22 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.338380:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7964 00000100:00100000:1.0:1746129827.338386:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054555776:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.338396:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.338409:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 22 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.338417:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 22 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.338431:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ea0200/0x48868a4e43956314 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569ed expref: 22 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.338444:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.338464:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054555776:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.338470:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7964 00000100:00100000:1.0:1746129827.338510:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.338520:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054555904 00000100:00100000:1.0:1746129827.338523:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054555904 00010000:00010000:1.0:1746129827.338533:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 17 pid: 8435 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746129827.338547:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7965 00000100:00100000:1.0:1746129827.338552:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054555904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.338558:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.338566:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 17 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746129827.338574:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 17 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746129827.338584:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3c00/0x48868a4e4395634c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a25 expref: 17 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746129827.338592:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.338607:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1962:x1830949054555904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 54us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.338611:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7965 00000100:00100000:3.0:1746129827.338812:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054100736:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.338834:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->2945023] (req 2568192->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.338843:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8fb7200, rc 0) 00000100:00100000:3.0:1746129827.338885:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31810:x1830949054555520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4312us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.338891:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15909 00000100:00100000:0.0:1746129827.340045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.340062:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054556032 00000100:00100000:0.0:1746129827.340065:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054556032 00010000:00010000:0.0:1746129827.340081:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 20 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.340111:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7966 00000100:00100000:0.0:1746129827.340117:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054556032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.340124:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.340134:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 20 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.340143:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 20 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.340157:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff2600/0x48868a4e43956330 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a09 expref: 20 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.340170:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.340172:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.340178:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.340190:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.340213:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.340223:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054100992:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129827.342242:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.342569:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054100864:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.342592:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.343057:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054555648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6111us (6571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.343067:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7963 00000100:00100000:0.0:1746129827.344498:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.344580:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10980:1830949054100992:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129827.344593:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.344632:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054556032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4515us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.344640:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7966 00000100:00100000:3.0:1746129827.345086:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054556544 00000100:00100000:3.0:1746129827.345092:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054556544 00002000:00100000:3.0:1746129827.345127:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2568192->2572287) req@ffff8800926a2a00 x1830949054556544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.345137:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a2a00 with x1830949054556544 ext(2568192->2572287) 00002000:00010000:3.0:1746129827.345141:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a2a00 00000100:00100000:3.0:1746129827.345166:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7176 00000100:00100000:3.0:1746129827.345172:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054556544:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129827.345292:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1963:x1830949054556544:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 120us (797us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129827.345297:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7176 00002000:00100000:3.0:1746129827.345302:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2568192->2572287) req@ffff8800926a2a00 x1830949054556544/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.345309:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a2a00 with x1830949054556544 ext(2568192->2572287) 00002000:00010000:3.0:1746129827.345312:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a2a00 00000100:00100000:0.0:1746129827.345430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.345598:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054556288 00000100:00100000:1.0:1746129827.345602:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054556288 00002000:00100000:1.0:1746129827.345620:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800926a2d80 x1830949054556288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.345626:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a2d80 with x1830949054556288 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.345630:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800926a2d80 00000100:00100000:1.0:1746129827.345648:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7177 00000100:00100000:1.0:1746129827.345653:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054556288:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.356951:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054556288:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11289us (11512us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.356962:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7177 00002000:00100000:1.0:1746129827.356977:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800926a2d80 x1830949054556288/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.357073:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a2d80 with x1830949054556288 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.357078:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800926a2d80 00000100:00100000:1.0:1746129827.362014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.362272:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054556800 00000100:00100000:0.0:1746129827.362281:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054556800 00002000:00100000:0.0:1746129827.362316:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2940928->2945023) req@ffff88012b8e7800 x1830949054556800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.362326:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e7800 with x1830949054556800 ext(2940928->2945023) 00002000:00010000:0.0:1746129827.362330:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e7800 00000100:00100000:0.0:1746129827.362362:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7178 00000100:00100000:0.0:1746129827.362369:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054556800:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129827.362521:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b8e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054556800:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 152us (526us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129827.362528:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7178 00002000:00100000:0.0:1746129827.362533:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2940928->2945023) req@ffff88012b8e7800 x1830949054556800/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.362545:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b8e7800 with x1830949054556800 ext(2940928->2945023) 00002000:00010000:0.0:1746129827.362548:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b8e7800 00000100:00100000:3.0:1746129827.362616:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.362877:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054556928 00000100:00100000:0.0:1746129827.362880:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054556928 00000100:00100000:0.0:1746129827.362907:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15910 00000100:00100000:0.0:1746129827.362912:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31807:x1830949054556928:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129827.362921:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.362934:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a56 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.362954:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.362961:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.362967:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129827.362968:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746129827.362971:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3153920->3801087] (req 3153920->3801087) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.362994:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 17 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.363015:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 17 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.363028:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054101120:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.363096:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.363104:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 18 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.363111:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054101248:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.363133:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.364599:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.365453:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.365476:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.365945:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557056 00000100:00100000:1.0:1746129827.365951:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557056 00000100:00100000:1.0:1746129827.365981:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15911 00000100:00100000:1.0:1746129827.365987:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31805:x1830949054557056:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.366011:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.366026:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a5d expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.366050:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.366056:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129827.366058:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129827.366061:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 19 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.366087:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.366096:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 18 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.366105:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054101376:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.366163:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.366299:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054101120:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.366309:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054101248:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.366326:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3153920->3801087] (req 3153920->3801087) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.366334:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0200, rc 0) 00000100:00100000:2.0:1746129827.366357:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31807:x1830949054556928:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3444us (3741us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.366362:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15910 00000100:00100000:0.0:1746129827.366765:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557184 00000100:00100000:0.0:1746129827.366769:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557184 00002000:00100000:0.0:1746129827.366790:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2568192->2945023) req@ffff8800926a3b80 x1830949054557184/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.366798:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a3b80 with x1830949054557184 ext(2568192->2945023) 00010000:00010000:0.0:1746129827.366803:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 19 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.366812:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 19 pid: 7976 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746129827.366817:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800926a3b80 00000100:00100000:0.0:1746129827.366830:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1937 00000100:00100000:0.0:1746129827.366835:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054557184:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129827.367226:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557312 00000100:00100000:3.0:1746129827.367231:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557312 00010000:00010000:3.0:1746129827.367251:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.367275:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7967 00000100:00100000:3.0:1746129827.367281:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054557312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.367288:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.367300:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.367313:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.367328:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00000/0x48868a4e439562c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 4194304->4931583) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569a0 expref: 19 pid: 8435 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.367339:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.367354:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054557312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 74us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.367359:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7967 00000100:00100000:0.0:1746129827.371396:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.371546:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:4589:1830949054101376:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129827.371568:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.371582:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e2aa400, rc 0) 00000100:00100000:1.0:1746129827.371616:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31805:x1830949054557056:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5629us (7020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.371623:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15911 00000100:00100000:3.0:1746129827.371924:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557440 00000100:00100000:3.0:1746129827.371930:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557440 00002000:00100000:3.0:1746129827.371963:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1073151) req@ffff8800926a0a80 x1830949054557440/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.371971:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a0a80 with x1830949054557440 ext(1048576->1073151) 00010000:00010000:3.0:1746129827.371977:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 21 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.371987:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 21 pid: 1877 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.371994:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800926a0a80 00000100:00100000:3.0:1746129827.372019:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1938 00000100:00100000:3.0:1746129827.372026:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054557440:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129827.375909:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054557440:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 3876us (4513us total) trans 21474841394 rc 0/0 00000100:00100000:3.0:1746129827.375920:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1938 00002000:00100000:3.0:1746129827.375930:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1073151) req@ffff8800926a0a80 x1830949054557440/t21474841394(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.375939:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a0a80 with x1830949054557440 ext(1048576->1073151) 00010000:00010000:3.0:1746129827.375947:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 23 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.375957:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 23 pid: 1877 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.375963:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800926a0a80 00000100:00100000:0.0:1746129827.378910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.378984:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557568 00000100:00100000:3.0:1746129827.378995:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557568 00010000:00010000:3.0:1746129827.379029:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 24 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.379070:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7968 00000100:00100000:3.0:1746129827.379078:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054557568:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.379090:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129827.379103:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129827 -> 1746129828 00010000:00010000:3.0:1746129827.379108:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 24 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.379121:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054557184:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 12284us (13667us total) trans 21474841395 rc 0/0 00010000:00010000:3.0:1746129827.379122:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 24 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.379129:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1937 00002000:00100000:1.0:1746129827.379137:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2568192->2945023) req@ffff8800926a3b80 x1830949054557184/t21474841395(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746129827.379140:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ff3a00/0x48868a4e43956329 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1073151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a02 expref: 24 pid: 1877 timeout: 873 lvb_type: 0 00002000:00100000:1.0:1746129827.379145:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a3b80 with x1830949054557184 ext(2568192->2945023) 00010000:00010000:1.0:1746129827.379151:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 23 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.379157:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.379158:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.379162:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 23 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.379164:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129827.379167:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800926a3b80 00010000:00010000:3.0:1746129827.379172:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.379198:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 16 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.379208:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054101504:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.379251:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.381021:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054101504:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.381042:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.381067:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054557568:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1990us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.381074:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7968 00000100:00100000:0.0:1746129827.382487:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.382559:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557696 00000100:00100000:3.0:1746129827.382565:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557696 00010000:00010000:3.0:1746129827.382591:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 22 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.382703:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7969 00000100:00100000:3.0:1746129827.382711:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054557696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.382721:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129827.382735:0:7109:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.382737:0:7109:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129827 -> 1746129828 00010000:00010000:3.0:1746129827.382742:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 22 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.382752:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 22 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.382769:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8fb7200/0x48868a4e43956376 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2568192->3686399] (req 2568192->2945023) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a4f expref: 22 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.382906:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.382909:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.382915:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 16 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.382923:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 16 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.382951:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 16 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.382966:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054101632:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.383255:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.384182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.384285:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054557952 00000100:00100000:1.0:1746129827.384290:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054557952 00002000:00100000:1.0:1746129827.384319:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800926a3100 x1830949054557952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.384333:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a3100 with x1830949054557952 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.384338:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a3100 00000100:00100000:1.0:1746129827.384365:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7179 00000100:00100000:1.0:1746129827.384370:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054557952:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129827.384940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.385622:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054558208 00000100:00100000:2.0:1746129827.385627:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054558208 00000100:00100000:3.0:1746129827.385633:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054101632:192.168.204.31@tcp:105: 00002000:00100000:2.0:1746129827.385647:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3153920->3158015) req@ffff88009c679c00 x1830949054558208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746129827.385654:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746129827.385656:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679c00 with x1830949054558208 ext(3153920->3158015) 00002000:00010000:2.0:1746129827.385659:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c679c00 00000100:00100000:2.0:1746129827.385674:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7180 00000100:00100000:2.0:1746129827.385679:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054558208:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129827.385684:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054557696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2973us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.385692:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7969 00000100:00100000:2.0:1746129827.385778:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054558208:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 98us (839us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129827.385784:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7180 00002000:00100000:2.0:1746129827.385788:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3153920->3158015) req@ffff88009c679c00 x1830949054558208/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.385796:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679c00 with x1830949054558208 ext(3153920->3158015) 00002000:00010000:2.0:1746129827.385799:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c679c00 00000100:00100000:0.0:1746129827.395407:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.395532:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054558464 00000100:00100000:2.0:1746129827.395539:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054558464 00002000:00100000:2.0:1746129827.395571:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3796992->3801087) req@ffff88009c67a300 x1830949054558464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.395581:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67a300 with x1830949054558464 ext(3796992->3801087) 00002000:00010000:2.0:1746129827.395585:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67a300 00000100:00100000:2.0:1746129827.395617:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7181 00000100:00100000:2.0:1746129827.395625:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054558464:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129827.395762:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054558464:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 137us (363us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129827.395768:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7181 00002000:00100000:2.0:1746129827.395774:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3796992->3801087) req@ffff88009c67a300 x1830949054558464/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.395780:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67a300 with x1830949054558464 ext(3796992->3801087) 00002000:00010000:2.0:1746129827.395782:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67a300 00000100:00100000:1.0:1746129827.396014:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054557952:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11642us (11832us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.396021:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7179 00002000:00100000:1.0:1746129827.396027:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800926a3100 x1830949054557952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.396034:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a3100 with x1830949054557952 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.396038:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800926a3100 00000100:00100000:0.0:1746129827.403172:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.403202:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.403230:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054558592 00000100:00100000:1.0:1746129827.403238:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054558592 00000100:00100000:0.0:1746129827.403241:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.403270:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054558720 00000100:00100000:1.0:1746129827.403271:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054558720 00000100:00100000:1.0:1746129827.404890:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054558848 00000100:00100000:1.0:1746129827.404896:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054558848 00000100:00100000:1.0:1746129827.404920:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15912 00000100:00100000:1.0:1746129827.404926:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054558592:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.404942:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.404957:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a64 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.404975:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.404977:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.404985:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.404997:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 30 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.405016:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800952b9e00, rc 0) 00000100:00100000:0.0:1746129827.405097:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15913 00000100:00100000:0.0:1746129827.405103:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054558720:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129827.405111:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.405119:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a6b expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.405129:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.405130:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.405134:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 23 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.405142:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 23 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.405148:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cae0400, rc 0) 00000100:00100000:3.0:1746129827.405184:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15914 00000100:00100000:1.0:1746129827.405193:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054558592:12345-192.168.204.31@tcp:101:cat.0 Request processed in 267us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.405199:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15912 00000100:00100000:3.0:1746129827.405211:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054558848:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.405219:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.405227:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e43956399 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a72 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.405248:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054558720:12345-192.168.204.31@tcp:101:cat.0 Request processed in 145us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.405254:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15913 00000100:00100000:3.0:1746129827.405299:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054101760:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129827.405415:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.407570:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.407607:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.407685:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.409122:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054559488 00000100:00100000:1.0:1746129827.409130:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054559488 00002000:00100000:1.0:1746129827.409163:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012b7d8380 x1830949054559488/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.409172:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8380 with x1830949054559488 ext(2097152->3145727) 00002000:00010000:1.0:1746129827.409176:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7d8380 00000100:00100000:1.0:1746129827.409192:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054559232 00000100:00100000:1.0:1746129827.409194:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054559232 00002000:00100000:1.0:1746129827.409205:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b7d8700 x1830949054559232/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.409211:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8700 with x1830949054559232 ext(2097152->3145727) 00002000:00010000:1.0:1746129827.409214:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d8700 00000100:00100000:1.0:1746129827.409295:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054559360 00000100:00100000:1.0:1746129827.409297:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054559360 00002000:00100000:1.0:1746129827.409311:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012b7d8a80 x1830949054559360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 504/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.409316:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8a80 with x1830949054559360 ext(3145728->4194303) 00002000:00010000:1.0:1746129827.409319:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d8a80 00000100:00100000:1.0:1746129827.409330:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7182 00000100:00100000:2.0:1746129827.409336:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7183 00000100:00100000:1.0:1746129827.409336:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054559488:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129827.409342:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054559232:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:3.0:1746129827.409748:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129827 -> 1746129828 00000100:00100000:3.0:1746129827.409757:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054101760:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129827.409784:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e43956399 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a72 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.409794:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e43956399 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a72 expref: 23 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.409820:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9a00, rc 0) 00000100:00100000:3.0:1746129827.409863:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054558848:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4671us (6620us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129827.409868:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15914 00000100:00100000:3.0:1746129827.409885:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7184 00000100:00100000:3.0:1746129827.409889:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054559360:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.422037:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.422072:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.422145:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054559872 00000100:00100000:2.0:1746129827.422153:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054559872 00002000:00100000:2.0:1746129827.422185:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012b7d8e00 x1830949054559872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.422193:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8e00 with x1830949054559872 ext(0->1048575) 00002000:00010000:2.0:1746129827.422198:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d8e00 00000100:00100000:2.0:1746129827.422217:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054560128 00000100:00100000:2.0:1746129827.422220:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054560128 00002000:00100000:2.0:1746129827.422233:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b7d9180 x1830949054560128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.422239:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9180 with x1830949054560128 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.422242:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7d9180 00000100:00100000:2.0:1746129827.422254:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7185 00000100:00100000:2.0:1746129827.422260:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054559872:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.422442:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7186 00000100:00100000:3.0:1746129827.422454:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054560128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.422522:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054559488:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13184us (14955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.422529:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7182 00002000:00100000:1.0:1746129827.422535:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012b7d8380 x1830949054559488/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.422542:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8380 with x1830949054559488 ext(2097152->3145727) 00002000:00010000:1.0:1746129827.422545:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7d8380 00000100:00100000:3.0:1746129827.425844:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054559360:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15946us (18151us total) trans 0 rc 401408/401408 00000100:00100000:3.0:1746129827.425866:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7184 00002000:00100000:3.0:1746129827.425875:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012b7d8a80 x1830949054559360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 504/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 401408/401408 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.425882:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8a80 with x1830949054559360 ext(3145728->4194303) 00002000:00010000:3.0:1746129827.425886:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d8a80 00000100:00100000:0.0:1746129827.428746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.428838:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054560384 00000100:00100000:2.0:1746129827.428861:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054560384 00002000:00100000:2.0:1746129827.428897:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012b7d9500 x1830949054560384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.428906:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9500 with x1830949054560384 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.428910:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d9500 00000100:00100000:2.0:1746129827.429035:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7187 00000100:00100000:2.0:1746129827.429043:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054560384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.430983:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054559232:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21631us (23365us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.430995:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7183 00002000:00100000:3.0:1746129827.431014:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b7d8700 x1830949054559232/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.431024:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8700 with x1830949054559232 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.431029:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d8700 00000100:00100000:3.0:1746129827.437638:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1964:x1830949054560128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15181us (15557us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.437648:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7186 00002000:00100000:3.0:1746129827.437658:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88012b7d9180 x1830949054560128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.437667:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9180 with x1830949054560128 ext(1048576->2097151) 00002000:00010000:3.0:1746129827.437671:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7d9180 00000100:00100000:2.0:1746129827.438206:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1964:x1830949054559872:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15944us (16174us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.438213:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7185 00002000:00100000:2.0:1746129827.438218:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012b7d8e00 x1830949054559872/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.438225:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8e00 with x1830949054559872 ext(0->1048575) 00002000:00010000:2.0:1746129827.438228:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d8e00 00000100:00100000:2.0:1746129827.441568:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054560384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12516us (12820us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.441579:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7187 00002000:00100000:2.0:1746129827.441589:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012b7d9500 x1830949054560384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.441598:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9500 with x1830949054560384 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.441603:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d9500 00000100:00100000:0.0:1746129827.444656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.444714:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054560640 00000100:00100000:2.0:1746129827.444722:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054560640 00002000:00100000:2.0:1746129827.444755:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b7d9880 x1830949054560640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.444763:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9880 with x1830949054560640 ext(4194304->4931583) 00002000:00010000:2.0:1746129827.444767:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d9880 00000100:00100000:2.0:1746129827.444788:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7188 00000100:00100000:2.0:1746129827.444794:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054560640:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.452392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.452594:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054560768 00000100:00100000:3.0:1746129827.452603:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054560768 00000100:00100000:3.0:1746129827.452651:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15915 00000100:00100000:3.0:1746129827.452658:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31814:x1830949054560768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.452673:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.452688:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a79 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.452712:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.452718:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.452719:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.452722:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.452745:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.452763:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 18 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.452772:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054101888:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.452845:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.453226:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054560640:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8430us (8575us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129827.453234:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7188 00002000:00100000:2.0:1746129827.453241:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b7d9880 x1830949054560640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.453250:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9880 with x1830949054560640 ext(4194304->4931583) 00010000:00010000:2.0:1746129827.453255:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.453265:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746129827.453271:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7d9880 00000100:00100000:3.0:1746129827.455438:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054101888:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.455467:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 23 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.455481:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f8a00, rc 0) 00000100:00100000:3.0:1746129827.455514:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31814:x1830949054560768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2856us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.455520:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15915 00000100:00100000:0.0:1746129827.456677:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.456729:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054560896 00000100:00100000:2.0:1746129827.456734:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054560896 00002000:00100000:2.0:1746129827.456763:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3153920->3801087) req@ffff88012b7d9f80 x1830949054560896/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.456771:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9f80 with x1830949054560896 ext(3153920->3801087) 00010000:00010000:2.0:1746129827.456778:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.456789:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746129827.456796:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7d9f80 00000100:00100000:2.0:1746129827.456816:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1939 00000100:00100000:2.0:1746129827.456823:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054560896:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129827.456941:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.457200:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054561024 00000100:00100000:3.0:1746129827.457203:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054561024 00000100:00100000:3.0:1746129827.457295:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15916 00000100:00100000:3.0:1746129827.457301:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054561024:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.457308:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.457319:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e439563a7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a80 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.457352:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054102016:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129827.457414:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.459798:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054102016:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129827.459830:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e439563a7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a80 expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.459842:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8e00/0x48868a4e439563a7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a80 expref: 20 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.460070:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f8e00, rc 0) 00000100:00100000:3.0:1746129827.460548:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054561024:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3244us (3603us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129827.460555:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15916 00000100:00100000:1.0:1746129827.466213:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.466284:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054561152 00000100:00100000:2.0:1746129827.466291:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054561152 00000100:00100000:2.0:1746129827.466488:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15917 00000100:00100000:2.0:1746129827.466495:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31805:x1830949054561152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.466507:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.466519:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a87 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.466540:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.466542:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.466546:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4927488->5242879] (req 4927488->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.466556:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [4927488->5242879] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 20 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.466564:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10000, rc 0) 00000100:00100000:3.0:1746129827.467116:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054560896:12345-192.168.204.31@tcp:4:cat.0 Request processed in 10292us (10441us total) trans 21474841396 rc 0/0 00000100:00100000:2.0:1746129827.467116:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31805:x1830949054561152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 621us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.467123:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15917 00000100:00100000:3.0:1746129827.467124:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1939 00002000:00100000:3.0:1746129827.467131:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3153920->3801087) req@ffff88012b7d9f80 x1830949054560896/t21474841396(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.467139:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9f80 with x1830949054560896 ext(3153920->3801087) 00010000:00010000:3.0:1746129827.467145:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 20 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.467155:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 20 pid: 7976 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.467161:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b7d9f80 00000100:00100000:0.0:1746129827.475945:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.476057:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054561280 00000100:00100000:3.0:1746129827.476064:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054561280 00010000:00010000:3.0:1746129827.476098:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 20 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.476134:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7970 00000100:00100000:3.0:1746129827.476141:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054561280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.476153:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.476175:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 20 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.476185:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 20 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.476432:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0200/0x48868a4e4395637d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3153920->3801087) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a56 expref: 20 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.476457:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.476459:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.476465:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.476471:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.476478:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.476479:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.476482:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.476487:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.476511:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 19 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.476526:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054102144:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.476606:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.476614:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054102272:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.476703:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.479291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.480185:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054561536 00000100:00100000:0.0:1746129827.480193:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054561536 00002000:00100000:0.0:1746129827.480228:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff88012e851c00 x1830949054561536/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.480237:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e851c00 with x1830949054561536 ext(4927488->4931583) 00002000:00010000:0.0:1746129827.480242:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e851c00 00000100:00100000:0.0:1746129827.480270:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7189 00000100:00100000:0.0:1746129827.480276:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054561536:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.480417:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054561536:12345-192.168.204.31@tcp:3:cat.0 Request processed in 140us (1130us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746129827.480423:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7189 00002000:00100000:0.0:1746129827.480427:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff88012e851c00 x1830949054561536/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.480434:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e851c00 with x1830949054561536 ext(4927488->4931583) 00002000:00010000:0.0:1746129827.480437:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e851c00 00000100:00100000:3.0:1746129827.480632:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054102144:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.480641:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7109:1830949054102272:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.480661:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.480683:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054561280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4543us (4743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.480690:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7970 00000100:00100000:0.0:1746129827.487053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.487434:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054561920 00000100:00100000:1.0:1746129827.487442:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054561920 00002000:00100000:1.0:1746129827.487478:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012b7da680 x1830949054561920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.487488:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7da680 with x1830949054561920 ext(3145728->4194303) 00002000:00010000:1.0:1746129827.487493:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7da680 00000100:00100000:1.0:1746129827.487526:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7190 00000100:00100000:1.0:1746129827.487533:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054561920:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.488240:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.488280:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054561792 00000100:00100000:2.0:1746129827.488293:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054561792 00002000:00100000:2.0:1746129827.488311:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b7daa00 x1830949054561792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.488318:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7daa00 with x1830949054561792 ext(2097152->3145727) 00002000:00010000:2.0:1746129827.488321:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7daa00 00000100:00100000:2.0:1746129827.488344:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7191 00000100:00100000:2.0:1746129827.488350:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1961:x1830949054561792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.495160:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.495444:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054562176 00000100:00100000:2.0:1746129827.495451:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054562176 00000100:00100000:2.0:1746129827.495774:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15918 00000100:00100000:2.0:1746129827.495784:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31817:x1830949054562176:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129827.495797:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.495810:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a8e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.495834:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.495841:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.495865:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.495867:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.495870:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1163264->1318911] (req 1163264->1318911) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.495894:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.495903:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.495914:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054102400:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.497350:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.497361:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 18 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.497369:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054102528:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.497786:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.498104:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054561792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9751us (9863us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.498113:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7191 00002000:00100000:3.0:1746129827.498121:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b7daa00 x1830949054561792/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.498129:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7daa00 with x1830949054561792 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.498134:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7daa00 00000100:00100000:0.0:1746129827.500900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.500954:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054102400:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.500963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.500964:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054102528:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.500987:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [1163264->1318911] (req 1163264->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.501011:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:2.0:1746129827.501046:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31817:x1830949054562176:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5264us (5893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.501054:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15918 00000100:00100000:2.0:1746129827.501083:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054562304 00000100:00100000:2.0:1746129827.501087:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054562304 00010000:00010000:2.0:1746129827.501112:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.501127:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054562432 00000100:00100000:2.0:1746129827.501129:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054562432 00010000:00010000:2.0:1746129827.501136:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.501148:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7971 00000100:00100000:2.0:1746129827.501153:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054562304:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.501164:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.501181:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.501189:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.501206:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f906a00/0x48868a4e43956242 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356937 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.501219:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.501233:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054561920:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13700us (14187us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.501234:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054562304:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.501241:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7190 00000100:00100000:2.0:1746129827.501242:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7971 00002000:00100000:1.0:1746129827.501248:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012b7da680 x1830949054561920/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746129827.501251:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7972 00000100:00100000:2.0:1746129827.501255:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054562432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746129827.501257:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7da680 with x1830949054561920 ext(3145728->4194303) 00002000:00010000:1.0:1746129827.501260:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7da680 00010000:00010000:2.0:1746129827.501261:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.501267:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.501274:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.501285:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87bc00/0x48868a4e43956249 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35693e expref: 31 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.501291:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.501293:0:10980:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.501298:0:10980:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.501305:0:10980:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.501325:0:10980:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.501334:0:10980:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054102656:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129827.501379:0:10980:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.502507:0:10980:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10980:1830949054102656:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129827.502517:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.502548:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054562432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1292us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.502554:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7972 00000100:00100000:0.0:1746129827.504432:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.504484:0:25617:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054562688 00000100:00100000:1.0:1746129827.504490:0:25617:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054562688 00002000:00100000:1.0:1746129827.504523:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1163264->1167359) req@ffff88012b7db480 x1830949054562688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.504532:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7db480 with x1830949054562688 ext(1163264->1167359) 00002000:00010000:1.0:1746129827.504537:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7db480 00000100:00100000:1.0:1746129827.505359:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7192 00000100:00100000:1.0:1746129827.505368:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054562688:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129827.505507:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054562688:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 140us (1079us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129827.505514:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7192 00002000:00100000:1.0:1746129827.505519:0:25617:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3f2:0x0] (1163264->1167359) req@ffff88012b7db480 x1830949054562688/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.505526:0:25617:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7db480 with x1830949054562688 ext(1163264->1167359) 00002000:00010000:1.0:1746129827.505529:0:25617:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7db480 00000100:00100000:0.0:1746129827.511989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.513194:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054562944 00000100:00100000:3.0:1746129827.513203:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054562944 00002000:00100000:3.0:1746129827.513244:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b7db800 x1830949054562944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.513254:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7db800 with x1830949054562944 ext(4194304->4931583) 00002000:00010000:3.0:1746129827.513259:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7db800 00000100:00100000:0.0:1746129827.513422:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.513649:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054563200 00000100:00100000:3.0:1746129827.513652:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054563200 00002000:00100000:3.0:1746129827.513668:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1314816->1318911) req@ffff88012b7dbb80 x1830949054563200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.513675:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7dbb80 with x1830949054563200 ext(1314816->1318911) 00002000:00010000:3.0:1746129827.513678:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7dbb80 00000100:00100000:3.0:1746129827.513697:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7193 00000100:00100000:3.0:1746129827.513703:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054562944:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.514536:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7194 00000100:00100000:3.0:1746129827.514543:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054563200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.514608:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054563200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 66us (1187us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129827.514613:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7194 00002000:00100000:3.0:1746129827.514618:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f2:0x0] (1314816->1318911) req@ffff88012b7dbb80 x1830949054563200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.514625:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7dbb80 with x1830949054563200 ext(1314816->1318911) 00002000:00010000:3.0:1746129827.514628:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7dbb80 00000100:00100000:3.0:1746129827.520121:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054562944:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6411us (8132us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129827.520137:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7193 00002000:00100000:3.0:1746129827.520146:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b7db800 x1830949054562944/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.520155:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7db800 with x1830949054562944 ext(4194304->4931583) 00002000:00010000:3.0:1746129827.520159:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7db800 00000100:00100000:0.0:1746129827.534753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.535932:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054563328 00000100:00100000:2.0:1746129827.535942:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054563328 00000100:00100000:2.0:1746129827.535991:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11128 00000100:00100000:2.0:1746129827.536008:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31820:x1830949054563328:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.536030:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.536044:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e439563bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a95 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.536526:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536547:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536563:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536577:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536582:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536592:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536694:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536706:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 296 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.536711:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 24 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.536714:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.536737:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 24 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.536745:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 24 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.536756:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054102784:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.537097:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 296 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.537105:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 296 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.537113:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054102912:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.537357:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.539021:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054102784:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.539737:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.539776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.539879:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054563584 00000100:00100000:3.0:1746129827.539885:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054563584 00000100:00100000:3.0:1746129827.539922:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054563840 00000100:00100000:3.0:1746129827.539925:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054563840 00000100:00100000:3.0:1746129827.539941:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4675 00000100:00100000:3.0:1746129827.539947:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:7658:x1830949054563584:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129827.540087:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054102912:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.540107:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129827.540154:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:7658:x1830949054563584:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 206us (418us total) trans 8589945158 rc 0/0 00000100:00100000:3.0:1746129827.540160:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4675 00000100:00100000:3.0:1746129827.540184:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4676 00000100:00100000:3.0:1746129827.540189:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:23993:x1830949054563840:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746129827.540271:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129827.540312:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50eb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:23993:x1830949054563840:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 123us (535us total) trans 8589945159 rc 0/0 00000100:00100000:3.0:1746129827.540318:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4676 00000100:00100000:0.0:1746129827.542551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.542603:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.542627:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564096 00000100:00100000:2.0:1746129827.542633:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564096 00010000:00010000:2.0:1746129827.542660:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 298 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.542671:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054563968 00000100:00100000:3.0:1746129827.542675:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054563968 00010000:00010000:3.0:1746129827.542693:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 26 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.542726:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7973 00000100:00100000:2.0:1746129827.542734:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+298:1962:x1830949054564096:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.542746:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.542751:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 298 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.542752:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7974 00000100:00100000:3.0:1746129827.542759:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054563968:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.542761:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 298 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.542765:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.542768:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 26 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.542780:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395626c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35695a expref: 298 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.542835:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 26 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.542843:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.542870:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.542877:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.542882:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.542889:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.542922:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949054564096:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 189us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.542928:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7973 00010000:00010000:3.0:1746129827.542934:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d5200/0x48868a4e4395627a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356961 expref: 26 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.542942:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.542945:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.542951:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.542956:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.542972:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129827.542979:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.542985:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129827.542989:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054563968:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 231us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.542994:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7974 00000004:00200000:2.0:1746129827.543026:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129827.543030:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129827.543042:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543050:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543057:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543062:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543067:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543072:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129827.543074:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543080:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543088:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129827.543090:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129827.543094:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543098:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10600/0x48868a4e439563c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543106:0:14313:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543110:0:14313:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543115:0:14313:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543118:0:14313:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10a00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129827.543119:0:14313:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543124:0:14313:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543128:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092830400) 00010000:00010000:2.0:1746129827.543130:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129827.543132:0:14313:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543135:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e439563ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.543162:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10c00/0x48868a4e439563bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.543171:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 12 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.543176:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.543178:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129827.543180:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11c00, rc 0) 00000100:00100000:2.0:1746129827.543200:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31820:x1830949054563328:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 7203us (8453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.543205:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11128 00000100:00100000:0.0:1746129827.544813:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.544881:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564224 00000100:00100000:2.0:1746129827.544885:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564224 00000100:00100000:2.0:1746129827.544922:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15919 00000100:00100000:2.0:1746129827.544928:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054564224:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.544939:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.544951:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356a9c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.544968:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.544970:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.544977:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.544988:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.544996:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:2.0:1746129827.545042:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054564224:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 114us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.545047:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15919 00000100:00100000:1.0:1746129827.545186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.545400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.545428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.545441:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.545645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.545914:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564480 00000100:00100000:0.0:1746129827.545914:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564736 00000100:00100000:2.0:1746129827.545917:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564480 00000100:00100000:0.0:1746129827.545917:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564736 00000100:00100000:0.0:1746129827.545935:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564352 00000100:00100000:0.0:1746129827.545937:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564352 00000100:00100000:2.0:1746129827.545941:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564608 00000100:00100000:2.0:1746129827.545943:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564608 00000100:00100000:0.0:1746129827.545946:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054564864 00000100:00100000:0.0:1746129827.545947:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054564864 00000100:00100000:2.0:1746129827.545955:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15920 00000100:00100000:0.0:1746129827.545958:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15921 00000100:00100000:2.0:1746129827.545959:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054564736:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129827.545962:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054564480:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.545966:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.545967:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.545973:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ab8 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.545973:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356aaa expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.545984:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.545984:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.545986:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.545986:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.545991:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.545991:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.546010:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.546010:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 8 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.546017:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00010000:00010000:0.0:1746129827.546017:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f87ba00, rc 0) 00000100:00100000:2.0:1746129827.546035:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054564736:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 75us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.546035:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054564480:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 72us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.546039:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15921 00000100:00100000:2.0:1746129827.546048:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15920 00000100:00100000:2.0:1746129827.546059:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15922 00000100:00100000:2.0:1746129827.546063:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054564352:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.546071:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129827.546073:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15923 00010000:00010000:2.0:1746129827.546076:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e439563ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356aa3 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.546079:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054564608:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129827.546084:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.546089:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ab1 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.546097:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.546098:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.546102:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129827.546103:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054103040:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129827.546109:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.546115:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d7f9a00, rc 0) 00000100:00100000:2.0:1746129827.546137:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.546141:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15924 00000100:00100000:1.0:1746129827.546147:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054564864:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129827.546152:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.546157:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356abf expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.546165:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.546167:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.546171:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.546179:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.546185:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f32600, rc 0) 00000100:00080000:0.0:1746129827.546221:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129827.546305:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054564608:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 145us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.546310:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15923 00000100:00100000:1.0:1746129827.546370:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054564864:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 223us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.546375:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15924 00002000:00010000:2.0:1746129827.548263:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime: 1746129827 -> 1746129828 00002000:00010000:2.0:1746129827.548268:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129827 -> 1746129828 00002000:00010000:2.0:1746129827.548269:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime: 1746129827 -> 1746129828 00000100:00100000:2.0:1746129827.548287:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054103040:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129827.548304:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e439563ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aa3 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.548313:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e439563ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aa3 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.548319:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:2.0:1746129827.548356:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054564352:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2292us (2927us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129827.548360:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15922 00000100:00100000:0.0:1746129827.549925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.550011:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054565120 00000100:00100000:2.0:1746129827.550018:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054565120 00000100:00100000:2.0:1746129827.550062:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11129 00000100:00100000:2.0:1746129827.550069:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31820:x1830949054565120:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.550082:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.550096:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e43956402 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ac6 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.550165:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.550177:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.550184:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.550430:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.550441:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 13 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.550451:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054103168:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.550528:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.552357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.552413:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054565248 00000100:00100000:3.0:1746129827.552418:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054565248 00010000:00010000:3.0:1746129827.552448:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 14 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.552449:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054103168:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.552467:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129827.552471:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7975 00000100:00100000:3.0:1746129827.552478:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054565248:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.552488:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.552493:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 14 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.552503:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 14 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.552519:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439563d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a95 expref: 14 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.552530:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.552534:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.552542:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.552547:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.552574:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129827.552594:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.552600:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129827.552614:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054565248:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 137us (260us total) trans 0 rc 0/0 00000004:00200000:2.0:1746129827.552614:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:3.0:1746129827.552619:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7975 00010000:00010000:2.0:1746129827.552725:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e43956402 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.552747:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.552753:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.552756:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129827.552758:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11200, rc 0) 00000100:00100000:2.0:1746129827.552788:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31820:x1830949054565120:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2719us (2867us total) trans 8589945160 rc 0/0 00000100:00100000:2.0:1746129827.552793:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11129 00000100:00100000:0.0:1746129827.556423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.556556:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054565376 00000100:00100000:2.0:1746129827.556565:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054565376 00000100:00100000:2.0:1746129827.556620:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11130 00000100:00100000:2.0:1746129827.556627:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31820:x1830949054565376:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.556646:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.556661:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x48868a4e43956417 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356acd expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.556729:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.556743:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.556750:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.556777:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.556788:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 14 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.556798:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054103296:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.557169:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.562881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.563284:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e851500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054103296:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.563302:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129827.563333:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054565504 00000100:00100000:3.0:1746129827.563339:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054565504 00010000:00010000:3.0:1746129827.563368:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 15 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.563403:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7976 00000100:00100000:3.0:1746129827.563426:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:1962:x1830949054565504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.563437:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.563443:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 15 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.563453:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 15 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.563474:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956409 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ac6 expref: 15 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.563498:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.563502:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.563510:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.563515:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.563538:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.563584:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054565504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 157us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.563591:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7976 00010000:00010000:2.0:1746129827.564182:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.564189:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129827.564225:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129827.564229:0:14313:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129827.564242:0:14313:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.564268:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11000/0x48868a4e43956417 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356acd expref: 14 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.564279:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356acd expref: 13 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.564285:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.564287:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129827.564290:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:2.0:1746129827.564681:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31820:x1830949054565376:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8053us (8263us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.564687:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11130 00000100:00100000:2.0:1746129827.570184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.571520:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054565632 00000100:00100000:0.0:1746129827.571530:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054565632 00000100:00100000:1.0:1746129827.572131:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15925 00000100:00100000:1.0:1746129827.572140:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054565632:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129827.572155:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.572169:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f32e00/0x48868a4e43956425 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ad4 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.572214:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054103424:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129827.572724:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.574939:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054103424:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129827.574965:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f32e00/0x48868a4e43956425 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ad4 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.574976:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f32e00/0x48868a4e43956425 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ad4 expref: 8 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.575006:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f32e00, rc 0) 00000100:00100000:1.0:1746129827.575051:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054565632:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2912us (4873us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129827.575058:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15925 00000100:00100000:0.0:1746129827.577484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.577569:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054565888 00000100:00100000:2.0:1746129827.577577:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054565888 00000100:00100000:2.0:1746129827.577624:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11131 00000100:00100000:2.0:1746129827.577631:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31820:x1830949054565888:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.577647:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.577661:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4e00/0x48868a4e4395642c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356adb expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.577736:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43956433 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.577748:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43956433 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.577763:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43956433 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000004:00200000:2.0:1746129827.577772:0:14313:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129827.577888:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4e00/0x48868a4e4395642c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356adb expref: 16 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.577900:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43956433 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356adb expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.578407:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.578410:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129827.578413:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094be4600, rc 0) 00000100:00100000:2.0:1746129827.578679:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31820:x1830949054565888:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1047us (1199us total) trans 8589945161 rc 0/0 00000100:00100000:2.0:1746129827.578685:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11131 00000100:00100000:0.0:1746129827.582335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.582449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.582474:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.582628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.583046:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566016 00000100:00100000:2.0:1746129827.583054:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566016 00000100:00100000:0.0:1746129827.583061:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.583084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.583089:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566272 00000100:00100000:2.0:1746129827.583091:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566272 00000100:00100000:0.0:1746129827.583095:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566528 00000100:00100000:0.0:1746129827.583096:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566528 00000100:00100000:2.0:1746129827.583102:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566144 00000100:00100000:2.0:1746129827.583103:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566144 00000100:00100000:0.0:1746129827.583108:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566400 00000100:00100000:0.0:1746129827.583110:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566400 00000100:00100000:2.0:1746129827.583111:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566656 00000100:00100000:2.0:1746129827.583112:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566656 00000100:00100000:2.0:1746129827.583125:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15926 00000100:00100000:2.0:1746129827.583131:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054566016:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:0.0:1746129827.583131:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15927 00000100:00100000:0.0:1746129827.583134:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054566272:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129827.583163:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.583163:0:1877:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583178:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.583178:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583185:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583185:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583192:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583192:0:1877:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 29 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583197:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.583197:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.583198:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.583198:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.583201:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.583201:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583223:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 22 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583223:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 29 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583234:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 22 pid: 4589 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.583234:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 29 pid: 4589 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.583245:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054103680:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.583245:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054103552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.583301:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583309:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 10 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.583315:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054103808:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.583412:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15928 00000100:00100000:1.0:1746129827.583419:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054566528:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129827.583432:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.583440:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.583446:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.583451:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.583455:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.583456:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.583459:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.583472:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 18 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.583478:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 18 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.583485:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054103936:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.583517:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15929 00000100:00100000:3.0:1746129827.583526:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054566144:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129827.583537:0:4589:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.583545:0:4589:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.583550:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.583550:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.583552:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.583564:0:4589:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.583570:0:4589:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 29 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.583576:0:4589:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054104064:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.583791:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 9 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583799:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 9 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746129827.583805:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.583806:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054104192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.583812:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 18 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.583818:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054104320:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.583825:0:1877:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.583831:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4edd300 going to sleep for 11 seconds 00010000:00010000:0.0:1746129827.583832:0:1877:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.583839:0:1877:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054104448:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.583862:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15930 00000100:00100000:0.0:1746129827.583866:0:1877:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.583868:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054566400:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:0.0:1746129827.583878:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15931 00010000:00010000:2.0:1746129827.583882:0:3623:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.583882:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054566656:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129827.583890:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.583893:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583896:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583901:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583902:0:3623:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 22 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583907:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.583907:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583908:0:3623:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.583910:0:3623:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.583913:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583920:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583921:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 22 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.583925:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129827.583926:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129827.583927:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 22 pid: 1877 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.583928:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.583934:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054104576:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.583939:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 17 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.583945:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 17 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.583952:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054104704:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.583953:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.583963:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 10 pid: 8436 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.583966:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 17 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129827.583970:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800926a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054104832:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.583972:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 17 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.583978:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054104960:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.583983:0:3623:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 18 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.583989:0:3623:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 18 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.583990:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746129827.584006:0:3623:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054105088:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.584012:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 9 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.584018:0:3623:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.584019:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054105216:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.584045:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 29 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.584106:0:4589:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800931a8cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746129827.584117:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 10 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.584125:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 10 pid: 7976 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746129827.584132:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054105472:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129827.584150:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.584150:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 29 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.584157:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 22 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.584157:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054105344:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.584163:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054105600:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.584169:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129827.584173:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.591809:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.591833:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.591948:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054104704:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.591986:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.592015:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566912 00000100:00100000:0.0:1746129827.592020:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566912 00010000:00010000:0.0:1746129827.592045:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 10 pid: 8435 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.592065:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054566784 00000100:00100000:0.0:1746129827.592067:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054566784 00010000:00010000:0.0:1746129827.592076:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.592092:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567168 00000100:00100000:0.0:1746129827.592093:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567168 00010000:00010000:0.0:1746129827.592101:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 19 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.592113:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7977 00000100:00100000:0.0:1746129827.592118:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054566912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592127:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592146:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 10 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592155:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 10 pid: 8435 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592176:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592208:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054566912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592214:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7977 00000100:00100000:0.0:1746129827.592227:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7978 00000100:00100000:0.0:1746129827.592231:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054566784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592238:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592249:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592256:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592267:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592281:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054566784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 50us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592285:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7978 00000100:00100000:0.0:1746129827.592294:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7979 00000100:00100000:0.0:1746129827.592298:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054567168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592304:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592311:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 19 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592318:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 19 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592328:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592340:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054567168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 42us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592345:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7979 00000100:00100000:0.0:1746129827.592390:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.592405:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567680 00000100:00100000:0.0:1746129827.592408:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567680 00010000:00010000:0.0:1746129827.592418:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 18 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.592430:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7980 00000100:00100000:0.0:1746129827.592434:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1963:x1830949054567680:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592440:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592448:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 18 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592455:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 18 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592464:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093befa00/0x48868a4e439562a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35697d expref: 18 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592478:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592492:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054567680:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592496:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7980 00000100:00100000:0.0:1746129827.592551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.592561:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567424 00000100:00100000:0.0:1746129827.592563:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567424 00010000:00010000:0.0:1746129827.592571:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.592583:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7981 00000100:00100000:0.0:1746129827.592587:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054567424:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592592:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592598:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592609:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 17 pid: 7976 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.592618:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592631:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1963:x1830949054567424:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592635:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7981 00000100:00100000:0.0:1746129827.592681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.592691:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567808 00000100:00100000:0.0:1746129827.592693:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567808 00010000:00010000:0.0:1746129827.592702:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 11 pid: 8436 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.592713:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7982 00000100:00100000:0.0:1746129827.592717:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054567808:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592722:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592730:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 11 pid: 8436 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592737:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 11 pid: 8436 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592746:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592757:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054567808:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 40us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592764:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7982 00000100:00100000:0.0:1746129827.592808:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054104960:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.592830:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.592840:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567040 00000100:00100000:0.0:1746129827.592842:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567040 00010000:00010000:0.0:1746129827.592873:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 30 pid: 4589 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.592886:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7983 00000100:00100000:0.0:1746129827.592890:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054567040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.592895:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.592900:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 30 pid: 4589 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592906:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 30 pid: 4589 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.592916:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.592917:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.592920:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.592926:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.592939:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.592949:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054567040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.592954:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7983 00000100:00100000:0.0:1746129827.592981:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.593028:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.593036:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567296 00000100:00100000:0.0:1746129827.593038:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567296 00010000:00010000:0.0:1746129827.593046:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 19 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.593056:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7984 00000100:00100000:0.0:1746129827.593059:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054567296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.593064:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.593070:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 19 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.593076:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 19 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.593084:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.593097:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054567296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 37us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.593100:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7984 00000100:00100000:0.0:1746129827.593119:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.593127:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567936 00000100:00100000:0.0:1746129827.593129:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567936 00010000:00010000:0.0:1746129827.593136:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 23 pid: 1877 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.593151:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7985 00000100:00100000:0.0:1746129827.593155:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054567936:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.593160:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.593383:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10000/0x48868a4e439563ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a87 expref: 18 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.593399:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054103936:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.593483:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054104576:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.593493:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f9a00/0x48868a4e439563f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab1 expref: 10 pid: 8436 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.593519:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054104832:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.593540:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800952b9e00/0x48868a4e4395638b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a64 expref: 29 pid: 4589 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.593548:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054103552:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.593556:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87ba00/0x48868a4e439563e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356aaa expref: 9 pid: 8435 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.593568:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054104192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.593575:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8fb7000/0x48868a4e4395636f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a48 expref: 16 pid: 7976 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.593582:0:1877:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1877:1830949054104448:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.593599:0:1877:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593607:0:1877:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593613:0:1877:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593635:0:1877:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593641:0:1877:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593646:0:1877:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593651:0:1877:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87a800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129827.593654:0:1877:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.593664:0:1877:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.593670:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054567552 00010000:00010000:2.0:1746129827.593673:0:1877:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.593674:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054567552 00010000:00010000:2.0:1746129827.593678:0:1877:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f87a800/0x48868a4e43956441 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746129827.593701:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1163264->1318911) req@ffff88009f939180 x1830949054567552/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.593708:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830949054567552 ext(1163264->1318911) 00000100:00100000:2.0:1746129827.593710:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1963:x1830949054566272:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 10575us (11260us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129827.593714:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 29 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.593715:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15927 00010000:00010000:3.0:1746129827.593721:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 29 pid: 20441 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.593726:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:3.0:1746129827.593736:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1940 00000100:00100000:3.0:1746129827.593741:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054567552:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129827.593940:0:4589:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:4589:1830949054104064:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.593951:0:4589:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.593968:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012e850a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054103680:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.593977:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11e00/0x48868a4e439563d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a9c expref: 9 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.593987:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054103808:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.593995:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e4395635a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a33 expref: 17 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.594017:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800926a2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054104320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.594036:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.594244:0:3623:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:3623:1830949054105088:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.594259:0:3623:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.594282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.594326:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054105216:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.594368:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568192 00000100:00100000:1.0:1746129827.594371:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568192 00000100:00100000:3.0:1746129827.594383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129827.594383:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 17 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.594395:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568576 00000100:00100000:1.0:1746129827.594396:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568576 00000100:00100000:3.0:1746129827.594397:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7986 00000100:00100000:3.0:1746129827.594402:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1964:x1830949054568192:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.594403:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 16 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.594408:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.594417:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 17 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.594424:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 17 pid: 4589 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.594427:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7987 00000100:00100000:1.0:1746129827.594431:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1963:x1830949054568576:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.594436:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e2aa400/0x48868a4e43956384 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a5d expref: 17 pid: 4589 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.594437:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.594444:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129827.594444:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 16 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746129827.594450:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 16 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746129827.594459:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f859800/0x48868a4e43956353 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a2c expref: 16 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.594462:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1964:x1830949054568192:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.594467:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7986 00010000:00010000:1.0:1746129827.594467:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.594483:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:1963:x1830949054568576:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.594489:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7987 00000100:00100000:1.0:1746129827.594512:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054105472:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.594517:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054105600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129827.594527:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.595317:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054105344:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.595334:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598056:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 23 pid: 1877 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598148:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 23 pid: 1877 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598169:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cae0400/0x48868a4e43956392 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a6b expref: 23 pid: 1877 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598183:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.598185:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.598188:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598195:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598215:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.598258:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1964:x1830949054567936:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5101us (5136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.598266:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7985 00000100:00100000:0.0:1746129827.598367:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.598401:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.598421:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.598440:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.598453:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568448 00000100:00100000:0.0:1746129827.598459:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568448 00010000:00010000:0.0:1746129827.598479:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 9 pid: 7976 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.598493:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568320 00000100:00100000:0.0:1746129827.598495:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568320 00010000:00010000:0.0:1746129827.598503:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 8 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.598513:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568064 00000100:00100000:0.0:1746129827.598514:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568064 00010000:00010000:0.0:1746129827.598522:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 22 pid: 4589 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746129827.598529:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568704 00000100:00100000:0.0:1746129827.598530:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568704 00010000:00010000:0.0:1746129827.598536:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 23 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.598545:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7988 00000100:00100000:0.0:1746129827.598550:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054568448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.598560:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.598575:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 9 pid: 7976 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598583:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 9 pid: 7976 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598596:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11a00/0x48868a4e439563df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ab8 expref: 9 pid: 7976 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598604:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.598617:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054568448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.598622:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7988 00000100:00100000:0.0:1746129827.598631:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7989 00000100:00100000:0.0:1746129827.598635:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054568320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.598642:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.598653:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 8 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598660:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 8 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598671:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e439563fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356abf expref: 8 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598680:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.598693:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054568320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 58us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.598698:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7989 00000100:00100000:0.0:1746129827.598707:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7990 00000100:00100000:0.0:1746129827.598711:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054568064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.598717:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.598724:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 23 pid: 4589 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598731:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 23 pid: 4589 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598741:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1f200/0x48868a4e43956368 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a41 expref: 23 pid: 4589 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746129827.598749:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.598751:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.598753:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598759:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598772:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.598785:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054568064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.598791:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7990 00000100:00100000:0.0:1746129827.598800:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7991 00000100:00100000:0.0:1746129827.598804:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054568704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.598809:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.598815:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 21 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.598827:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 21 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.598836:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d7f8a00/0x48868a4e439563a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a79 expref: 21 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.598845:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.598862:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.598865:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598871:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598884:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.598899:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054568704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.598903:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7991 00010000:00010000:0.0:1746129827.598919:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598926:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598941:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598952:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598958:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598964:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f32a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129827.598967:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598974:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598982:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.598987:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f32a00/0x48868a4e4395644f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.599032:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1963:x1830949054566528:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 15614us (16557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.599039:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15928 00000100:00100000:0.0:1746129827.599133:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.599147:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568832 00000100:00100000:0.0:1746129827.599149:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568832 00010000:00010000:0.0:1746129827.599159:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 31 pid: 1877 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.599169:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7992 00000100:00100000:0.0:1746129827.599172:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054568832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129827.599177:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129827.599184:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 31 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.599191:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 31 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.599201:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ea1e00/0x48868a4e4395631b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3569f4 expref: 31 pid: 1877 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746129827.599208:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.599210:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.599212:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.599217:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.599228:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129827.599240:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054568832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 67us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.599244:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7992 00010000:00010000:3.0:1746129827.599368:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599376:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599389:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599395:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599400:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599405:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f906a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.599407:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599412:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599425:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.599430:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f906a00/0x48868a4e43956448 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.599464:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054566016:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 16333us (17137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.599469:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15926 00010000:00010000:2.0:1746129827.600015:0:3623:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600026:0:3623:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600041:0:3623:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600047:0:3623:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600052:0:3623:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600057:0:3623:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a540e400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129827.600059:0:3623:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600065:0:3623:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600073:0:3623:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600078:0:3623:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a540e400/0x48868a4e4395645d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3623 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.600111:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054566400:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 16242us (17049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.600116:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15930 00010000:00010000:2.0:1746129827.600131:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600137:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600149:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600154:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600160:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600164:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129827.600166:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600172:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600180:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.600185:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10800/0x48868a4e43956464 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.600211:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1963:x1830949054566656:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 16329us (17128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.600216:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15931 00000100:00100000:3.0:1746129827.605268:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054567552:12345-192.168.204.31@tcp:4:cat.0 Request processed in 11517us (12276us total) trans 17179874201 rc 0/0 00000100:00100000:3.0:1746129827.605278:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1940 00002000:00100000:3.0:1746129827.605288:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1163264->1318911) req@ffff88009f939180 x1830949054567552/t17179874201(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.605297:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939180 with x1830949054567552 ext(1163264->1318911) 00010000:00010000:3.0:1746129827.605305:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.605318:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746129827.605325:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939180 00000100:00100000:0.0:1746129827.606959:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.607139:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054568960 00000100:00100000:1.0:1746129827.607146:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054568960 00010000:00010000:1.0:1746129827.607169:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.607191:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7993 00000100:00100000:1.0:1746129827.607198:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054568960:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.607219:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.607236:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.607250:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.607269:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11800/0x48868a4e439563b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1163264->1318911) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356a8e expref: 30 pid: 20441 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.607280:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.607328:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.607334:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.607342:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.607370:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.607405:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054568960:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 207us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.607410:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7993 00010000:00010000:3.0:1746129827.607483:0:4589:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607496:0:4589:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607511:0:4589:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607517:0:4589:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607524:0:4589:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607529:0:4589:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d7f8e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.607532:0:4589:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607538:0:4589:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607548:0:4589:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.607553:0:4589:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d7f8e00/0x48868a4e43956456 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.607595:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1963:x1830949054566144:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 24073us (24966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.607604:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15929 00000100:00100000:0.0:1746129827.609557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.609637:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054569216 00000100:00100000:2.0:1746129827.609642:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054569216 00000100:00100000:2.0:1746129827.609718:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11132 00000100:00100000:2.0:1746129827.609725:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+15:31820:x1830949054569216:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129827.609761:0:14313:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746129827.609777:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395641e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356acd expref: 15 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.609792:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e43955ebb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f9 expref: 14 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.609799:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.609803:0:14313:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129827.609822:0:14313:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.609831:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 24 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.609837:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.609843:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 296 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610008:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 24 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610015:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610021:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610027:0:14313:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 296 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610033:0:14313:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 10/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.610056:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 296 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610066:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 296 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.610076:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054105728:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.610382:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610390:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 24 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.610401:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054105856:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.610546:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610554:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.610562:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054105984:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.610837:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 24 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.610845:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 24 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.610868:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106112:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.611438:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 296 pid: 15044 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.611446:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 296 pid: 15044 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.611454:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106240:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.611490:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.611501:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 24 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.611508:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106368:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.611534:0:14313:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 24 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.611541:0:14313:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 24 pid: 14315 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.611775:0:14313:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106496:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.611811:0:14313:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1df00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.612529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.612771:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d637100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054105728:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.612792:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054569344 00000100:00100000:1.0:1746129827.612797:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054569344 00010000:00010000:1.0:1746129827.612820:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 297 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.612879:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7994 00000100:00100000:1.0:1746129827.612887:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1963:x1830949054569344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.612896:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.612901:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 297 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.612912:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 297 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.612930:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6ffa00/0x48868a4e439560ac lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356842 expref: 297 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.612942:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129827.612947:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.612954:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.612980:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1963:x1830949054569344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 94us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.612985:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7994 00000100:00100000:0.0:1746129827.613970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.613994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.614042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.614109:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054569472 00000100:00100000:2.0:1746129827.614113:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054569472 00010000:00010000:2.0:1746129827.614129:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 25 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.614149:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7995 00000100:00100000:2.0:1746129827.614155:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054569472:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.614162:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.614167:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 25 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.614174:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 25 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.614186:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.614190:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.614200:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.614222:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054569472:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 68us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.614228:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7995 00010000:00010000:2.0:1746129827.614254:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a507f200/0x48868a4e43956074 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356826 expref: 24 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.614264:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054105856:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.614272:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054105984:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.614277:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106112:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.614284:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054569728 00000100:00100000:1.0:1746129827.614288:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054569728 00000100:00100000:1.0:1746129827.614306:0:16532:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054569984 00000100:00100000:1.0:1746129827.614308:0:16532:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054569984 00000100:00100000:1.0:1746129827.614320:0:16532:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4677 00000100:00100000:1.0:1746129827.614325:0:16532:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:29848:x1830949054569728:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129827.614345:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4678 00000100:00100000:3.0:1746129827.614356:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:14511:x1830949054569984:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129827.614467:0:16532:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:29848:x1830949054569728:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 141us (499us total) trans 8589945162 rc 0/0 00000100:00100000:3.0:1746129827.614471:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:14511:x1830949054569984:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 119us (428us total) trans 8589945163 rc 0/0 00000100:00100000:1.0:1746129827.614472:0:16532:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4677 00000100:00100000:3.0:1746129827.614477:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4678 00000100:00100000:2.0:1746129827.615228:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106240:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.615691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.615714:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.615865:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570112 00000100:00100000:3.0:1746129827.615869:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570112 00010000:00010000:3.0:1746129827.615887:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 25 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.615903:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570240 00000100:00100000:3.0:1746129827.615904:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570240 00010000:00010000:3.0:1746129827.615912:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 297 pid: 15044 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.615930:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7996 00000100:00100000:3.0:1746129827.615936:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054570112:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.615944:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.615948:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 25 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.615956:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 25 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.615969:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.615973:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.615980:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.616013:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054570112:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.616019:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7996 00000100:00100000:3.0:1746129827.616033:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7997 00000100:00100000:3.0:1746129827.616038:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1961:x1830949054570240:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.616045:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.616048:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 297 pid: 15044 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.616055:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 297 pid: 15044 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.616065:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cae1e00/0x48868a4e43955eb4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566f2 expref: 297 pid: 15044 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.616075:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.616077:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.616082:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.616095:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1961:x1830949054570240:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 57us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.616100:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7997 00010000:00010000:2.0:1746129827.616377:0:14313:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013083b800/0x48868a4e43955e91 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566e4 expref: 24 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.616386:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106368:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.616393:0:14313:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14313:1830949054106496:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.616421:0:14313:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129827.617335:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.617357:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.617706:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.617832:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570496 00000100:00100000:1.0:1746129827.617838:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570496 00000100:00100000:2.0:1746129827.617868:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570368 00000100:00100000:2.0:1746129827.617872:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570368 00010000:00010000:1.0:1746129827.617874:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 24 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.617882:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.617891:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570624 00000100:00100000:1.0:1746129827.617893:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570624 00000100:00100000:2.0:1746129827.617896:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7998 00000100:00100000:2.0:1746129827.617901:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054570496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129827.617901:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 25 pid: 14315 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.617910:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129827.617911:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7999 00010000:00010000:2.0:1746129827.617913:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 25 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.617915:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1963:x1830949054570368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.617921:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 25 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.617922:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129827.617925:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.617933:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a12a200/0x48868a4e43955fa2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35678c expref: 25 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.617966:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8000 00000100:00100000:3.0:1746129827.617974:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054570624:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.617981:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.617984:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 25 pid: 14315 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.618210:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.618222:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094ea1800/0x48868a4e43955fc5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3567a1 expref: 296 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.618225:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 24 pid: 14315 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746129827.618231:0:10980:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129827.618235:0:10980:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.618242:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129827.618244:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.618246:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.618251:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129827.618279:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1963:x1830949054570368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 362us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.618284:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7999 00010000:00010000:3.0:1746129827.618324:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d91200/0x48868a4e43955e8a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3566dd expref: 24 pid: 14315 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.618333:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.618335:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.618341:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.618347:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14313 initiator: MDT0 00010000:00010000:3.0:1746129827.618364:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.618457:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054570496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 555us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.618463:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7998 00010000:00010000:2.0:1746129827.618483:0:14313:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00010000:00010000:2.0:1746129827.618489:0:14313:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:3.0:1746129827.619660:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054570624:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1683us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.619668:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8000 00000040:00080000:2.0:1746129827.620643:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3569, 88 off300808 00000004:00080000:2.0:1746129827.620655:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773678805844ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621128:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3569, 88 off300720 00000004:00080000:2.0:1746129827.621132:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679284231ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621416:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3570, 88 off300808 00000004:00080000:2.0:1746129827.621420:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679572129ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621428:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3570, 88 off300896 00000004:00080000:2.0:1746129827.621430:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679581916ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621438:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3571, 88 off300984 00000004:00080000:2.0:1746129827.621441:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679592923ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621556:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3571, 88 off300896 00000004:00080000:2.0:1746129827.621560:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679712019ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621750:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3572, 88 off300984 00000004:00080000:2.0:1746129827.621754:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679906531ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621771:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3573, 88 off301072 00000004:00080000:2.0:1746129827.621774:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679925682ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621781:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3572, 88 off301072 00000004:00080000:2.0:1746129827.621783:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679935324ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621796:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3574, 88 off301160 00000004:00080000:2.0:1746129827.621798:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679950524ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621805:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3573, 88 off301160 00000004:00080000:2.0:1746129827.621808:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679960274ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621814:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3575, 88 off301248 00000004:00080000:2.0:1746129827.621816:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773679968576ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.621822:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3574, 88 off301248 00000004:00080000:2.0:1746129827.621824:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679976433ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621830:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3575, 88 off301336 00000004:00080000:2.0:1746129827.621833:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679984773ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621839:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3576, 88 off301424 00000004:00080000:2.0:1746129827.621841:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773679992779ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621860:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3577, 88 off301512 00000004:00080000:2.0:1746129827.621862:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773680014359ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.621868:0:14313:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3576, 88 off301336 00000004:00080000:2.0:1746129827.621871:0:14313:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773680022773ns, next at 716792379979ns, rc = 0 00000001:00080000:1.0:1746129827.639036:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945157 is committed 00000001:00080000:1.0:1746129827.639049:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945134 is committed 00000001:00080000:1.0:1746129827.639059:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945129 is committed 00000001:00080000:1.0:1746129827.639064:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945162 is committed 00000001:00080000:1.0:1746129827.639072:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945164 is committed 00000004:00080000:1.0:1746129827.639075:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2743 committed 00000004:00080000:1.0:1746129827.639081:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2749 committed 00000004:00080000:1.0:1746129827.639086:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2748 committed 00000004:00080000:1.0:1746129827.639088:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2747 committed 00000004:00080000:1.0:1746129827.639089:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2746 committed 00000004:00080000:1.0:1746129827.639090:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2742 committed 00000004:00080000:1.0:1746129827.639092:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2745 committed 00000004:00080000:1.0:1746129827.639094:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2741 committed 00000004:00080000:1.0:1746129827.639100:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2744 committed 00000004:00080000:1.0:1746129827.639101:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2740 committed 00000004:00080000:1.0:1746129827.639103:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2739 committed 00000004:00080000:1.0:1746129827.639105:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2738 committed 00000004:00080000:1.0:1746129827.639106:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2743 committed 00000004:00080000:1.0:1746129827.639108:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2742 committed 00000004:00080000:1.0:1746129827.639109:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2737 committed 00000004:00080000:1.0:1746129827.639111:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2736 committed 00000004:00080000:1.0:1746129827.639112:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2741 committed 00000001:00080000:1.0:1746129827.639143:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945163 is committed 00000100:00100000:0.0:1746129827.639441:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054106624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639492:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639514:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639526:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639540:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746129827.639550:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054106752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639562:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639570:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639580:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639591:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.639605:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639615:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129827.639619:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.639631:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639643:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054108160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.639656:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639665:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746129827.639669:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054108288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.639679:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639695:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054106880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.639700:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054106624 00000100:00100000:3.0:1746129827.639707:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054106624 00000100:00100000:0.0:1746129827.639709:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639719:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639730:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.639739:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107904:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.639743:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107136 00000100:00100000:3.0:1746129827.639745:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107136 00000100:00100000:0.0:1746129827.639750:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.639753:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054106752 00000100:00100000:3.0:1746129827.639755:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054106752 00000100:00100000:0.0:1746129827.639756:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054108416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.639760:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107264 00000100:00100000:3.0:1746129827.639762:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107264 00000100:00100000:0.0:1746129827.639767:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.639769:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107648 00000100:00100000:3.0:1746129827.639770:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107648 00000100:00100000:0.0:1746129827.639774:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746129827.639777:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.639779:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107776 00000100:00100000:3.0:1746129827.639781:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107776 00000100:00100000:3.0:1746129827.639786:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108160 00000100:00100000:3.0:1746129827.639788:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108160 00000100:00100000:0.0:1746129827.639789:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.639793:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108288 00000100:00100000:3.0:1746129827.639794:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108288 00000100:00100000:0.0:1746129827.639794:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.639799:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054106880 00000100:00100000:3.0:1746129827.639801:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054106880 00000100:00100000:0.0:1746129827.639805:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.639807:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107392 00000100:00100000:3.0:1746129827.639808:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107392 00000100:00100000:0.0:1746129827.639811:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054108032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.639813:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107904 00000100:00100000:3.0:1746129827.639815:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107904 00000100:00100000:0.0:1746129827.639820:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.639822:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108416 00000100:00100000:3.0:1746129827.639824:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108416 00000100:00100000:0.0:1746129827.639825:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054108544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.639829:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107008 00000100:00100000:3.0:1746129827.639830:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107008 00000100:00100000:0.0:1746129827.639835:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.639836:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054107520 00000100:00100000:3.0:1746129827.639837:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054107520 00000100:00100000:3.0:1746129827.639843:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108032 00000100:00100000:3.0:1746129827.639844:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108032 00000100:00100000:0.0:1746129827.639867:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108544 00000100:00100000:0.0:1746129827.639870:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108544 00000100:00100000:3.0:1746129827.639871:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15932 00000100:00100000:3.0:1746129827.639877:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054106624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639884:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15933 00000100:00100000:0.0:1746129827.639889:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054107136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.639920:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15934 00000100:00100000:0.0:1746129827.639924:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054106752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.639984:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15935 00000100:00100000:3.0:1746129827.639990:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054107264:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1746129827.640011:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746129827.640014:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746129827.640022:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15936 00000100:00100000:3.0:1746129827.640027:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054107648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.640049:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054106752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (485us total) trans 17179874202 rc 0/0 00000100:00100000:0.0:1746129827.640055:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15934 00000100:00100000:0.0:1746129827.640073:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15937 00000100:00100000:0.0:1746129827.640077:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054107776:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.640126:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054107648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (520us total) trans 21474841397 rc 0/0 00000100:00100000:3.0:1746129827.640132:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15936 00000100:00100000:3.0:1746129827.640142:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15938 00000100:00100000:3.0:1746129827.640146:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054108160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.640157:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054107776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (524us total) trans 21474841398 rc 0/0 00000100:00100000:0.0:1746129827.640162:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15937 00000100:00100000:0.0:1746129827.640171:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15939 00000100:00100000:0.0:1746129827.640175:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054108288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.640212:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054108160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (555us total) trans 21474841399 rc 0/0 00000100:00100000:3.0:1746129827.640217:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15938 00000100:00100000:3.0:1746129827.640227:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15940 00000100:00100000:3.0:1746129827.640231:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054106880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.640240:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3298:x1830949054108288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (560us total) trans 21474841400 rc 0/0 00000100:00100000:0.0:1746129827.640245:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15939 00000100:00100000:0.0:1746129827.640254:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15941 00000100:00100000:0.0:1746129827.640258:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054107392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.640302:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054106880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (592us total) trans 17179874203 rc 0/0 00000100:00100000:3.0:1746129827.640307:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15940 00000100:00100000:3.0:1746129827.640316:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15942 00000100:00100000:3.0:1746129827.640320:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054107904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.640342:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054107392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (609us total) trans 17179874204 rc 0/0 00000100:00100000:0.0:1746129827.640346:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15941 00000100:00100000:0.0:1746129827.640355:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15943 00000100:00100000:0.0:1746129827.640359:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054108416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.640388:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054107904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (636us total) trans 21474841401 rc 0/0 00000100:00100000:3.0:1746129827.640393:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15942 00000100:00100000:3.0:1746129827.640402:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15944 00000100:00100000:3.0:1746129827.640406:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054107008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746129827.640417:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746129827.640420:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129827.640422:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129827.640424:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746129827.640426:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129827.640443:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054108416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (675us total) trans 21474841402 rc 0/0 00000100:00100000:0.0:1746129827.640448:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15943 00000100:00100000:0.0:1746129827.640457:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15945 00000100:00100000:0.0:1746129827.640461:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054107520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.640475:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054107008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (685us total) trans 17179874205 rc 0/0 00000100:00100000:3.0:1746129827.640480:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15944 00000100:00100000:3.0:1746129827.640489:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15946 00000100:00100000:3.0:1746129827.640493:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054108032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.640538:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054107520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (731us total) trans 17179874206 rc 0/0 00000100:00100000:0.0:1746129827.640543:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15945 00000100:00100000:0.0:1746129827.640553:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15947 00000100:00100000:3.0:1746129827.640559:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054108032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (737us total) trans 21474841403 rc 0/0 00000100:00100000:0.0:1746129827.640559:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054108544:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.640565:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15946 00000100:00100000:0.0:1746129827.640624:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3296:x1830949054108544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (788us total) trans 21474841404 rc 0/0 00000100:00100000:0.0:1746129827.640629:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15947 00000100:00100000:3.0:1746129827.640644:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054107264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 655us (1063us total) trans 17179874207 rc 0/0 00000100:00100000:3.0:1746129827.640649:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15935 00000004:00010000:0.0:1746129827.640660:0:14313:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f939880 reply state ffff88008f86d400 transno 8589945164 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14313 initiator: MDT0 00000100:00100000:0.0:1746129827.640667:0:14313:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129827.640717:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054107136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 828us (1190us total) trans 17179874208 rc 0/0 00010000:00080000:0.0:1746129827.640721:0:14313:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746129827.640722:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15933 00000100:00100000:0.0:1746129827.640731:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31820:x1830949054569216:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 31005us (31177us total) trans 8589945164 rc 0/0 00000100:00100000:0.0:1746129827.640736:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11132 00000100:00100000:3.0:1746129827.640746:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874190 gen 2 00000004:00080000:3.0:1746129827.640750:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1aa00, transno 17179874145 00000004:00080000:3.0:1746129827.640756:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18700, transno 17179874146 00000004:00080000:3.0:1746129827.640758:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1bb80, transno 17179874147 00000004:00080000:3.0:1746129827.640762:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18e00, transno 17179874148 00000004:00080000:3.0:1746129827.640764:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19c00, transno 17179874149 00000004:00080000:3.0:1746129827.640767:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19180, transno 17179874150 00000004:00080000:3.0:1746129827.640769:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b100, transno 17179874151 00000004:00080000:3.0:1746129827.640771:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1a300, transno 17179874152 00000004:00080000:3.0:1746129827.640773:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19500, transno 17179874156 00000004:00080000:3.0:1746129827.640775:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b480, transno 17179874157 00000004:00080000:3.0:1746129827.640777:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18380, transno 17179874158 00000004:00080000:3.0:1746129827.640779:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19f80, transno 17179874159 00000004:00080000:3.0:1746129827.640782:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba19880, transno 17179874160 00000004:00080000:3.0:1746129827.640784:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1b800, transno 17179874161 00000004:00080000:3.0:1746129827.640786:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18a80, transno 17179874162 00000004:00080000:3.0:1746129827.640788:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba1ad80, transno 17179874163 00000004:00080000:3.0:1746129827.640790:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85180, transno 17179874164 00000004:00080000:3.0:1746129827.640792:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85500, transno 17179874165 00000004:00080000:3.0:1746129827.640794:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba18000, transno 17179874166 00000004:00080000:3.0:1746129827.640796:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85880, transno 17179874167 00000004:00080000:3.0:1746129827.640798:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84700, transno 17179874168 00000004:00080000:3.0:1746129827.640800:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84000, transno 17179874169 00000004:00080000:3.0:1746129827.640802:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87480, transno 17179874170 00000004:00080000:3.0:1746129827.640803:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba84380, transno 17179874171 00000004:00080000:3.0:1746129827.640805:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86300, transno 17179874175 00000004:00080000:3.0:1746129827.640807:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284ce00, transno 17179874176 00000004:00080000:3.0:1746129827.640809:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85f80, transno 17179874177 00000004:00080000:3.0:1746129827.640811:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87b80, transno 17179874178 00000004:00080000:3.0:1746129827.640813:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba87100, transno 17179874179 00000004:00080000:3.0:1746129827.640815:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009284d180, transno 17179874180 00000004:00080000:3.0:1746129827.640816:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba85c00, transno 17179874181 00000004:00080000:3.0:1746129827.640818:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ba86680, transno 17179874182 00000004:00080000:3.0:1746129827.640820:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5180, transno 17179874183 00000004:00080000:3.0:1746129827.640822:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7100, transno 17179874184 00000004:00080000:3.0:1746129827.640823:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6680, transno 17179874185 00000004:00080000:3.0:1746129827.640825:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c4380, transno 17179874186 00000004:00080000:3.0:1746129827.640827:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5880, transno 17179874187 00000004:00080000:3.0:1746129827.640828:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c4700, transno 17179874188 00000004:00080000:3.0:1746129827.640830:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7b80, transno 17179874189 00000004:00080000:3.0:1746129827.640831:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5500, transno 17179874190 00000100:00100000:3.0:1746129827.640836:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f93a300 x1830949054107008/t17179874205(17179874205) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129843 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:3.0:1746129827.640844:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93a300/2, rc 0, transno 17179874205 00000100:00100000:0.0:1746129827.640862:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841377 gen 2 00000100:00100000:3.0:1746129827.640866:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129827.640866:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f90bb80, transno 21474841337 00000004:00080000:0.0:1746129827.640871:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f908380, transno 21474841338 00000004:00080000:0.0:1746129827.640873:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f909880, transno 21474841339 00000004:00080000:3.0:1746129827.640875:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93b100/2, rc 0, transno 17179874206 00000004:00080000:0.0:1746129827.640875:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f90b800, transno 21474841340 00000100:00100000:3.0:1746129827.640877:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129827.640878:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f909f80, transno 21474841341 00000004:00080000:0.0:1746129827.640879:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f908000, transno 21474841342 00000004:00080000:0.0:1746129827.640881:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f908700, transno 21474841343 00000004:00080000:0.0:1746129827.640882:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f909180, transno 21474841344 00000004:00080000:0.0:1746129827.640884:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a5491500, transno 21474841345 00000004:00080000:0.0:1746129827.640886:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009328a300, transno 21474841349 00000004:00080000:0.0:1746129827.640887:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5f80, transno 21474841350 00000004:00080000:0.0:1746129827.640889:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4380, transno 21474841351 00000004:00080000:0.0:1746129827.640891:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb7480, transno 21474841352 00010000:00010000:1.0:1746129827.640967:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.640974:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.640980:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.640984:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa00e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129827.640987:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.640993:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.641013:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129827.641016:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129827.641019:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00010000:00010000:1.0:1746129827.641023:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00e00/0x48868a4e4395646b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14313 initiator: MDT0 00000004:00080000:0.0:1746129827.641262:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5180, transno 21474841353 00000004:00080000:0.0:1746129827.641265:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4000, transno 21474841354 00000004:00080000:0.0:1746129827.641267:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5c00, transno 21474841355 00000004:00080000:0.0:1746129827.641269:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6d80, transno 21474841356 00000004:00080000:0.0:1746129827.641271:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb5880, transno 21474841357 00000004:00080000:0.0:1746129827.641273:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bce00, transno 21474841358 00000004:00080000:0.0:1746129827.641274:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bdc00, transno 21474841359 00000004:00080000:0.0:1746129827.641276:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bf480, transno 21474841360 00000004:00080000:0.0:1746129827.641278:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38000, transno 21474841361 00000004:00080000:0.0:1746129827.641279:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bdf80, transno 21474841362 00000004:00080000:0.0:1746129827.641281:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bca80, transno 21474841363 00000004:00080000:0.0:1746129827.641283:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bf100, transno 21474841364 00000004:00080000:0.0:1746129827.641284:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b100, transno 21474841365 00000004:00080000:0.0:1746129827.641286:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3b800, transno 21474841366 00000004:00080000:0.0:1746129827.641287:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936de300, transno 21474841369 00000004:00080000:0.0:1746129827.641289:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39500, transno 21474841370 00000004:00080000:0.0:1746129827.641291:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dca80, transno 21474841371 00000004:00080000:0.0:1746129827.641293:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936dea00, transno 21474841372 00000004:00080000:0.0:1746129827.641294:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012d634000, transno 21474841373 00000004:00080000:0.0:1746129827.641296:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936df800, transno 21474841374 00000004:00080000:0.0:1746129827.641297:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39c00, transno 21474841375 00000004:00080000:0.0:1746129827.641299:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936ddc00, transno 21474841376 00000004:00080000:0.0:1746129827.641301:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bd180, transno 21474841377 00000100:00100000:0.0:1746129827.641305:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880092ad8700 x1830949054081792/t21474841378(21474841378) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129841 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746129827.641312:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6a00/2, rc 0, transno 21474841400 00000004:00080000:3.0:1746129827.641315:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6300/2, rc 0, transno 21474841403 00000100:00100000:0.0:1746129827.641315:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054108288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.641320:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054108032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.641325:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4a80/2, rc 0, transno 21474841399 00000100:00100000:0.0:1746129827.641328:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054108160:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129827.641331:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c678000/2, rc 0, transno 21474841404 00000004:00080000:0.0:1746129827.641333:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4e00/2, rc 0, transno 21474841398 00000100:00100000:3.0:1746129827.641334:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c678000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054108544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.641336:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107776:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129827.641339:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f939c00/2, rc 0, transno 17179874203 00000004:00080000:0.0:1746129827.641341:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb7b80/2, rc 0, transno 21474841397 00000100:00100000:3.0:1746129827.641342:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054106880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.641343:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107648:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129827.642028:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93b480/2, rc 0, transno 17179874204 00000100:00100000:3.0:1746129827.642032:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129827.642142:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 40 done 00000004:00080000:0.0:1746129827.642263:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93bb80/2, rc 0, transno 17179874202 00000004:00080000:3.0:1746129827.642267:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb4700/2, rc 0, transno 21474841401 00000100:00100000:0.0:1746129827.642267:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054106752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.642270:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054107904:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.642273:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93ad80/2, rc 0, transno 17179874207 00000100:00100000:0.0:1746129827.642275:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129827.642277:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094eb6680/2, rc 0, transno 21474841402 00000100:00100000:3.0:1746129827.642280:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094eb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054108416:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.642282:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93aa00/2, rc 0, transno 17179874208 00000100:00100000:0.0:1746129827.642284:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054107136:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129827.642452:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 17 in progress, 0 in flight, 36 done 00000100:00100000:0.0:1746129827.643026:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746129827.643036:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a022b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054108672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.643068:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.643131:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054106624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3254us (3638us total) trans 17179874209 rc 0/0 00000100:00100000:3.0:1746129827.643138:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15932 00000004:00080000:1.0:1746129827.643253:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93b800/2, rc 0, transno 17179874209 00000100:00100000:1.0:1746129827.643258:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054106624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129827.643332:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108672 00000100:00100000:2.0:1746129827.643337:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108672 00000100:00100000:2.0:1746129827.643359:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15948 00000100:00100000:2.0:1746129827.643364:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054108672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129827.643473:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3299:x1830949054108672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (405us total) trans 21474841405 rc 0/0 00000100:00100000:2.0:1746129827.643478:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15948 00000004:00080000:0.0:1746129827.643484:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a022b100/2, rc 0, transno 21474841405 00000100:00100000:0.0:1746129827.643487:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a022b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054108672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.644089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.644148:0:14313:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570752 00000100:00100000:2.0:1746129827.644151:0:14313:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570752 00000100:00100000:2.0:1746129827.644181:0:14313:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11133 00000100:00100000:2.0:1746129827.644186:0:14313:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31820:x1830949054570752:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.644200:0:14313:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.644214:0:14313:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ae2 expref: -99 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.644253:0:14313:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.644264:0:14313:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 8 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.644279:0:14313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.644281:0:14313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129827.644283:0:14313:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00000, rc 0) 00000100:00100000:2.0:1746129827.644309:0:14313:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31820:x1830949054570752:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 122us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.644314:0:14313:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11133 00000100:00100000:0.0:1746129827.646125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.646413:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054570880 00000100:00100000:3.0:1746129827.646426:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054570880 00000100:00100000:3.0:1746129827.646462:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11134 00000100:00100000:3.0:1746129827.646468:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31820:x1830949054570880:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129827.646479:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.646492:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c800/0x48868a4e43956479 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ae9 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.646548:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43956480 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.646558:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43956480 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.646565:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43956480 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129827.646584:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129827.646588:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129827.646597:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43956480 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.646617:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74c800/0x48868a4e43956479 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae9 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.646629:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43956480 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae9 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.646635:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.646637:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129827.646639:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b74ca00, rc 0) 00000100:00100000:3.0:1746129827.646674:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31820:x1830949054570880:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 206us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.646678:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11134 00000100:00100000:0.0:1746129827.649393:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.649616:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571008 00000100:00100000:2.0:1746129827.649623:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571008 00000100:00100000:2.0:1746129827.649663:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15949 00000100:00100000:2.0:1746129827.649669:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+5:1962:x1830949054571008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129827.649683:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.649696:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356af0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129827.649715:0:1140:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d3a3, atime: 0x6813d3a3, ctime: 0x6813d3a3, blocks: 0x7e9 00010000:00010000:2.0:1746129827.649730:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.649731:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.649738:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 6 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.649750:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 6 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.649759:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01a00, rc 0) 00000100:00100000:2.0:1746129827.649787:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:1962:x1830949054571008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.649796:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15949 00000100:00100000:0.0:1746129827.649934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.649989:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.650017:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.650028:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.650045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.650058:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571264 00000100:00100000:0.0:1746129827.650060:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571264 00000100:00100000:0.0:1746129827.650073:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571520 00000100:00100000:0.0:1746129827.650074:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571520 00000100:00100000:0.0:1746129827.650081:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571136 00000100:00100000:0.0:1746129827.650082:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571136 00000100:00100000:0.0:1746129827.650088:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571392 00000100:00100000:0.0:1746129827.650089:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571392 00000100:00100000:0.0:1746129827.650096:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571648 00000100:00100000:0.0:1746129827.650097:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571648 00000100:00100000:0.0:1746129827.650105:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15950 00000100:00100000:0.0:1746129827.650109:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054571264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129827.650116:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.650125:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356afe expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129827.650138:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d3a3, atime: 0x6813d3a3, ctime: 0x6813d3a3, blocks: 0x81f 00010000:00010000:0.0:1746129827.650144:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650146:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650150:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650163:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650170:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130a39c00, rc 0) 00000100:00100000:0.0:1746129827.650184:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054571264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 74us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.650188:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15950 00000100:00100000:0.0:1746129827.650196:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15951 00000100:00100000:0.0:1746129827.650200:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054571520:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129827.650204:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.650210:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b0c expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129827.650219:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d3a4, atime: 0x6813d3a4, ctime: 0x6813d3a4, blocks: 0x15e9 00010000:00010000:0.0:1746129827.650225:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650226:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650229:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650237:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650243:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c15800, rc 0) 00000100:00100000:0.0:1746129827.650257:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054571520:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.650264:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15951 00000100:00100000:0.0:1746129827.650273:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15952 00000100:00100000:0.0:1746129827.650277:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054571136:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129827.650282:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.650288:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356af7 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129827.650297:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d3a4, atime: 0x6813d3a3, ctime: 0x6813d3a4, blocks: 0x821 00010000:00010000:0.0:1746129827.650303:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650304:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650307:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650315:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650321:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c15e00, rc 0) 00000100:00100000:0.0:1746129827.650332:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054571136:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.650337:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15952 00000100:00100000:0.0:1746129827.650344:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15953 00000100:00100000:0.0:1746129827.650347:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054571392:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129827.650351:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.650356:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b05 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129827.650369:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d3a4, atime: 0x6813d3a2, ctime: 0x6813d3a3, blocks: 0x821 00010000:00010000:0.0:1746129827.650374:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650375:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650378:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650385:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650390:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c15200, rc 0) 00000100:00100000:0.0:1746129827.650399:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054571392:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 51us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.650403:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15953 00000100:00100000:0.0:1746129827.650408:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15954 00000100:00100000:0.0:1746129827.650412:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1961:x1830949054571648:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129827.650416:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.650420:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b13 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129827.650428:0:20441:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d3a3, atime: 0x6813d3a3, ctime: 0x6813d3a3, blocks: 0x1029 00010000:00010000:0.0:1746129827.650432:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650433:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.650436:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650448:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 8 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129827.650453:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c15c00, rc 0) 00000100:00100000:0.0:1746129827.650462:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054571648:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.650466:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15954 00000100:00100000:2.0:1746129827.656911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.656967:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054571904 00000100:00100000:3.0:1746129827.656977:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054571904 00000100:00100000:0.0:1746129827.657030:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.657077:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054572160 00000100:00100000:3.0:1746129827.657079:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054572160 00000100:00100000:1.0:1746129827.657097:0:25617:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7195 00000100:00100000:3.0:1746129827.657103:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7196 00000100:00100000:1.0:1746129827.657106:0:25617:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054571904:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:3.0:1746129827.657108:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054572160:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129827.657132:0:2677:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.657132:0:25617:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.657143:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.657143:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.657144:0:2677:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.657144:0:25617:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.657148:0:2677:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.657148:0:25617:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.657159:0:2677:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.657159:0:25617:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.664113:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.664152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.664307:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054572544 00000100:00100000:2.0:1746129827.664314:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054572544 00000100:00100000:0.0:1746129827.664324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.664468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.664953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.665195:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054572672 00000100:00100000:3.0:1746129827.665196:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054573056 00000100:00100000:2.0:1746129827.665199:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054572672 00000100:00100000:3.0:1746129827.665201:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054573056 00000100:00100000:2.0:1746129827.665218:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054572928 00000100:00100000:2.0:1746129827.665220:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054572928 00000100:00100000:3.0:1746129827.665232:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7197 00000100:00100000:2.0:1746129827.665239:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7198 00000100:00100000:3.0:1746129827.665241:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054572544:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:2.0:1746129827.665244:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054572672:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:2.0:1746129827.665257:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7199 00000100:00100000:2.0:1746129827.665261:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054573056:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129827.665278:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.665278:0:21605:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.665290:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.665290:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.665291:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.665292:0:21605:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.665296:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.665296:0:21605:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.665306:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.665306:0:21605:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.665400:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7200 00000100:00100000:3.0:1746129827.665406:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054572928:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129827.665420:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.665427:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.665428:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.665430:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.665436:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.665816:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.665823:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.665824:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.665827:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.665834:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.668155:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054573440 00000100:00100000:1.0:1746129827.668164:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054573440 00000100:00100000:1.0:1746129827.668208:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7201 00000100:00100000:1.0:1746129827.668214:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054573440:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:1.0:1746129827.668236:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.668247:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.668249:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.668252:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.668266:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.670183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.670213:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054573696 00000100:00100000:2.0:1746129827.670220:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054573696 00000100:00100000:2.0:1746129827.670262:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7202 00000100:00100000:2.0:1746129827.670270:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054573696:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129827.670296:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.670309:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.670310:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.670315:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.670326:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673924:0:25617:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673937:0:25617:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673944:0:25617:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673950:0:25617:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091f32800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129827.673953:0:25617:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673960:0:25617:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673976:0:25617:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.673981:0:25617:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f32800/0x48868a4e439564b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25617 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.674052:0:25617:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054571904:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 16943us (17203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.674064:0:25617:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7195 00010000:00010000:3.0:1746129827.674469:0:2677:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.674477:0:2677:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.674483:0:2677:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.674488:0:2677:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093591a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.674490:0:2677:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.674496:0:2677:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.674504:0:2677:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.674513:0:2677:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093591a00/0x48868a4e439564b8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2677 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.674547:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1962:x1830949054572160:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 17439us (17518us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.674552:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7196 00010000:00010000:3.0:1746129827.684090:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.684105:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.684112:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.684118:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.684122:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.684129:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.684145:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.684151:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fb5a00/0x48868a4e439564cd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.686145:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054572928:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 20725us (21662us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.686158:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7200 00010000:00010000:3.0:1746129827.686872:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.686885:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.686894:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.686901:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5200 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.686905:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.686912:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.686927:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.686932:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094fb5200/0x48868a4e439564c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.687010:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054572544:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 21758us (23079us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.687018:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7197 00010000:00010000:3.0:1746129827.695250:0:21605:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.695264:0:21605:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.695270:0:21605:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.695276:0:21605:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa01c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.695279:0:21605:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.695286:0:21605:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.695301:0:21605:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.695307:0:21605:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01c00/0x48868a4e439564bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21605 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.695368:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054573056:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 30102us (31040us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.695378:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7199 00010000:00010000:0.0:1746129827.696155:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.696164:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.696170:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.696387:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095350800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129827.696390:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.696401:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.696412:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.696418:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095350800/0x48868a4e439564db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.698873:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054573440:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 30633us (33899us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.698885:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7201 00010000:00010000:3.0:1746129827.699284:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.699295:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.699302:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.699307:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa00e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129827.699311:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.699318:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.699332:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.699337:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa00e00/0x48868a4e439564d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.699389:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054572672:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 34143us (35235us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.699395:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7198 00010000:00010000:2.0:1746129827.702004:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.702017:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.702025:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.702035:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095230a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129827.702038:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.702044:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.702058:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.702064:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095230a00/0x48868a4e439564e2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.702129:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054573696:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 31857us (31956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.702136:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7202 00000100:00100000:0.0:1746129827.705399:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.705579:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054573952 00000100:00100000:3.0:1746129827.705586:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054573952 00000100:00100000:3.0:1746129827.705691:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11135 00000100:00100000:3.0:1746129827.705700:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31820:x1830949054573952:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:3.0:1746129827.705740:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.705760:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b74ca00/0x48868a4e43956480 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae9 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.705772:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.705776:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129827.705805:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.705814:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.705821:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00010000:3.0:1746129827.706098:0:1851:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800936dea00 reply state ffff88009c17a000 transno 8589945165 ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129827.706104:0:1851:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746129827.706169:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31820:x1830949054573952:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 470us (777us total) trans 8589945165 rc 0/0 00000100:00100000:3.0:1746129827.706175:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11135 00000100:00100000:0.0:1746129827.708644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129827.708706:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129827.708715:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129827.708721:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129827.708725:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb4e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129827.708729:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129827.708738:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129827.708750:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:2.0:1746129827.708753:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129827.708756:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129827.708760:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4e00/0x48868a4e439564e9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129827.708814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.708828:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.708840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.708936:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574080 00000100:00100000:3.0:1746129827.708943:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574080 00000100:00100000:0.0:1746129827.709541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.709665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.709682:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574208 00000100:00100000:3.0:1746129827.709685:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574208 00000100:00100000:3.0:1746129827.709704:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574336 00000100:00100000:3.0:1746129827.709706:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574336 00000100:00100000:3.0:1746129827.709716:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574464 00000100:00100000:3.0:1746129827.709717:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574464 00000100:00100000:3.0:1746129827.709733:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574592 00000100:00100000:3.0:1746129827.709735:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574592 00000100:00100000:3.0:1746129827.709749:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15955 00000100:00100000:3.0:1746129827.709755:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054574080:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129827.709922:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129827.709925:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.709927:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.709929:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.709931:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746129827.709969:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054574080:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 214us (1330us total) trans 21474841406 rc 0/0 00000100:00100000:3.0:1746129827.709975:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15955 00000100:00100000:3.0:1746129827.709990:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15956 00000100:00100000:3.0:1746129827.710007:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054574208:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129827.710087:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129827.710090:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.710092:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.710093:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.710094:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129827.710110:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054574208:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 114us (1295us total) trans 17179874210 rc 0/0 00000100:00100000:3.0:1746129827.710115:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15956 00000100:00100000:3.0:1746129827.710124:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15957 00000100:00100000:3.0:1746129827.710129:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1964:x1830949054574336:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129827.710181:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129827.710183:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.710185:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.710186:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.710188:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129827.710202:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054574336:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 73us (1373us total) trans 17179874211 rc 0/0 00000100:00100000:3.0:1746129827.710207:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15957 00000100:00100000:3.0:1746129827.710217:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15958 00000100:00100000:3.0:1746129827.710222:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054574464:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129827.710274:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129827.710276:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.710278:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129826 -> 1746129828 00002000:00010000:3.0:1746129827.710280:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129827 -> 1746129828 00002000:00010000:3.0:1746129827.710281:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129827.710295:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054574464:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 74us (1455us total) trans 21474841407 rc 0/0 00000100:00100000:3.0:1746129827.710300:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15958 00000100:00100000:3.0:1746129827.710310:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15959 00000100:00100000:3.0:1746129827.710315:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054574592:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129827.710364:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:3.0:1746129827.710366:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.710368:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.710369:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.710371:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:3.0:1746129827.710387:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054574592:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 72us (846us total) trans 21474841408 rc 0/0 00000100:00100000:3.0:1746129827.710392:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15959 00000100:00100000:0.0:1746129827.710586:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574720 00000100:00100000:0.0:1746129827.710589:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574720 00000100:00100000:0.0:1746129827.710605:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15960 00000100:00100000:0.0:1746129827.710609:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054574720:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:0.0:1746129827.710672:0:7976:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746129827.710674:0:7976:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129827 -> 1746129828 00002000:00010000:0.0:1746129827.710676:0:7976:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129827 -> 1746129828 00002000:00010000:0.0:1746129827.710677:0:7976:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129827 -> 1746129828 00002000:00010000:0.0:1746129827.710679:0:7976:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746129827.710694:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054574720:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 85us (1030us total) trans 17179874212 rc 0/0 00000100:00100000:0.0:1746129827.710699:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15960 00000100:00100000:0.0:1746129827.713189:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.713420:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054574976 00000100:00100000:2.0:1746129827.713429:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054574976 00000100:00100000:2.0:1746129827.713536:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4679 00000100:00100000:2.0:1746129827.713544:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31820:x1830949054574976:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:2.0:1746129827.713594:0:14316:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43956433 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356adb expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.713630:0:14316:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129827.713640:0:14316:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.713645:0:14316:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129827.713667:0:14316:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 9 pid: 14313 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.713677:0:14316:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 9 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.713688:0:14316:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949054108800:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.714714:0:14316:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bd1d540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.715760:0:14316:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949054108800:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.715778:0:14316:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:0.0:1746129827.718551:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.718635:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054575104 00000100:00100000:3.0:1746129827.718643:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054575104 00010000:00010000:3.0:1746129827.718676:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 10 pid: 14313 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.718712:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8001 00000100:00100000:3.0:1746129827.718720:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054575104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.718732:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.718737:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 10 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.718745:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 10 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.718761:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa00000/0x48868a4e43956472 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ae2 expref: 10 pid: 14313 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.718776:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.718780:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129827.718787:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129827.718792:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129827.718809:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.718874:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054575104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 154us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.718880:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8001 00010000:00010000:2.0:1746129827.718992:0:14316:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129827.719011:0:14316:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000040:00080000:2.0:1746129827.720677:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3578, 88 off301600 00000004:00080000:2.0:1746129827.720685:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773778836159ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.720732:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3577, 88 off301424 00000004:00080000:2.0:1746129827.720736:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773778887984ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721699:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3578, 88 off301512 00000004:00080000:2.0:1746129827.721704:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773779855658ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721717:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3579, 88 off301688 00000004:00080000:2.0:1746129827.721720:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779872064ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721740:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3580, 88 off301776 00000004:00080000:2.0:1746129827.721743:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779895111ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721750:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3579, 88 off301600 00000004:00080000:2.0:1746129827.721752:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773779903862ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721757:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3580, 88 off301688 00000004:00080000:2.0:1746129827.721759:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773779910889ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721768:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3581, 88 off301776 00000004:00080000:2.0:1746129827.721771:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773779923226ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721777:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3581, 88 off301864 00000004:00080000:2.0:1746129827.721779:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779930968ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721784:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3582, 88 off301864 00000004:00080000:2.0:1746129827.721786:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773779938056ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721796:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3582, 88 off301952 00000004:00080000:2.0:1746129827.721798:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779950533ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721804:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3583, 88 off301952 00000004:00080000:2.0:1746129827.721806:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773779958001ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129827.721811:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3583, 88 off302040 00000004:00080000:2.0:1746129827.721817:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779969038ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721823:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3584, 88 off302128 00000004:00080000:2.0:1746129827.721825:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779977554ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721831:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3585, 88 off302216 00000004:00080000:2.0:1746129827.721833:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779985322ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721842:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3586, 88 off302304 00000004:00080000:2.0:1746129827.721844:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773779996173ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129827.721868:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3584, 88 off302040 00000004:00080000:2.0:1746129827.721872:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773780024051ns, next at 716792379979ns, rc = 0 00000001:00080000:0.0:1746129827.751206:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945166 is committed 00000004:00080000:0.0:1746129827.751215:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2751 committed 00000004:00080000:0.0:1746129827.751231:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2758 committed 00000004:00080000:0.0:1746129827.751237:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2757 committed 00000004:00080000:0.0:1746129827.751238:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2756 committed 00000004:00080000:0.0:1746129827.751239:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2755 committed 00000004:00080000:0.0:1746129827.751241:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2750 committed 00000004:00080000:0.0:1746129827.751242:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2754 committed 00000004:00080000:0.0:1746129827.751243:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2749 committed 00000004:00080000:0.0:1746129827.751245:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2753 committed 00000004:00080000:0.0:1746129827.751246:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2748 committed 00000004:00080000:0.0:1746129827.751248:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2747 committed 00000004:00080000:0.0:1746129827.751249:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2746 committed 00000004:00080000:0.0:1746129827.751250:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2752 committed 00000004:00080000:0.0:1746129827.751252:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2751 committed 00000004:00080000:0.0:1746129827.751253:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2745 committed 00000004:00080000:0.0:1746129827.751254:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2744 committed 00000004:00080000:0.0:1746129827.751256:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2750 committed 00000100:00100000:0.0:1746129827.751385:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054108928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751434:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.751468:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751483:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746129827.751487:0:14316:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801305bca80 reply state ffff88009caa4c00 transno 8589945166 ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:3.0:1746129827.751496:0:14316:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746129827.751498:0:3299:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746129827.751502:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109312:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746129827.751503:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:3.0:1746129827.751505:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129827.751512:0:14316:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094be4600/0x48868a4e43956433 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356adb expref: 7 pid: 14313 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.751512:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.751522:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.751546:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751560:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.751576:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109696:0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746129827.751581:0:14316:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746129827.751590:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.751591:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31820:x1830949054574976:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 38048us (38406us total) trans 8589945166 rc 0/0 00000100:00100000:3.0:1746129827.751599:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4679 00000100:00100000:0.0:1746129827.751600:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129827.751603:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751613:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.751621:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.751624:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054108928 00000100:00100000:3.0:1746129827.751629:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054108928 00000100:00100000:0.0:1746129827.751631:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.751645:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109440 00000100:00100000:0.0:1746129827.751647:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109440 00000100:00100000:3.0:1746129827.751651:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109312 00000100:00100000:3.0:1746129827.751652:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109312 00000100:00100000:0.0:1746129827.751657:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109824 00000100:00100000:0.0:1746129827.751659:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109824 00000100:00100000:3.0:1746129827.751661:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109184 00000100:00100000:3.0:1746129827.751662:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109184 00000100:00100000:3.0:1746129827.751667:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109056 00000100:00100000:0.0:1746129827.751667:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109696 00000100:00100000:3.0:1746129827.751668:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109056 00000100:00100000:0.0:1746129827.751668:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109696 00000100:00100000:3.0:1746129827.751673:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109568 00000100:00100000:3.0:1746129827.751675:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109568 00000100:00100000:0.0:1746129827.751677:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15961 00000100:00100000:3.0:1746129827.751682:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15962 00000100:00100000:0.0:1746129827.751682:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949054108928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.751685:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949054109440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751695:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15963 00000100:00100000:0.0:1746129827.751698:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3299:x1830949054109312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.751802:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15964 00000100:00100000:3.0:1746129827.751807:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949054109824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.751823:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949054109312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (309us total) trans 21474841409 rc 0/0 00000100:00100000:0.0:1746129827.751828:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15963 00000100:00100000:0.0:1746129827.751840:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15965 00000100:00100000:0.0:1746129827.751844:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054109184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.751901:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949054109824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (366us total) trans 21474841410 rc 0/0 00000100:00100000:3.0:1746129827.751906:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15964 00000100:00100000:3.0:1746129827.751926:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15966 00002000:00010000:0.0:1746129827.751926:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:0.0:1746129827.751929:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00000100:00100000:3.0:1746129827.751931:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054109056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129827.751931:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:0.0:1746129827.751933:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:0.0:1746129827.751935:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:0.0:1746129827.751954:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054109184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (392us total) trans 21474841411 rc 0/0 00000100:00100000:0.0:1746129827.751959:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15965 00000100:00100000:0.0:1746129827.751968:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15967 00000100:00100000:0.0:1746129827.751972:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054109696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129827.751992:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129827.752006:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.752007:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.752009:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.752011:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129827.752028:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3297:x1830949054109056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (413us total) trans 21474841412 rc 0/0 00000100:00100000:3.0:1746129827.752033:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15966 00002000:00010000:0.0:1746129827.752040:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1746129827.752042:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15968 00002000:00010000:0.0:1746129827.752042:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746129827.752044:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746129827.752045:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:3.0:1746129827.752046:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054109568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129827.752047:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1746129827.752062:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054109696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (471us total) trans 21474841413 rc 0/0 00000100:00100000:0.0:1746129827.752067:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15967 00000100:00100000:3.0:1746129827.752112:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3297:x1830949054109568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (479us total) trans 21474841414 rc 0/0 00000100:00100000:3.0:1746129827.752117:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15968 00002000:00010000:0.0:1746129827.752140:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746129827.752142:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:0.0:1746129827.752144:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:0.0:1746129827.752145:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:0.0:1746129827.752148:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746129827.752164:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054108928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 482us (731us total) trans 21474841415 rc 0/0 00000100:00100000:0.0:1746129827.752169:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15961 00000100:00100000:3.0:1746129827.752186:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949054109440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 500us (702us total) trans 21474841416 rc 0/0 00000100:00100000:3.0:1746129827.752190:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15962 00000004:00080000:0.0:1746129827.752196:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7b80/2, rc 0, transno 21474841412 00000100:00100000:0.0:1746129827.752202:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.752208:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaf480/2, rc 0, transno 21474841414 00000100:00100000:0.0:1746129827.752210:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.752215:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b8e7100/2, rc 0, transno 21474841411 00000100:00100000:0.0:1746129827.752217:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b8e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.752221:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac700/2, rc 0, transno 21474841413 00000100:00100000:0.0:1746129827.752223:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054109696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.752245:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.752260:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.752270:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054109952 00000100:00100000:3.0:1746129827.752272:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054109952 00000004:00080000:0.0:1746129827.752284:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaf800/2, rc 0, transno 21474841409 00000100:00100000:3.0:1746129827.752285:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15969 00000100:00100000:0.0:1746129827.752287:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109312:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.752289:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3299:x1830949054109952:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.752292:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adac380/2, rc 0, transno 21474841410 00000100:00100000:0.0:1746129827.752295:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.752300:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bd180/2, rc 0, transno 21474841415 00000100:00100000:0.0:1746129827.752302:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054108928:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129827.752306:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adaea00/2, rc 0, transno 21474841416 00000100:00100000:0.0:1746129827.752309:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.752362:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054109952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (100us total) trans 21474841417 rc 0/0 00000100:00100000:3.0:1746129827.752366:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15969 00000100:00100000:3.0:1746129827.752394:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110080:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.752410:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752420:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.752422:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.752433:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752440:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110080 00000100:00100000:3.0:1746129827.752442:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129827.752442:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110080 00000100:00100000:3.0:1746129827.752446:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752455:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110592 00000100:00100000:1.0:1746129827.752456:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110592 00000100:00100000:3.0:1746129827.752457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752464:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110208 00000100:00100000:3.0:1746129827.752465:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110720:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752465:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110208 00000100:00100000:1.0:1746129827.752474:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15970 00000100:00100000:3.0:1746129827.752475:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752478:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3296:x1830949054110080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.752487:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110720 00000100:00100000:3.0:1746129827.752489:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110720 00000100:00100000:3.0:1746129827.752501:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15971 00000100:00100000:3.0:1746129827.752505:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3296:x1830949054110592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129827.752562:0:10930:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129827.752565:0:10930:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.752567:0:10930:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.752568:0:10930:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.752570:0:10930:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129827.752573:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3296:x1830949054110592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (139us total) trans 17179874213 rc 0/0 00000100:00100000:3.0:1746129827.752578:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15971 00000100:00100000:1.0:1746129827.752585:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1830949054110080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (174us total) trans 17179874214 rc 0/0 00000100:00100000:3.0:1746129827.752587:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15972 00000100:00100000:1.0:1746129827.752589:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15970 00000100:00100000:3.0:1746129827.752591:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3296:x1830949054110208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752596:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15973 00000100:00100000:1.0:1746129827.752599:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3296:x1830949054110720:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129827.752623:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb0a80/2, rc 0, transno 17179874213 00000100:00100000:3.0:1746129827.752626:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129827.752632:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb2680/2, rc 0, transno 17179874214 00000100:00100000:3.0:1746129827.752635:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752673:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3296:x1830949054110720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (195us total) trans 17179874215 rc 0/0 00000100:00100000:1.0:1746129827.752679:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15973 00010000:00010000:1.0:1746129827.752697:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129827.752704:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129827.752709:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129827.752716:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095230600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129827.752719:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129827.752725:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129827.752735:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244700) 00010000:00010000:1.0:1746129827.752737:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129827.752740:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129827.752744:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095230600/0x48868a4e439564f0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00000100:00100000:1.0:1746129827.752764:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752777:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752791:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752799:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129827.752803:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752814:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752822:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.752834:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.752863:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110336 00000100:00100000:1.0:1746129827.752866:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110336 00000100:00100000:1.0:1746129827.752878:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110848 00000100:00100000:1.0:1746129827.752880:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110848 00000100:00100000:1.0:1746129827.752886:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110464 00000100:00100000:1.0:1746129827.752888:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110464 00000100:00100000:1.0:1746129827.752894:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054110976 00000100:00100000:1.0:1746129827.752896:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054110976 00000100:00100000:1.0:1746129827.752904:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15974 00000100:00100000:1.0:1746129827.752908:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949054110336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129827.752976:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129827.752978:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.752980:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.752982:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.752983:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129827.753018:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054110336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 109us (252us total) trans 17179874216 rc 0/0 00000100:00100000:1.0:1746129827.753022:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15974 00000100:00100000:1.0:1746129827.753030:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15975 00000100:00100000:1.0:1746129827.753034:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949054110848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.753100:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054110848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (307us total) trans 17179874217 rc 0/0 00000100:00100000:1.0:1746129827.753105:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15975 00000100:00100000:1.0:1746129827.753113:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15976 00000100:00100000:1.0:1746129827.753117:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949054110464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.753184:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054110464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (369us total) trans 17179874218 rc 0/0 00000100:00100000:1.0:1746129827.753189:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15976 00000100:00100000:1.0:1746129827.753197:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15977 00000100:00100000:1.0:1746129827.753201:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949054110976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.753265:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054110976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (430us total) trans 17179874219 rc 0/0 00000100:00100000:1.0:1746129827.753270:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15977 00000004:00080000:1.0:1746129827.753291:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb0380/2, rc 0, transno 17179874218 00000100:00100000:1.0:1746129827.753294:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129827.753299:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb1180/2, rc 0, transno 17179874219 00000100:00100000:1.0:1746129827.753302:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110976:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129827.753307:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb2300/2, rc 0, transno 17179874216 00000100:00100000:1.0:1746129827.753309:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110336:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129827.753314:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb1c00/2, rc 0, transno 17179874217 00000100:00100000:1.0:1746129827.753316:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054110848:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129827.753357:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb3480/2, rc 0, transno 17179874215 00000100:00100000:3.0:1746129827.753361:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110720:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129827.753371:0:20441:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129827.753373:0:20441:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.753375:0:20441:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00000004:00080000:0.0:1746129827.753935:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3480/2, rc 0, transno 21474841417 00000100:00100000:0.0:1746129827.754040:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054109952:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129827.754427:0:20441:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.754430:0:20441:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129827.754471:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054110208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1879us (2012us total) trans 17179874220 rc 0/0 00000100:00100000:1.0:1746129827.754477:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15972 00000004:00080000:3.0:1746129827.754486:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ffb1f80/2, rc 0, transno 17179874220 00000100:00100000:3.0:1746129827.754489:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054110208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.755180:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.755246:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054575232 00000100:00100000:3.0:1746129827.755251:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054575232 00000100:00100000:3.0:1746129827.755332:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11136 00000100:00100000:3.0:1746129827.755339:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31820:x1830949054575232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129827.755355:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.755369:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b1a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.755413:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.755424:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.755438:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129827.755441:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129827.755443:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb5e00, rc 0) 00000100:00100000:3.0:1746129827.755526:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31820:x1830949054575232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 187us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.755532:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11136 00000100:00100000:0.0:1746129827.757978:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.758060:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054575488 00000100:00100000:3.0:1746129827.758067:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054575488 00000100:00100000:3.0:1746129827.758101:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4680 00000100:00100000:3.0:1746129827.758108:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31820:x1830949054575488:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:3.0:1746129827.759060:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31820:x1830949054575488:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 949us (1085us total) trans 8589945167 rc 0/0 00000100:00100000:3.0:1746129827.759067:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4680 00000100:00100000:0.0:1746129827.774481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.774543:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054575744 00000100:00100000:3.0:1746129827.774552:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054575744 00000100:00100000:3.0:1746129827.774608:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11137 00000100:00100000:3.0:1746129827.774616:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31832:x1830949054575744:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.774638:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.774654:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5a00/0x48868a4e439564fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b21 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.774741:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774752:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774760:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774772:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774778:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774783:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129827.774786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129827.774909:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774916:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.774922:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129827.774930:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:1.0:1746129827.774974:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054576000 00000100:00100000:1.0:1746129827.774978:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054576000 00000100:00100000:1.0:1746129827.775010:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11138 00000100:00100000:1.0:1746129827.775015:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:31833:x1830949054576000:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.775023:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.775030:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009330ee00/0x48868a4e43956521 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b28 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.775055:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775062:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775068:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129827.775072:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129827.775073:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129827.775076:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129827.775079:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129827.775085:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129827.775085:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775091:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129827.775095:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129827.775096:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129827.775097:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129827.775100:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129827.775101:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:3.0:1746129827.775104:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5800/0x48868a4e43956505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775132:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775137:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775141:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775145:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fb5400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129827.775147:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775150:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775156:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244700) 00010000:00010000:3.0:1746129827.775158:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129827.775159:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.775163:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5400/0x48868a4e4395650c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129827.775195:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775202:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775207:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000004:00200000:1.0:1746129827.775216:0:14315:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129827.775252:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775258:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775262:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775266:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009330f000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129827.775268:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775273:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775279:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129827.775281:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129827.775283:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775287:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330f000/0x48868a4e43956528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775298:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775302:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775306:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775313:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009330fe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129827.775315:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775319:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775325:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244700) 00010000:00010000:1.0:1746129827.775327:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129827.775329:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775332:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330fe00/0x48868a4e4395652f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:1.0:1746129827.775362:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009330ee00/0x48868a4e43956521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.775371:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 8 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.775376:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129827.775378:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129827.775380:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f859800, rc 0) 00000100:00100000:1.0:1746129827.775416:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31833:x1830949054576000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 401us (630us total) trans 8589945169 rc 0/0 00000100:00100000:1.0:1746129827.775422:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11138 00010000:00010000:3.0:1746129827.775622:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5a00/0x48868a4e439564fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.775632:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.775766:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129827.775769:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129827.775771:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4600, rc 0) 00000100:00100000:3.0:1746129827.776593:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31832:x1830949054575744:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1976us (2116us total) trans 8589945168 rc 0/0 00000100:00100000:3.0:1746129827.776600:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11137 00000100:00100000:0.0:1746129827.778399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.778554:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054576128 00000100:00100000:1.0:1746129827.778561:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054576128 00000100:00100000:0.0:1746129827.778917:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.778986:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15978 00000100:00100000:0.0:1746129827.779016:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054576384 00000100:00100000:0.0:1746129827.779019:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054576384 00000100:00100000:0.0:1746129827.779040:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11139 00000100:00100000:0.0:1746129827.779046:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:31828:x1830949054576384:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129827.779064:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.779079:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fe00/0x48868a4e43956544 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b36 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779152:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129827.779163:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 282 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779170:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779175:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129827.779199:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 9 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779210:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 9 pid: 14315 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.779219:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111104:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129827.779306:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 282 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779314:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 282 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746129827.779321:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8790000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111232:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.779342:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.779355:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31833:x1830949054576128:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129827.779362:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.779370:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b2f expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779383:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.779385:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.779391:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779401:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 17 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.779408:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fa00, rc 0) 00000100:00100000:0.0:1746129827.779426:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31833:x1830949054576128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 433us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.779430:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15978 00000100:00100000:0.0:1746129827.779751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.779784:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054576512 00000100:00100000:2.0:1746129827.779788:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054576512 00000100:00100000:2.0:1746129827.779805:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15979 00000100:00100000:2.0:1746129827.779810:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31832:x1830949054576512:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.779816:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.779822:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b3d expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.779835:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.779837:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.779840:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.779869:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.779875:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095230000, rc 0) 00000100:00100000:2.0:1746129827.780276:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31832:x1830949054576512:12345-192.168.204.31@tcp:101:cat.0 Request processed in 464us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.780282:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15979 00000100:00100000:2.0:1746129827.782543:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.782887:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.782890:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054576768 00000100:00100000:3.0:1746129827.782897:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054576768 00000100:00100000:2.0:1746129827.782957:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054576896 00000100:00100000:0.0:1746129827.782957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.782960:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054576896 00010000:00010000:2.0:1746129827.782988:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 10 pid: 14315 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.783038:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054577024 00000100:00100000:2.0:1746129827.783039:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054577024 00010000:00010000:2.0:1746129827.783050:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 283 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.783062:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8002 00000100:00100000:2.0:1746129827.783068:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054576896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.783078:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.783083:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 10 pid: 14315 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.783092:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 10 pid: 14315 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.783108:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129827.783113:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.783119:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.783124:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.783167:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1963:x1830949054576896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 99us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.783173:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8002 00000100:00100000:2.0:1746129827.783184:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8003 00000100:00100000:2.0:1746129827.783188:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1963:x1830949054577024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.783193:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.783196:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 283 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.783204:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 283 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.783212:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129827.783215:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.783220:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.783227:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.783238:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.783250:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1963:x1830949054577024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.783254:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8003 00000100:00100000:3.0:1746129827.783316:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11140 00000100:00100000:3.0:1746129827.783321:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31829:x1830949054576768:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129827.783335:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.783344:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43956560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b44 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.783410:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.783417:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129827.783428:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129827.783437:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129827.783471:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f859800/0x48868a4e43956536 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b28 expref: 9 pid: 14315 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.783487:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8793480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111104:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129827.783499:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4600/0x48868a4e43956513 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b21 expref: 285 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746129827.783508:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a8790000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111232:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.783524:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4c00/0x48868a4e43956560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.783524:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129827.783534:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 284 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.783535:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129827.783539:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129827.783540:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129827.783543:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1f 00010000:00010000:3.0:1746129827.783545:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fb4800, rc 0) 00000004:00200000:1.0:1746129827.783548:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:3.0:1746129827.783576:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31829:x1830949054576768:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 255us (1038us total) trans 8589945170 rc 0/0 00000100:00100000:3.0:1746129827.783581:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11140 00010000:00010000:1.0:1746129827.783600:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27fe00/0x48868a4e43956544 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 10 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.783619:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.783625:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129827.783627:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129827.783628:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8fa800, rc 0) 00000100:00100000:1.0:1746129827.783646:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31828:x1830949054576384:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4601us (4729us total) trans 8589945171 rc 0/0 00000100:00100000:1.0:1746129827.783653:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11139 00000100:00100000:0.0:1746129827.784450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.784599:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054577152 00000100:00100000:1.0:1746129827.784603:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054577152 00000100:00100000:1.0:1746129827.784639:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11141 00000100:00100000:1.0:1746129827.784644:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31833:x1830949054577152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.784652:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.784660:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e4395657c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b4b expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.784689:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e4395657c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b4b expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.784699:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e4395657c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b4b expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.784712:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129827.784714:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129827.784716:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27f000, rc 0) 00000100:00100000:1.0:1746129827.784738:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31833:x1830949054577152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 94us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.784743:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11141 00000100:00100000:3.0:1746129827.789039:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.789087:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054577408 00000100:00100000:2.0:1746129827.789095:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054577408 00002000:00100000:2.0:1746129827.789131:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c678a80 x1830949054577408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.789141:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678a80 with x1830949054577408 ext(0->1048575) 00002000:00010000:2.0:1746129827.789145:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c678a80 00000100:00100000:2.0:1746129827.789163:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7203 00000100:00100000:2.0:1746129827.789170:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054577408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.793799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.793872:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054577664 00000100:00100000:3.0:1746129827.793879:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054577664 00002000:00100000:3.0:1746129827.793921:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009206e680 x1830949054577664/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.793930:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e680 with x1830949054577664 ext(0->1048575) 00002000:00010000:3.0:1746129827.793934:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206e680 00000100:00100000:3.0:1746129827.793961:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7204 00000100:00100000:3.0:1746129827.793968:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054577664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129827.798336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.800452:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054577920 00000100:00100000:2.0:1746129827.800462:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054577920 00000100:00100000:2.0:1746129827.800508:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11142 00000100:00100000:2.0:1746129827.800514:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31828:x1830949054577920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129827.800532:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.800535:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746129827.800556:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27f000/0x48868a4e4395657c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b4b expref: 10 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.800585:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129827.800589:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129827.800597:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095230a00/0x48868a4e43956583 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b52 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.800637:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.800646:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.800652:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.800657:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 5/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.800678:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 283 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.800687:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 283 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.800695:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111360:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.800779:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.800787:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 7 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.800794:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111488:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.800810:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.804445:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054577408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15266us (15854us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.804457:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7203 00002000:00100000:2.0:1746129827.804468:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009c678a80 x1830949054577408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.804476:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678a80 with x1830949054577408 ext(0->1048575) 00002000:00010000:2.0:1746129827.804481:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c678a80 00000100:00100000:3.0:1746129827.805078:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054577664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11109us (11285us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.805084:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7204 00002000:00100000:3.0:1746129827.805089:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88009206e680 x1830949054577664/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.805096:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009206e680 with x1830949054577664 ext(0->1048575) 00002000:00010000:3.0:1746129827.805100:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009206e680 00000100:00100000:3.0:1746129827.805133:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111360:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.805142:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111488:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.805159:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129827.805317:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.805351:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.805382:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578048 00000100:00100000:3.0:1746129827.805387:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578048 00010000:00010000:3.0:1746129827.805409:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 284 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.805412:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578176 00000100:00100000:2.0:1746129827.805415:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578176 00000100:00100000:3.0:1746129827.805427:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8004 00010000:00010000:2.0:1746129827.805428:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 8 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746129827.805432:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1962:x1830949054578048:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.805440:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.805444:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 284 pid: 1851 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746129827.805444:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8005 00000100:00100000:2.0:1746129827.805448:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054578176:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.805452:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 284 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.805454:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.805457:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 8 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746129827.805468:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb4800/0x48868a4e43956567 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x1f/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b44 expref: 284 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.805471:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 8 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.805481:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094fb5e00/0x48868a4e439564f7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b1a expref: 8 pid: 1851 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746129827.805489:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129827.805493:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.805502:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129827.805507:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129827.805542:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129827.805545:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.805564:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949054578048:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.805569:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8004 00010000:00010000:2.0:1746129827.805681:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.805740:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1962:x1830949054578176:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 290us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.805746:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8005 00010000:00010000:3.0:1746129827.805752:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129827.805758:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000040:00080000:3.0:1746129827.806360:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3587, 88 off302392 00000004:00080000:3.0:1746129827.806366:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864517311ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806411:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3585, 88 off302128 00000004:00080000:3.0:1746129827.806414:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864566501ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806434:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3586, 88 off302216 00000004:00080000:3.0:1746129827.806436:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864588468ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806487:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3588, 88 off302480 00000004:00080000:3.0:1746129827.806490:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864641826ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806520:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3589, 88 off302568 00000004:00080000:3.0:1746129827.806523:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864675171ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806603:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3587, 88 off302304 00000004:00080000:3.0:1746129827.806608:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864759752ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806624:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3588, 88 off302392 00000004:00080000:3.0:1746129827.806627:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864779018ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806633:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3589, 88 off302480 00000004:00080000:3.0:1746129827.806635:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864787058ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806642:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3590, 88 off302656 00000004:00080000:3.0:1746129827.806644:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864795759ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806663:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3590, 88 off302568 00000004:00080000:3.0:1746129827.806666:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864818359ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806672:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3591, 88 off302744 00000004:00080000:3.0:1746129827.806674:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864826278ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806680:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3591, 88 off302656 00000004:00080000:3.0:1746129827.806682:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864833742ns, next at 716792379979ns, rc = 0 00000040:00080000:3.0:1746129827.806687:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3592, 88 off302832 00000004:00080000:3.0:1746129827.806690:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864841933ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806698:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3593, 88 off302920 00000004:00080000:3.0:1746129827.806700:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864852676ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806707:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3594, 88 off303008 00000004:00080000:3.0:1746129827.806709:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864861316ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806740:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3596, 88 off303192 00000004:00080000:3.0:1746129827.806743:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773864894729ns, next at 731767308185ns, rc = 0 00000040:00080000:3.0:1746129827.806753:0:16808:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3592, 88 off302744 00000004:00080000:3.0:1746129827.806755:0:16808:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773864907493ns, next at 716792379979ns, rc = 0 00000100:00100000:0.0:1746129827.813296:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.813575:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.813880:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578304 00000100:00100000:3.0:1746129827.813888:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578304 00000100:00100000:1.0:1746129827.813915:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578432 00000100:00100000:1.0:1746129827.813919:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578432 00000100:00100000:3.0:1746129827.813935:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15980 00000100:00100000:1.0:1746129827.813984:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15981 00000100:00100000:3.0:1746129827.814019:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31833:x1830949054578304:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.814034:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.814049:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b59 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.814070:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.814072:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.814078:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.814092:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 16 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.814101:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ff3400, rc 0) 00000100:00100000:3.0:1746129827.814137:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31833:x1830949054578304:12345-192.168.204.31@tcp:101:cat.0 Request processed in 196us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.814146:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15980 00000100:00100000:1.0:1746129827.814637:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31832:x1830949054578432:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.814807:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.814814:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b60 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.814826:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.814827:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.814831:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.814839:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.814861:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094be4c00, rc 0) 00000100:00100000:1.0:1746129827.814878:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31832:x1830949054578432:12345-192.168.204.31@tcp:101:cat.0 Request processed in 890us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.814882:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15981 00000100:00100000:0.0:1746129827.817194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.817256:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578560 00000100:00100000:1.0:1746129827.817264:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578560 00000100:00100000:1.0:1746129827.817296:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11143 00000100:00100000:1.0:1746129827.817302:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31832:x1830949054578560:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129827.817317:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.817330:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b67 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.817371:0:14315:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129827.817379:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 4/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.817396:0:14315:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129827.817405:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.817413:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129827.817415:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746129827.817417:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.817422:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5244000, rc 0) 00000100:00100000:1.0:1746129827.817453:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31832:x1830949054578560:12345-192.168.204.31@tcp:101:cat.0 Request processed in 151us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.818194:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11143 00000100:00100000:1.0:1746129827.818657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.818759:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578688 00000100:00100000:2.0:1746129827.818763:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578688 00000100:00100000:2.0:1746129827.818784:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11144 00000100:00100000:2.0:1746129827.818789:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31833:x1830949054578688:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.818798:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.818807:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b6e expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.818835:0:14315:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.818842:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.818865:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129827.818868:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129827.818871:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.818879:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01c00, rc 0) 00000100:00100000:2.0:1746129827.818903:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31833:x1830949054578688:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.818907:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11144 00010000:00010000:0.0:1746129827.833719:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b52 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833732:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:0.0:1746129827.833734:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746129827.833738:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833746:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833752:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833758:0:16808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833763:0:16808:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833771:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.833801:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 13 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.833811:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111616:192.168.204.31@tcp:105: 00010000:00010000:0.0:1746129827.833906:0:16808:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 283 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129827.833913:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111744:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129827.833930:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00000001:00080000:1.0:1746129827.833976:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945171 is committed 00000001:00080000:1.0:1746129827.833986:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945172 is committed 00000004:00080000:1.0:1746129827.833990:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2759 committed 00000004:00080000:1.0:1746129827.834007:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2767 committed 00000004:00080000:1.0:1746129827.834011:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2766 committed 00000004:00080000:1.0:1746129827.834012:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2765 committed 00000004:00080000:1.0:1746129827.834014:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2764 committed 00000004:00080000:1.0:1746129827.834015:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2758 committed 00000004:00080000:1.0:1746129827.834017:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2763 committed 00000004:00080000:1.0:1746129827.834018:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2757 committed 00000004:00080000:1.0:1746129827.834019:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2762 committed 00000004:00080000:1.0:1746129827.834020:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2756 committed 00000004:00080000:1.0:1746129827.834022:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2755 committed 00000004:00080000:1.0:1746129827.834023:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2754 committed 00000004:00080000:1.0:1746129827.834024:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2761 committed 00000004:00080000:1.0:1746129827.834025:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2760 committed 00000004:00080000:1.0:1746129827.834027:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2753 committed 00000004:00080000:1.0:1746129827.834028:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2752 committed 00000004:00080000:1.0:1746129827.834029:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2759 committed 00000001:00080000:1.0:1746129827.834036:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945170 is committed 00000001:00080000:1.0:1746129827.834043:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945167 is committed 00000100:00100000:0.0:1746129827.835043:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054112256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.835076:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.835093:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054112768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.835106:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.835174:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054111872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.835231:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054112000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.835254:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054112128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129827.835721:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054113280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.835738:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129827.835986:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054113792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.836011:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129827.836051:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112768 00000100:00100000:1.0:1746129827.836051:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112256 00000100:00100000:2.0:1746129827.836056:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112768 00000100:00100000:1.0:1746129827.836056:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112256 00000100:00100000:2.0:1746129827.836087:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15982 00000100:00100000:1.0:1746129827.836090:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113280 00000100:00100000:1.0:1746129827.836091:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113280 00000100:00100000:2.0:1746129827.836092:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054112768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.836103:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15983 00000100:00100000:1.0:1746129827.836107:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054112256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129827.836137:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15984 00000100:00100000:2.0:1746129827.836140:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3299:x1830949054113280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129827.836243:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3299:x1830949054113280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (503us total) trans 21474841418 rc 0/0 00000100:00100000:1.0:1746129827.836243:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3299:x1830949054112256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (1166us total) trans 17179874221 rc 0/0 00000100:00100000:1.0:1746129827.836249:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15983 00000004:00080000:0.0:1746129827.836322:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38380/2, rc 0, transno 17179874221 00000100:00100000:0.0:1746129827.836327:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054112256:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129827.836334:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c4380/2, rc 0, transno 21474841418 00000100:00100000:0.0:1746129827.836340:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054113280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.836353:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113792 00000100:00100000:0.0:1746129827.836355:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113792 00000100:00100000:0.0:1746129827.836371:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15985 00000100:00100000:0.0:1746129827.836375:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3299:x1830949054113792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.836460:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3299:x1830949054113792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (448us total) trans 21474841419 rc 0/0 00000100:00100000:0.0:1746129827.836465:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15985 00000004:00080000:0.0:1746129827.836535:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5500/2, rc 0, transno 21474841419 00000100:00100000:0.0:1746129827.836538:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054113792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.836577:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.836592:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054112384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.836606:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.836612:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054112896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.836621:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.836627:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054113408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.836635:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.836644:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054113920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.836653:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.836667:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054111872 00000100:00100000:3.0:1746129827.836668:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054111872 00000100:00100000:3.0:1746129827.836684:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112384 00000100:00100000:3.0:1746129827.836685:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112384 00000100:00100000:3.0:1746129827.836691:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112896 00000100:00100000:3.0:1746129827.836692:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112896 00000100:00100000:3.0:1746129827.836699:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113408 00000100:00100000:3.0:1746129827.836700:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113408 00000100:00100000:3.0:1746129827.836706:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113920 00000100:00100000:3.0:1746129827.836707:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113920 00000100:00100000:3.0:1746129827.836713:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15986 00000100:00100000:3.0:1746129827.836716:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949054111872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746129827.836788:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129827.836790:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.836792:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.836794:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.836796:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746129827.836813:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1830949054111872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (236us total) trans 17179874222 rc 0/0 00000100:00100000:3.0:1746129827.836818:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15986 00000100:00100000:3.0:1746129827.836828:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15987 00000100:00100000:3.0:1746129827.836832:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3296:x1830949054112384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.836908:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3296:x1830949054112384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (301us total) trans 17179874223 rc 0/0 00000100:00100000:3.0:1746129827.836912:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15987 00000100:00100000:3.0:1746129827.836920:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15988 00000100:00100000:3.0:1746129827.836923:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054112896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129827.836976:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129827.836978:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.836980:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.836981:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.836983:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746129827.837008:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949054112896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (385us total) trans 21474841420 rc 0/0 00000100:00100000:3.0:1746129827.837012:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15988 00000100:00100000:3.0:1746129827.837021:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15989 00000100:00100000:3.0:1746129827.837025:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054113408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.837091:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949054113408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (454us total) trans 21474841421 rc 0/0 00000100:00100000:3.0:1746129827.837096:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15989 00000100:00100000:3.0:1746129827.837106:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15990 00000100:00100000:3.0:1746129827.837110:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3296:x1830949054113920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129827.837175:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3296:x1830949054113920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (520us total) trans 21474841422 rc 0/0 00000100:00100000:3.0:1746129827.837179:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15990 00000004:00080000:3.0:1746129827.837206:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a04f100/2, rc 0, transno 21474841422 00000100:00100000:3.0:1746129827.837209:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a04f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054113920:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129827.837216:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39c00/2, rc 0, transno 17179874222 00000100:00100000:3.0:1746129827.837218:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054111872:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129827.837224:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba3bb80/2, rc 0, transno 17179874223 00000100:00100000:3.0:1746129827.837226:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054112384:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129827.837230:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15984 00000004:00080000:3.0:1746129827.837231:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5180/2, rc 0, transno 21474841420 00000100:00100000:3.0:1746129827.837233:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054112896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746129827.837238:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c5880/2, rc 0, transno 21474841421 00000100:00100000:3.0:1746129827.837240:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054113408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129827.837310:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3299:x1830949054112768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1217us (2202us total) trans 17179874224 rc 0/0 00000100:00100000:2.0:1746129827.837314:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15982 00000100:00100000:1.0:1746129827.837540:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.837567:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054112640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.837584:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.837593:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054113152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129827.837604:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.837612:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054113664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129827.837623:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.837639:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112128 00000100:00100000:1.0:1746129827.837642:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112128 00000100:00100000:1.0:1746129827.837655:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112640 00000100:00100000:1.0:1746129827.837656:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112640 00000100:00100000:1.0:1746129827.837663:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113152 00000100:00100000:1.0:1746129827.837664:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113152 00000100:00100000:1.0:1746129827.837669:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113664 00000100:00100000:1.0:1746129827.837671:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113664 00000100:00100000:1.0:1746129827.837678:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15991 00000100:00100000:1.0:1746129827.837682:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3298:x1830949054112128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129827.837751:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129827.837754:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.837755:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.837757:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.837759:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746129827.837779:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3298:x1830949054112128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (239us total) trans 17179874225 rc 0/0 00000100:00100000:1.0:1746129827.837784:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15991 00000100:00100000:1.0:1746129827.837792:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15992 00000100:00100000:1.0:1746129827.837796:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3298:x1830949054112640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.837883:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3298:x1830949054112640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (297us total) trans 17179874226 rc 0/0 00000100:00100000:1.0:1746129827.837888:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15992 00000100:00100000:1.0:1746129827.837895:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15993 00000100:00100000:1.0:1746129827.837899:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3298:x1830949054113152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129827.837962:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:1.0:1746129827.837964:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.837966:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.837968:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:1.0:1746129827.837970:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:1.0:1746129827.837986:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949054113152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (381us total) trans 21474841423 rc 0/0 00000100:00100000:1.0:1746129827.837999:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15993 00000100:00100000:1.0:1746129827.838008:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15994 00000100:00100000:1.0:1746129827.838012:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3298:x1830949054113664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746129827.838069:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746129827.838071:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746129827.838072:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746129827.838074:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746129827.838075:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746129827.838092:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3298:x1830949054113664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (467us total) trans 21474841424 rc 0/0 00000100:00100000:1.0:1746129827.838096:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15994 00000004:00080000:1.0:1746129827.838115:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba39180/2, rc 0, transno 17179874225 00000100:00100000:1.0:1746129827.838119:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054112128:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129827.838125:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4a80/2, rc 0, transno 17179874226 00000100:00100000:1.0:1746129827.838127:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054112640:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129827.838251:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c5500/2, rc 0, transno 17179874224 00000100:00100000:3.0:1746129827.838255:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054112768:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129827.838335:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c6680/2, rc 0, transno 21474841423 00000100:00100000:1.0:1746129827.838338:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054113152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129827.838342:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7b80/2, rc 0, transno 21474841424 00000100:00100000:1.0:1746129827.838344:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054113664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129827.838354:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.838455:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054112512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129827.838469:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129827.839653:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054113024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129827.839673:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129827.839744:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112000 00000100:00100000:2.0:1746129827.839748:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112000 00000100:00100000:1.0:1746129827.840312:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054113536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129827.840327:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129827.840339:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113024 00000100:00100000:2.0:1746129827.840339:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054112512 00000100:00100000:2.0:1746129827.840341:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054112512 00000100:00100000:3.0:1746129827.840342:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113024 00000100:00100000:2.0:1746129827.840359:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15995 00000100:00100000:3.0:1746129827.840362:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15996 00000100:00100000:2.0:1746129827.840364:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949054112000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.840366:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3297:x1830949054112512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129827.840375:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15997 00000100:00100000:3.0:1746129827.840378:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+39:3297:x1830949054113024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129827.840482:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129827.840482:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129827.840484:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:2.0:1746129827.840484:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.840486:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:2.0:1746129827.840486:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.840488:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:2.0:1746129827.840488:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129828 -> 1746129828 00002000:00010000:3.0:1746129827.840490:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746129827.840490:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746129827.840512:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949054113024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (838us total) trans 21474841425 rc 0/0 00000100:00100000:3.0:1746129827.840517:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15997 00000100:00100000:3.0:1746129827.840598:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3297:x1830949054112512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (2128us total) trans 17179874228 rc 0/0 00000100:00100000:3.0:1746129827.840603:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15996 00000100:00100000:2.0:1746129827.840774:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3297:x1830949054112000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 410us (2419us total) trans 17179874227 rc 0/0 00000100:00100000:2.0:1746129827.840779:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15995 00000100:00100000:2.0:1746129827.840786:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054113536 00000100:00100000:2.0:1746129827.840788:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054113536 00000004:00080000:1.0:1746129827.840788:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38e00/2, rc 0, transno 17179874227 00000100:00100000:1.0:1746129827.840792:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054112000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129827.840799:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15998 00000004:00080000:1.0:1746129827.840799:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c1c4700/2, rc 0, transno 17179874228 00000100:00100000:1.0:1746129827.840801:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054112512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129827.840802:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3297:x1830949054113536:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129827.840807:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c7100/2, rc 0, transno 21474841425 00000100:00100000:1.0:1746129827.840810:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054113024:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129827.840913:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3297:x1830949054113536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (584us total) trans 21474841426 rc 0/0 00000100:00100000:2.0:1746129827.840917:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15998 00000004:00080000:1.0:1746129827.841017:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a00c4700/2, rc 0, transno 21474841426 00000100:00100000:1.0:1746129827.841020:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054113536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129827.842198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.842273:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578816 00000100:00100000:3.0:1746129827.842277:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578816 00000100:00100000:3.0:1746129827.842307:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4681 00000100:00100000:3.0:1746129827.842312:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31832:x1830949054578816:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129827.842385:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50ea450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31832:x1830949054578816:12345-192.168.204.31@tcp:49:cat.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.842390:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4681 00000100:00100000:2.0:1746129827.842582:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111616:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129827.842591:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054111744:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129827.842621:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095230a00/0x48868a4e43956583 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b52 expref: 10 pid: 16808 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746129827.842634:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b52 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.842651:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095231000, rc 0) 00000100:00100000:2.0:1746129827.842684:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31828:x1830949054577920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 42169us (44355us total) trans 8589945172 rc 0/0 00000100:00100000:2.0:1746129827.842690:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11142 00000100:00100000:0.0:1746129827.842833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.842882:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054578944 00000100:00100000:2.0:1746129827.842885:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054578944 00000100:00100000:0.0:1746129827.842885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.842941:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4682 00000100:00100000:2.0:1746129827.842946:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31833:x1830949054578944:12345-192.168.204.31@tcp:49:cat.0 00000100:00100000:3.0:1746129827.843030:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054579072 00000100:00100000:3.0:1746129827.843033:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054579072 00000100:00100000:3.0:1746129827.843055:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11145 00000100:00100000:3.0:1746129827.843060:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31829:x1830949054579072:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129827.843067:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129827.843106:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31833:x1830949054578944:12345-192.168.204.31@tcp:49:cat.0 Request processed in 158us (272us total) trans 0 rc 0/0 00010000:00010000:3.0:1746129827.843109:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9400/0x48868a4e439565ad lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b75 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.843111:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4682 00010000:00010000:3.0:1746129827.843138:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9400/0x48868a4e439565ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b75 expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.843149:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9400/0x48868a4e439565ad lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b75 expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.843159:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129827.843166:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746129827.843220:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e0e9400, rc 0) 00000100:00100000:3.0:1746129827.843246:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31829:x1830949054579072:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 186us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.843250:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11145 00000100:00100000:0.0:1746129827.845419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.845607:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054579200 00000100:00100000:2.0:1746129827.845613:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054579200 00000100:00100000:2.0:1746129827.845653:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4683 00000100:00100000:2.0:1746129827.845659:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31828:x1830949054579200:12345-192.168.204.31@tcp:49:multiop.0 00000100:00100000:2.0:1746129827.845734:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31828:x1830949054579200:12345-192.168.204.31@tcp:49:multiop.0 Request processed in 75us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.845739:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4683 00000100:00100000:0.0:1746129827.847555:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.847614:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.847845:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054579328 00000100:00100000:2.0:1746129827.847865:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054579328 00000100:00100000:1.0:1746129827.848005:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054579456 00000100:00100000:1.0:1746129827.848009:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054579456 00000100:00100000:2.0:1746129827.848191:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 747 00000100:00100000:2.0:1746129827.848199:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:1962:x1830949054579328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.848210:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.848235:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e0e9400/0x48868a4e439565ad lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b75 expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.848248:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129827.848251:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.848592:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:1962:x1830949054579328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 393us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.848592:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 15999 00000100:00100000:2.0:1746129827.848597:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 747 00000100:00100000:1.0:1746129827.848598:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:31829:x1830949054579456:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129827.848608:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129827.848618:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b7c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.848638:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.848653:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.848655:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129827.848658:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 31 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.848681:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129827.848691:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 10 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746129827.848701:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054114048:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129827.848779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.848898:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584180 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.849008:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054579712 00000100:00100000:3.0:1746129827.849013:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054579712 00002000:00100000:3.0:1746129827.849043:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009a04ca80 x1830949054579712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746129827.849048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129827.849052:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ca80 with x1830949054579712 ext(1048576->2097151) 00002000:00010000:3.0:1746129827.849055:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ca80 00000100:00100000:3.0:1746129827.849068:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7205 00000100:00100000:3.0:1746129827.849074:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054579712:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129827.849108:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054579840 00000100:00100000:0.0:1746129827.849111:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054579840 00000100:00100000:0.0:1746129827.849128:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16000 00000100:00100000:0.0:1746129827.849132:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31828:x1830949054579840:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129827.849138:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.849144:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b83 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.849154:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.849155:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.849158:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.849165:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.849172:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ea00, rc 0) 00000100:00100000:0.0:1746129827.849199:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31828:x1830949054579840:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.849204:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16000 00000100:00100000:2.0:1746129827.852808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.852905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.852971:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054580096 00000100:00100000:0.0:1746129827.852978:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054580096 00002000:00100000:0.0:1746129827.853022:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009b00d500 x1830949054580096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.853030:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d500 with x1830949054580096 ext(1048576->2097151) 00002000:00010000:0.0:1746129827.853035:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d500 00000100:00100000:0.0:1746129827.853053:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7206 00000100:00100000:0.0:1746129827.853059:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054580096:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129827.853725:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054114048:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129827.853747:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129827.853761:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d5200, rc 0) 00000100:00100000:1.0:1746129827.853796:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31829:x1830949054579456:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5198us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129827.853802:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 15999 00000100:00100000:3.0:1746129827.854402:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054580224 00000100:00100000:3.0:1746129827.854406:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054580224 00010000:00010000:3.0:1746129827.854434:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.854467:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8006 00000100:00100000:3.0:1746129827.854473:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054580224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.854486:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.854503:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.854512:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.854531:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c15c00/0x48868a4e439564aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b13 expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.854541:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.854543:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.854548:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.854556:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.854563:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.854563:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.854567:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.854572:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.854597:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.854612:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054114176:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.854678:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 32 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.854686:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054114304:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.854703:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.857340:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054579712:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 8260us (8554us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.857350:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7205 00002000:00100000:3.0:1746129827.857359:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009a04ca80 x1830949054579712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.857367:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04ca80 with x1830949054579712 ext(1048576->2097151) 00002000:00010000:3.0:1746129827.857372:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04ca80 00000100:00100000:0.0:1746129827.862701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.862755:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054580480 00000100:00100000:2.0:1746129827.862762:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054580480 00002000:00100000:2.0:1746129827.862795:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3010560->3014655) req@ffff88009a04d500 x1830949054580480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.862803:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d500 with x1830949054580480 ext(3010560->3014655) 00002000:00010000:2.0:1746129827.862808:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04d500 00000100:00100000:2.0:1746129827.862825:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7207 00000100:00100000:2.0:1746129827.862831:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054580480:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129827.862979:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054580480:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 147us (284us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129827.862985:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7207 00002000:00100000:2.0:1746129827.862990:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (3010560->3014655) req@ffff88009a04d500 x1830949054580480/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.863010:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04d500 with x1830949054580480 ext(3010560->3014655) 00002000:00010000:2.0:1746129827.863012:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04d500 00000100:00100000:3.0:1746129827.863085:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054114176:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.863093:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054114304:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.863111:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.863135:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054580224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8663us (10231us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.863142:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8006 00000100:00100000:1.0:1746129827.864008:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1962:x1830949054580096:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10934us (11193us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.864016:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7206 00002000:00100000:1.0:1746129827.864023:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88009b00d500 x1830949054580096/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.864030:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d500 with x1830949054580096 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.864033:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00d500 00000100:00100000:2.0:1746129827.865183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.866844:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054580736 00000100:00100000:1.0:1746129827.866880:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054580736 00002000:00100000:1.0:1746129827.866917:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3973120->3977215) req@ffff88009b00c380 x1830949054580736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.866926:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949054580736 ext(3973120->3977215) 00002000:00010000:1.0:1746129827.866930:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00c380 00000100:00100000:1.0:1746129827.866956:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7208 00000100:00100000:1.0:1746129827.866962:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054580736:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129827.867127:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054580736:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 164us (1946us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129827.867132:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7208 00002000:00100000:1.0:1746129827.867138:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3973120->3977215) req@ffff88009b00c380 x1830949054580736/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.867144:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949054580736 ext(3973120->3977215) 00002000:00010000:1.0:1746129827.867147:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b00c380 00000100:00100000:0.0:1746129827.877814:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.877877:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054580864 00000100:00100000:1.0:1746129827.877886:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054580864 00000100:00100000:0.0:1746129827.877891:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.877922:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054580992 00000100:00100000:1.0:1746129827.877924:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054580992 00000100:00100000:0.0:1746129827.877929:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16001 00000100:00100000:0.0:1746129827.877936:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31832:x1830949054580864:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129827.877988:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16002 00000100:00100000:3.0:1746129827.878006:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31833:x1830949054580992:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.878015:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.878031:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b91 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.878050:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.878052:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.878058:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.878070:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.878080:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d6c3800, rc 0) 00000100:00100000:3.0:1746129827.878113:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31833:x1830949054580992:12345-192.168.204.31@tcp:101:cat.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.878118:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16002 00010000:00010000:0.0:1746129827.878710:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.878723:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b8a expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.878739:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.878740:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.878744:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.878752:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.878759:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f17600, rc 0) 00000100:00100000:0.0:1746129827.879394:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31832:x1830949054580864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1457us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.879400:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16001 00000100:00100000:0.0:1746129827.880889:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.880948:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054581120 00000100:00100000:2.0:1746129827.880955:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054581120 00000100:00100000:0.0:1746129827.880959:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.880987:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16003 00000100:00100000:2.0:1746129827.881004:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31829:x1830949054581120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129827.881018:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.881031:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b98 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.881036:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054581376 00000100:00100000:1.0:1746129827.881040:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054581376 00010000:00010000:2.0:1746129827.881058:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129827.881064:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:1.0:1746129827.881065:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009a04dc00 x1830949054581376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746129827.881066:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.881069:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4476927] (req 4194304->4476927) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 22 pid: 7976 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746129827.881074:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04dc00 with x1830949054581376 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.881078:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04dc00 00000100:00100000:1.0:1746129827.881091:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7209 00010000:00010000:2.0:1746129827.881093:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129827.881096:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054581376:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:2.0:1746129827.881103:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 10 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746129827.881114:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054114432:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129827.881182:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.886293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.886297:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054114432:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129827.886320:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [4194304->4476927] (req 4194304->4476927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 22 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.886336:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa00e00, rc 0) 00000100:00100000:2.0:1746129827.886376:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31829:x1830949054581120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5381us (5489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.886384:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16003 00000100:00100000:3.0:1746129827.887189:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054581504 00000100:00100000:3.0:1746129827.887196:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054581504 00010000:00010000:3.0:1746129827.887220:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746129827.887241:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8007 00000100:00100000:3.0:1746129827.887247:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054581504:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.887257:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.887273:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.887282:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.887303:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c15800/0x48868a4e43956495 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b0c expref: 11 pid: 20441 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746129827.887328:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.887330:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.887335:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.887341:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.887365:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.887375:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054114560:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.887600:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.892049:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.892191:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054581760 00000100:00100000:2.0:1746129827.892199:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054581760 00002000:00100000:2.0:1746129827.892234:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009a04c700 x1830949054581760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.892242:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c700 with x1830949054581760 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.892247:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c700 00000100:00100000:2.0:1746129827.892279:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7210 00000100:00100000:2.0:1746129827.892286:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054581760:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129827.893625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.893644:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054114560:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.893671:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.893698:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054581504:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6451us (7412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.893705:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8007 00000100:00100000:3.0:1746129827.893733:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054582016 00000100:00100000:3.0:1746129827.893736:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054582016 00002000:00100000:3.0:1746129827.893757:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4472832->4476927) req@ffff88009b00d880 x1830949054582016/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.893769:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949054582016 ext(4472832->4476927) 00002000:00010000:3.0:1746129827.893772:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00d880 00000100:00100000:3.0:1746129827.893781:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7211 00000100:00100000:3.0:1746129827.893785:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054582016:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129827.893837:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054581376:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 12741us (12877us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.893843:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7209 00002000:00100000:1.0:1746129827.893865:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009a04dc00 x1830949054581376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.893872:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04dc00 with x1830949054581376 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.893875:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04dc00 00000100:00100000:3.0:1746129827.893879:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1963:x1830949054582016:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 93us (260us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129827.893884:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7211 00002000:00100000:3.0:1746129827.893887:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4472832->4476927) req@ffff88009b00d880 x1830949054582016/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/4536 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.893893:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949054582016 ext(4472832->4476927) 00002000:00010000:3.0:1746129827.893896:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00d880 00000100:00100000:2.0:1746129827.902871:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1962:x1830949054581760:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10556us (10804us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.902881:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7210 00002000:00100000:2.0:1746129827.902890:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff88009a04c700 x1830949054581760/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.902900:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a04c700 with x1830949054581760 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.903466:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a04c700 00000100:00100000:0.0:1746129827.905949:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.906046:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054582272 00000100:00100000:3.0:1746129827.906054:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054582272 00000100:00100000:3.0:1746129827.906100:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4684 00000100:00100000:3.0:1746129827.906107:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31829:x1830949054582272:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129827.906318:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31829:x1830949054582272:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 212us (375us total) trans 8589945173 rc 0/0 00000100:00100000:3.0:1746129827.906324:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4684 00000100:00100000:0.0:1746129827.909415:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.909452:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.909468:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054582400 00000100:00100000:0.0:1746129827.909473:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054582400 00000100:00100000:0.0:1746129827.909499:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054582528 00000100:00100000:0.0:1746129827.909500:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054582528 00000100:00100000:0.0:1746129827.909511:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16004 00000100:00100000:0.0:1746129827.909517:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:31833:x1830949054582400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129827.909530:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.909543:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356b9f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.909562:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.909563:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.909569:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.909581:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.909588:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1ee00, rc 0) 00000100:00100000:0.0:1746129827.909615:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31833:x1830949054582400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.909620:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16004 00000100:00100000:0.0:1746129827.909631:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16005 00000100:00100000:0.0:1746129827.909635:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31832:x1830949054582528:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129827.909639:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129827.909643:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ba6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.909650:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.909651:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129827.909654:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.909661:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129827.909671:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800acc1fe00, rc 0) 00000100:00100000:0.0:1746129827.910648:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c042680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:31832:x1830949054582528:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1010us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129827.910654:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16005 00000100:00100000:0.0:1746129827.915567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.915651:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054582784 00000100:00100000:2.0:1746129827.915659:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054582784 00002000:00100000:2.0:1746129827.915693:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ffb1880 x1830949054582784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.915701:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb1880 with x1830949054582784 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.915705:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb1880 00000100:00100000:2.0:1746129827.915810:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7212 00000100:00100000:2.0:1746129827.915818:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054582784:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129827.916704:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129827.916767:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583040 00000100:00100000:1.0:1746129827.916772:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583040 00002000:00100000:1.0:1746129827.916789:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ffb0700 x1830949054583040/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.916797:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb0700 with x1830949054583040 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.916800:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb0700 00000100:00100000:1.0:1746129827.916819:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7213 00000100:00100000:1.0:1746129827.916824:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054583040:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129827.927061:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1964:x1830949054583040:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 10227us (10349us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129827.927074:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7213 00002000:00100000:1.0:1746129827.927083:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ffb0700 x1830949054583040/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.927092:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb0700 with x1830949054583040 ext(1048576->2097151) 00002000:00010000:1.0:1746129827.927096:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb0700 00000100:00100000:2.0:1746129827.932205:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054582784:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 16379us (16635us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.932217:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7212 00002000:00100000:2.0:1746129827.932227:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012ffb1880 x1830949054582784/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.932235:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ffb1880 with x1830949054582784 ext(1048576->2097151) 00002000:00010000:2.0:1746129827.932240:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ffb1880 00000100:00100000:0.0:1746129827.938976:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.939023:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.939063:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.939150:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583296 00000100:00100000:3.0:1746129827.939158:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583296 00000100:00100000:2.0:1746129827.939163:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583168 00000100:00100000:2.0:1746129827.939167:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583168 00000100:00100000:2.0:1746129827.939196:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16006 00000100:00100000:2.0:1746129827.939202:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054583168:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.939218:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.939232:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01600/0x48868a4e439565e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bad expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.939276:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054114688:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129827.939281:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16007 00000100:00100000:3.0:1746129827.939288:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054583296:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.939295:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.939305:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801373f8200/0x48868a4e439565ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bb4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.939328:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054114816:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129827.939348:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.939352:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.939364:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583552 00000100:00100000:2.0:1746129827.939366:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583552 00002000:00100000:2.0:1746129827.939388:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009c678700 x1830949054583552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.939396:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678700 with x1830949054583552 ext(2097152->3145727) 00002000:00010000:2.0:1746129827.939400:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c678700 00000100:00100000:2.0:1746129827.939411:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7214 00000100:00100000:2.0:1746129827.939416:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054583552:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.941172:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054114816:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129827.941197:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801373f8200/0x48868a4e439565ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bb4 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.941204:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801373f8200/0x48868a4e439565ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bb4 expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.941216:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373f8200, rc 0) 00000100:00100000:3.0:1746129827.941239:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054583296:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1953us (2271us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129827.941243:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16007 00000100:00100000:3.0:1746129827.941954:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054114688:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129827.941973:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01600/0x48868a4e439565e5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bad expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.941983:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01600/0x48868a4e439565e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bad expref: 19 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129827.942001:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01600, rc 0) 00000100:00100000:3.0:1746129827.942577:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054583168:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3373us (3551us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129827.942587:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16006 00000100:00100000:0.0:1746129827.948366:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.948439:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583680 00000100:00100000:3.0:1746129827.948446:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583680 00000100:00100000:3.0:1746129827.948501:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16008 00000100:00100000:3.0:1746129827.948510:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31833:x1830949054583680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.948527:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.948543:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bbb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.948570:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.948577:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.948579:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129827.948582:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.948610:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 24 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.948621:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 24 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129827.948632:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054114944:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.948693:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.949385:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1963:x1830949054583552:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9967us (10319us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129827.949395:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7214 00002000:00100000:2.0:1746129827.949404:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009c678700 x1830949054583552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.949412:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678700 with x1830949054583552 ext(2097152->3145727) 00010000:00010000:2.0:1746129827.949417:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 23 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.949427:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 23 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129827.949433:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c678700 00000100:00100000:3.0:1746129827.951467:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054114944:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.951496:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 19 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.951510:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa01800, rc 0) 00000100:00100000:3.0:1746129827.951550:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31833:x1830949054583680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3042us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.951556:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16008 00000100:00100000:0.0:1746129827.955266:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.955356:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583808 00000100:00100000:2.0:1746129827.955364:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583808 00002000:00100000:2.0:1746129827.955398:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4476927) req@ffff88009c679f80 x1830949054583808/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.955406:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679f80 with x1830949054583808 ext(4194304->4476927) 00010000:00010000:2.0:1746129827.955414:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 23 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.955425:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 23 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129827.955431:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c679f80 00000100:00100000:2.0:1746129827.955458:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1941 00000100:00100000:2.0:1746129827.955465:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054583808:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129827.957620:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.957692:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054583936 00000100:00100000:3.0:1746129827.957697:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054583936 00000100:00100000:3.0:1746129827.957728:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16009 00000100:00100000:3.0:1746129827.957733:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31832:x1830949054583936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129827.957745:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129827.957758:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bc2 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.957780:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.957787:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.957793:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129827.957794:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746129827.957797:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 5/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.957823:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.957833:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 33 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129827.957843:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054115072:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129827.957932:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 17 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.957939:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 17 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129827.957946:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054115200:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.957959:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129827.959692:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054583808:12345-192.168.204.31@tcp:4:cat.0 Request processed in 4222us (4429us total) trans 21474841427 rc 0/0 00000100:00100000:0.0:1746129827.959701:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1941 00002000:00100000:0.0:1746129827.959709:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4476927) req@ffff88009c679f80 x1830949054583808/t21474841427(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129827.959716:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679f80 with x1830949054583808 ext(4194304->4476927) 00010000:00010000:0.0:1746129827.959724:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 25 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129827.959734:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 25 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:0.0:1746129827.959745:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c679f80 00000100:00100000:0.0:1746129827.960696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.960740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.960839:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054115072:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129827.960868:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054115200:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129827.960883:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054584192 00000100:00100000:1.0:1746129827.960890:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054584192 00010000:00010000:3.0:1746129827.960894:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129827.960900:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054584064 00000100:00100000:1.0:1746129827.960902:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054584064 00010000:00010000:3.0:1746129827.960907:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373f9c00, rc 0) 00002000:00100000:1.0:1746129827.960928:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3973120->4194303) req@ffff88009c67bb80 x1830949054584064/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.960936:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67bb80 with x1830949054584064 ext(3973120->4194303) 00000100:00100000:3.0:1746129827.960941:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31832:x1830949054583936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3207us (3328us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129827.960942:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 34 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129827.960948:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16009 00010000:00010000:1.0:1746129827.960952:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 34 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129827.960959:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c67bb80 00000100:00100000:1.0:1746129827.960974:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1942 00000100:00100000:1.0:1746129827.960980:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054584064:12345-192.168.204.31@tcp:4:cat.0 00002000:00100000:1.0:1746129827.961229:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2719744->3014655) req@ffff88009c67b800 x1830949054584192/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.961236:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67b800 with x1830949054584192 ext(2719744->3014655) 00010000:00010000:1.0:1746129827.961242:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 18 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129827.961250:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 18 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129827.961256:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c67b800 00000100:00100000:1.0:1746129827.961274:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1943 00000100:00100000:1.0:1746129827.961279:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054584192:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129827.966716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.966895:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054584320 00000100:00100000:3.0:1746129827.966903:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054584320 00010000:00010000:3.0:1746129827.966939:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 25 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129827.966970:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8008 00000100:00100000:3.0:1746129827.966976:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054584320:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129827.966987:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129827.967013:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 25 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129827.967023:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 25 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129827.967042:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa00e00/0x48868a4e439565d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4476927) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b98 expref: 25 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129827.967447:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.967449:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129827.967456:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.967464:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129827.967493:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129827.967503:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054115328:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129827.967575:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:3.0:1746129827.971606:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054115328:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129827.971625:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129827.971689:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054584320:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4712us (4981us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129827.971698:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8008 00000100:00100000:0.0:1746129827.972776:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.972824:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054584576 00000100:00100000:3.0:1746129827.972829:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054584576 00002000:00100000:3.0:1746129827.972868:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009c67aa00 x1830949054584576/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.972876:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67aa00 with x1830949054584576 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.972880:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67aa00 00000100:00100000:3.0:1746129827.972915:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7215 00000100:00100000:3.0:1746129827.972922:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054584576:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.974063:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054584064:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13080us (13319us total) trans 17179874229 rc 0/0 00000100:00100000:1.0:1746129827.974071:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1942 00002000:00100000:1.0:1746129827.974077:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3973120->4194303) req@ffff88009c67bb80 x1830949054584064/t17179874229(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129827.974084:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67bb80 with x1830949054584064 ext(3973120->4194303) 00010000:00010000:1.0:1746129827.974092:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 35 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129827.974103:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 35 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129827.974108:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c67bb80 00000100:00100000:2.0:1746129827.974217:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054584192:12345-192.168.204.31@tcp:4:cat.0 Request processed in 12936us (13523us total) trans 17179874230 rc 0/0 00000100:00100000:2.0:1746129827.974224:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1943 00002000:00100000:2.0:1746129827.974230:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2719744->3014655) req@ffff88009c67b800 x1830949054584192/t17179874230(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/448 e 0 to 0 dl 1746129838 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129827.974237:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67b800 with x1830949054584192 ext(2719744->3014655) 00010000:00010000:2.0:1746129827.974242:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.974250:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129827.974312:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c67b800 00000100:00100000:2.0:1746129827.978367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.978426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129827.978447:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054584704 00000100:00100000:2.0:1746129827.978453:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054584704 00010000:00010000:2.0:1746129827.978481:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 35 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129827.978500:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054584832 00000100:00100000:2.0:1746129827.978502:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054584832 00010000:00010000:2.0:1746129827.978512:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129827.978537:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8009 00000100:00100000:2.0:1746129827.978545:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1964:x1830949054584704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.978555:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.978580:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 35 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.978592:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 35 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.978612:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01d5200/0x48868a4e439565b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [3014656->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b7c expref: 35 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.978628:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.978662:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054584704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 118us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.978668:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8009 00000100:00100000:2.0:1746129827.978681:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8010 00000100:00100000:2.0:1746129827.978685:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054584832:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129827.978691:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129827.978697:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.978705:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.978716:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800acc1ea00/0x48868a4e439565bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2719744->3014655] (req 2719744->3014655) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b83 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129827.978728:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.978729:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.978735:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.978743:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.978769:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129827.978780:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054115456:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129827.978828:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129827.983439:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054115456:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129827.983454:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129827.983501:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054584832:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4814us (5074us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.983510:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8010 00000100:00100000:3.0:1746129827.985130:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054584576:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12205us (12352us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.985138:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7215 00002000:00100000:3.0:1746129827.985147:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009c67aa00 x1830949054584576/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.985155:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67aa00 with x1830949054584576 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.985160:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67aa00 00000100:00100000:0.0:1746129827.988128:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.988202:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054585088 00000100:00100000:3.0:1746129827.988211:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054585088 00000100:00100000:0.0:1746129827.988226:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129827.988251:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009c679180 x1830949054585088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.988265:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679180 with x1830949054585088 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.988269:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c679180 00000100:00100000:2.0:1746129827.988277:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054585216 00000100:00100000:2.0:1746129827.988280:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054585216 00000100:00100000:3.0:1746129827.988300:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7216 00000100:00100000:2.0:1746129827.988306:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16010 00000100:00100000:3.0:1746129827.988307:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054585088:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129827.988310:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31833:x1830949054585216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129827.988317:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129827.988329:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bc9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.988346:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.988347:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129827.988352:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.988931:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129827.988942:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f32600, rc 0) 00000100:00100000:2.0:1746129827.989160:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31833:x1830949054585216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 848us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129827.989167:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16010 00000100:00100000:0.0:1746129827.997640:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129827.997686:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129827.997931:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054585472 00000100:00100000:3.0:1746129827.997938:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054585472 00002000:00100000:3.0:1746129827.997978:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a00c6a00 x1830949054585472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.997987:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6a00 with x1830949054585472 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.998005:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c6a00 00000100:00100000:3.0:1746129827.998032:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054585728 00000100:00100000:3.0:1746129827.998034:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054585728 00002000:00100000:3.0:1746129827.998045:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a00c6300 x1830949054585728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.998052:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6300 with x1830949054585728 ext(3145728->4194303) 00002000:00010000:3.0:1746129827.998054:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c6300 00000100:00100000:3.0:1746129827.998067:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7217 00000100:00100000:3.0:1746129827.998073:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054585472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129827.998313:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7218 00000100:00100000:1.0:1746129827.998321:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054585728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129827.999242:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054585088:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10933us (11119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129827.999249:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7216 00002000:00100000:3.0:1746129827.999255:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009c679180 x1830949054585088/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129827.999269:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679180 with x1830949054585088 ext(2097152->3145727) 00002000:00010000:3.0:1746129827.999272:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c679180 00000100:00100000:0.0:1746129827.999742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.001222:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054585984 00000100:00100000:3.0:1746129828.001230:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054585984 00000100:00080000:0.0:1746129828.001255:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:3.0:1746129828.001267:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a00c6d80 x1830949054585984/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/0 e 0 to 0 dl 1746129838 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.001275:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6d80 with x1830949054585984 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.001279:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6d80 00000100:00100000:3.0:1746129828.001304:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7219 00000100:00100000:3.0:1746129828.001313:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054585984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.011470:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054585472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13384us (13825us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.011481:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7217 00002000:00100000:3.0:1746129828.011627:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a00c6a00 x1830949054585472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.011637:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6a00 with x1830949054585472 ext(2097152->3145727) 00002000:00010000:3.0:1746129828.011642:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c6a00 00000100:00100000:0.0:1746129828.011732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.012802:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054586112 00000100:00100000:2.0:1746129828.012810:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054586112 00000100:00100000:2.0:1746129828.012882:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16011 00000100:00100000:2.0:1746129828.012889:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:31832:x1830949054586112:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.012903:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.012919:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bd0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.012940:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.012942:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.012950:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.012962:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.012971:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091f33800, rc 0) 00000100:00100000:2.0:1746129828.013012:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31832:x1830949054586112:12345-192.168.204.31@tcp:101:cat.0 Request processed in 124us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.013017:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16011 00000100:00080000:0.0:1746129828.013072:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129828.016906:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054585984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15587us (17155us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.016917:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7219 00002000:00100000:3.0:1746129828.016926:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a00c6d80 x1830949054585984/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.016934:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6d80 with x1830949054585984 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.016940:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6d80 00000100:00100000:1.0:1746129828.020024:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054585728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21696us (22330us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.020035:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7218 00002000:00100000:1.0:1746129828.020045:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800a00c6300 x1830949054585728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:568/0 lens 488/440 e 0 to 0 dl 1746129838 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.020053:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6300 with x1830949054585728 ext(3145728->4194303) 00002000:00010000:1.0:1746129828.020058:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a00c6300 00000100:00100000:0.0:1746129828.023080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.023160:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054586368 00000100:00100000:1.0:1746129828.023168:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054586368 00002000:00100000:1.0:1746129828.023204:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009be64700 x1830949054586368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.023213:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64700 with x1830949054586368 ext(3145728->4194303) 00002000:00010000:1.0:1746129828.023217:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64700 00000100:00100000:1.0:1746129828.023349:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7220 00000100:00100000:1.0:1746129828.023358:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054586368:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.025310:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.025540:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054586624 00000100:00100000:3.0:1746129828.025547:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054586624 00002000:00100000:3.0:1746129828.025593:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009be66300 x1830949054586624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.025602:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66300 with x1830949054586624 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.025607:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66300 00000100:00100000:3.0:1746129828.025629:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7221 00000100:00100000:3.0:1746129828.025639:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054586624:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129828.027633:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129828.030591:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.030678:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054586880 00000100:00100000:3.0:1746129828.030686:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054586880 00002000:00100000:3.0:1746129828.030725:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009be64e00 x1830949054586880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.030733:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64e00 with x1830949054586880 ext(4194304->4931583) 00002000:00010000:3.0:1746129828.030738:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64e00 00000100:00100000:3.0:1746129828.031033:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7222 00000100:00100000:3.0:1746129828.031042:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054586880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.031879:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054586368:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8521us (8804us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.031886:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7220 00002000:00100000:1.0:1746129828.031892:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009be64700 x1830949054586368/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.031900:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64700 with x1830949054586368 ext(3145728->4194303) 00002000:00010000:1.0:1746129828.031904:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64700 00000100:00100000:0.0:1746129828.038366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.038481:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054587136 00000100:00100000:3.0:1746129828.038490:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054587136 00000100:00100000:3.0:1746129828.038533:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11146 00000100:00100000:3.0:1746129828.038543:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31838:x1830949054587136:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129828.038562:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.038578:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e4395660f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bd7 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.038665:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038675:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038685:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038697:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038701:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038705:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038814:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43956624 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038820:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43956624 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038825:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43956624 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129828.038832:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129828.038915:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038921:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038929:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038934:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b6b6400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.038937:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038941:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038949:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129828.038951:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.038954:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.038958:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b6b6400/0x48868a4e43956616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129828.038980:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1963:x1830949054586880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7938us (8396us total) trans 0 rc 737280/737280 00010000:00010000:3.0:1746129828.038985:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129828.038996:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7222 00010000:00010000:3.0:1746129828.038997:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.039001:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.039005:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f87a200 already unused, calling callback (ffffffffa1371690) 00002000:00100000:2.0:1746129828.039005:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009be64e00 x1830949054586880/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746129828.039007:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.039011:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00002000:00100000:2.0:1746129828.039013:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be64e00 with x1830949054586880 ext(4194304->4931583) 00002000:00010000:2.0:1746129828.039017:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be64e00 00010000:00010000:3.0:1746129828.039020:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244700) 00010000:00010000:3.0:1746129828.039022:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.039024:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.039027:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f87a200/0x48868a4e4395661d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00000100:00080000:0.0:1746129828.039139:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746129828.039623:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e4395660f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd7 expref: 286 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.039638:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43956624 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd7 expref: 285 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.039644:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.039646:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746129828.039648:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1ab200, rc 0) 00000100:00100000:3.0:1746129828.039761:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31838:x1830949054587136:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1221us (1402us total) trans 8589945174 rc 0/0 00000100:00100000:3.0:1746129828.039767:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11146 00000100:00100000:3.0:1746129828.040718:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054586624:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15079us (15409us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.040726:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7221 00002000:00100000:3.0:1746129828.040733:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009be66300 x1830949054586624/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.040741:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be66300 with x1830949054586624 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.040745:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009be66300 00000100:00100000:0.0:1746129828.045741:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.045781:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.045819:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.045938:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054587648 00000100:00100000:1.0:1746129828.045946:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054587648 00000100:00100000:3.0:1746129828.045956:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054587520 00000100:00100000:3.0:1746129828.045960:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054587520 00000100:00100000:1.0:1746129828.045980:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16012 00000100:00100000:1.0:1746129828.045985:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:31838:x1830949054587648:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:3.0:1746129828.046000:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4685 00000100:00100000:3.0:1746129828.046006:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:31833:x1830949054587520:12345-192.168.204.31@tcp:35:cat.0 00010000:00010000:1.0:1746129828.046010:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.046024:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bde expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.046044:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.046051:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.046057:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.046062:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.046064:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.046066:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1327104->1445887] (req 1327104->1445887) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.046091:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 18 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.046100:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 18 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.046110:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054115584:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.046346:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054587776 00000100:00100000:2.0:1746129828.046350:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054587776 00002000:00100000:2.0:1746129828.046374:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009be65880 x1830949054587776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.046382:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65880 with x1830949054587776 ext(4194304->4931583) 00002000:00010000:2.0:1746129828.046386:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be65880 00000100:00100000:2.0:1746129828.046400:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7223 00000100:00100000:2.0:1746129828.046405:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054587776:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129828.046448:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31833:x1830949054587520:12345-192.168.204.31@tcp:35:cat.0 Request processed in 441us (665us total) trans 8589945175 rc 0/0 00000100:00100000:3.0:1746129828.046455:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4685 00010000:00010000:1.0:1746129828.047129:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.047142:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.047151:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054115712:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.047183:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.047190:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 9 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.047198:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054115840:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.047214:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584840 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.048598:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054115584:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.049431:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054115712:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.049441:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054115840:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.049462:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1327104->1445887] (req 1327104->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.049476:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00000100:00100000:1.0:1746129828.049507:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31838:x1830949054587648:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3522us (3774us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.049514:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16012 00000100:00100000:0.0:1746129828.051294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.051536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.051595:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054587904 00000100:00100000:2.0:1746129828.051602:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054587904 00000100:00100000:1.0:1746129828.051613:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054588160 00000100:00100000:1.0:1746129828.051617:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054588160 00010000:00010000:1.0:1746129828.051631:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.051636:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 19 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.051758:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8011 00000100:00100000:2.0:1746129828.051765:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054588160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.051778:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.051800:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.051811:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.051829:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fe00/0x48868a4e439565de lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ba6 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.051841:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8012 00000100:00100000:3.0:1746129828.051922:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1962:x1830949054587904:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.051929:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.051939:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 19 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.051947:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 19 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.051958:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1ee00/0x48868a4e439565d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b9f expref: 19 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.051968:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.052044:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054587904:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 195us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.052050:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8012 00010000:00010000:2.0:1746129828.052122:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.052141:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054588160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 377us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.052147:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8011 00000100:00100000:1.0:1746129828.052409:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.052838:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054588032 00000100:00100000:3.0:1746129828.052843:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054588032 00010000:00010000:3.0:1746129828.052890:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746129828.052905:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8013 00000100:00100000:3.0:1746129828.052911:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054588032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.052918:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.052925:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.052958:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.052972:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c15200/0x48868a4e439564a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b05 expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00000100:00080000:0.0:1746129828.052972:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746129828.052980:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.052982:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.052997:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.053005:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.053033:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.053043:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054115968:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.053096:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.053606:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1962:x1830949054587776:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 7199us (7785us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129828.053613:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7223 00002000:00100000:2.0:1746129828.053621:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009be65880 x1830949054587776/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 737280/737280 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.053629:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009be65880 with x1830949054587776 ext(4194304->4931583) 00002000:00010000:2.0:1746129828.053633:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009be65880 00000100:00100000:3.0:1746129828.054548:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054115968:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.054777:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.055034:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1963:x1830949054588032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2121us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.055041:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8013 00000100:00100000:0.0:1746129828.055285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.055792:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054588416 00000100:00100000:2.0:1746129828.055798:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054588416 00002000:00100000:2.0:1746129828.055827:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1327104->1331199) req@ffff8800a645ce00 x1830949054588416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.055835:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ce00 with x1830949054588416 ext(1327104->1331199) 00002000:00010000:2.0:1746129828.055840:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645ce00 00000100:00100000:2.0:1746129828.055888:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7224 00000100:00100000:2.0:1746129828.055894:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054588416:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129828.056116:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054588416:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 221us (831us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.056122:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7224 00002000:00100000:2.0:1746129828.056126:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1327104->1331199) req@ffff8800a645ce00 x1830949054588416/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.056133:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645ce00 with x1830949054588416 ext(1327104->1331199) 00002000:00010000:2.0:1746129828.056135:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645ce00 00000100:00100000:0.0:1746129828.060264:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.060438:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.060513:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054588672 00000100:00100000:3.0:1746129828.060521:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054588672 00000100:00100000:3.0:1746129828.060560:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4686 00000100:00100000:3.0:1746129828.060567:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31832:x1830949054588672:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129828.060742:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31832:x1830949054588672:12345-192.168.204.31@tcp:35:cat.0 Request processed in 175us (484us total) trans 8589945176 rc 0/0 00000100:00100000:3.0:1746129828.060748:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4686 00000100:00100000:2.0:1746129828.061122:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054588928 00000100:00100000:2.0:1746129828.061125:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054588928 00002000:00100000:2.0:1746129828.061146:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1441792->1445887) req@ffff8800a645c380 x1830949054588928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.061154:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c380 with x1830949054588928 ext(1441792->1445887) 00002000:00010000:2.0:1746129828.061158:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c380 00000100:00100000:2.0:1746129828.061167:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7225 00000100:00100000:2.0:1746129828.061171:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054588928:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129828.061282:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1964:x1830949054588928:12345-192.168.204.31@tcp:3:cat.0 Request processed in 109us (844us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.061291:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7225 00002000:00100000:2.0:1746129828.061296:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1441792->1445887) req@ffff8800a645c380 x1830949054588928/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.061302:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a645c380 with x1830949054588928 ext(1441792->1445887) 00002000:00010000:2.0:1746129828.061305:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a645c380 00000100:00100000:0.0:1746129828.062976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.063062:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054589184 00000100:00100000:3.0:1746129828.063066:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054589184 00000100:00100000:3.0:1746129828.063090:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4687 00000100:00100000:3.0:1746129828.063095:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+286:31838:x1830949054589184:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129828.063240:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31838:x1830949054589184:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 144us (268us total) trans 8589945177 rc 0/0 00000100:00100000:3.0:1746129828.063245:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4687 00000100:00100000:0.0:1746129828.080341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.080447:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054589312 00000100:00100000:3.0:1746129828.080456:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054589312 00000100:00080000:0.0:1746129828.080547:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746129828.080612:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11147 00000100:00100000:3.0:1746129828.080621:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+6:31842:x1830949054589312:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129828.080640:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.080655:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43956639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356be5 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.080709:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080719:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080729:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080740:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080745:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080750:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080837:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080906:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.080914:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.080945:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.080958:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 9 pid: 16808 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.080973:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054116096:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.081069:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.085979:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.086129:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054116096:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.086153:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129828.086231:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054589568 00000100:00100000:2.0:1746129828.086237:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054589568 00000100:00100000:2.0:1746129828.086274:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4688 00000100:00100000:2.0:1746129828.086281:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:27194:x1830949054589568:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746129828.086820:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:27194:x1830949054589568:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 537us (847us total) trans 8589945178 rc 0/0 00000100:00100000:2.0:1746129828.086827:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4688 00000100:00100000:0.0:1746129828.090088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.090279:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054589696 00000100:00100000:3.0:1746129828.090286:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054589696 00010000:00010000:3.0:1746129828.090319:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 11 pid: 16808 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.090353:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8014 00000100:00100000:3.0:1746129828.090361:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1961:x1830949054589696:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.090373:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.090379:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 11 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.090388:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 11 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.090405:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f8fa800/0x48868a4e4395654b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b36 expref: 11 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.090431:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.090436:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090447:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090453:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090472:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.090505:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054589696:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.090510:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8014 00010000:00010000:3.0:1746129828.090531:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090537:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129828.090569:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129828.090572:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129828.090586:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090594:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090602:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090607:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090613:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090620:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aac00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.090624:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090629:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090636:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129828.090638:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.090640:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090644:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aac00/0x48868a4e43956640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090652:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090656:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090660:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090663:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e1aae00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.090665:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090670:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090675:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244c00) 00010000:00010000:3.0:1746129828.090677:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.090679:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090683:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aae00/0x48868a4e43956647 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.090718:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1aa200/0x48868a4e43956639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.090728:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 7 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.090734:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.090736:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129828.090738:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e1abc00, rc 0) 00000100:00100000:3.0:1746129828.090761:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31842:x1830949054589312:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 10143us (10427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.090767:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11147 00000100:00100000:0.0:1746129828.092817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.092906:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.093521:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054589952 00000100:00100000:3.0:1746129828.093529:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054589952 00000100:00100000:3.0:1746129828.093572:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11148 00000100:00100000:3.0:1746129828.093579:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:31844:x1830949054589952:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129828.093598:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.093612:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04c00/0x48868a4e43956655 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bec expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.093693:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093703:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093712:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093723:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093728:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093733:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093820:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093827:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093833:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129828.093840:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129828.093918:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093924:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093928:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093932:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf05000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.093935:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093940:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093948:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129828.093950:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.093952:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093956:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05000/0x48868a4e4395665c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093964:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093968:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093972:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093976:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012bf04400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.093977:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093981:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.093996:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244100) 00010000:00010000:3.0:1746129828.093998:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.094000:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.094004:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04400/0x48868a4e43956663 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.094035:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04c00/0x48868a4e43956655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.094045:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.094051:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.094052:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129828.094054:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04200, rc 0) 00000100:00100000:3.0:1746129828.094088:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:31844:x1830949054589952:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 510us (1276us total) trans 8589945179 rc 0/0 00000100:00100000:3.0:1746129828.094093:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11148 00000100:00100000:2.0:1746129828.094230:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.094261:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.094284:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590080 00000100:00100000:2.0:1746129828.094287:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590080 00000100:00100000:2.0:1746129828.094306:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590208 00000100:00100000:2.0:1746129828.094308:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590208 00000100:00100000:2.0:1746129828.094318:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590336 00000100:00100000:2.0:1746129828.094319:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590336 00000100:00100000:0.0:1746129828.094323:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16013 00000100:00100000:0.0:1746129828.094329:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054590080:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:2.0:1746129828.094332:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16014 00000100:00100000:2.0:1746129828.094336:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054590208:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129828.094337:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.094340:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.094345:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a061800/0x48868a4e43956678 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bf3 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.094346:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356bfa expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.094358:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.094360:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.094366:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.094375:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 12 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.094381:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa4600, rc 0) 00000100:00100000:0.0:1746129828.094381:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a645ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116224:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129828.094398:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054590208:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.094403:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16014 00000100:00100000:2.0:1746129828.094412:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16015 00000100:00100000:0.0:1746129828.094414:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.094416:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054590336:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129828.094421:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.094429:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c01 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.094437:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.094438:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.094442:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.094451:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 11 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.094462:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa5600, rc 0) 00000100:00100000:2.0:1746129828.094477:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054590336:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.094481:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16015 00000100:00100000:2.0:1746129828.097633:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a645ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116224:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.097668:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a061800/0x48868a4e43956678 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bf3 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.097681:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a061800/0x48868a4e43956678 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bf3 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.097720:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a061800, rc 0) 00000100:00100000:2.0:1746129828.097791:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054590080:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3459us (4882us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.097799:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16013 00000100:00100000:0.0:1746129828.100957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.101061:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590592 00000100:00100000:3.0:1746129828.101069:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590592 00000100:00100000:3.0:1746129828.101115:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11149 00000100:00100000:3.0:1746129828.101125:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:31842:x1830949054590592:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129828.101143:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.101162:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e4395668d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c08 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.101406:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129828.101418:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.101433:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.101439:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129828.101464:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.101473:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 11 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.101484:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054116352:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.101611:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 8 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.101620:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 8 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.101629:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054116480:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.101652:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.104159:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.104275:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590720 00000100:00100000:2.0:1746129828.104283:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590720 00010000:00010000:2.0:1746129828.104316:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 12 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.104381:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8015 00000100:00100000:2.0:1746129828.104388:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+12:1962:x1830949054590720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.104399:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.104404:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 12 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.104410:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054116352:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.104414:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 12 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.104432:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04200/0x48868a4e4395666a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bec expref: 12 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.104453:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.104458:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.104465:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.104470:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.104505:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054590720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 117us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.104511:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8015 00000100:00100000:3.0:1746129828.104561:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054116480:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.104581:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129828.105039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.105102:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590848 00000100:00100000:2.0:1746129828.105106:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590848 00010000:00010000:2.0:1746129828.105117:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 9 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.105141:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8016 00000100:00100000:2.0:1746129828.105146:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009be67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054590848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.105154:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.105157:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 9 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.105169:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 9 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.105179:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1abc00/0x48868a4e4395664e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356be5 expref: 9 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.105186:0:16449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.105189:0:16449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.105195:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.105200:0:16449:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.105214:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.105243:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009be67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054590848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 96us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.105248:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8016 00010000:00010000:0.0:1746129828.105320:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129828.105325:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129828.105339:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:0.0:1746129828.105442:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf05c00/0x48868a4e4395668d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.105457:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.105467:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:0.0:1746129828.105469:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746129828.105471:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04a00, rc 0) 00000100:00100000:0.0:1746129828.105491:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a645c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31842:x1830949054590592:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4370us (4541us total) trans 8589945180 rc 0/0 00000100:00100000:0.0:1746129828.105497:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11149 00000100:00100000:0.0:1746129828.107454:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.107528:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054590976 00000100:00100000:2.0:1746129828.107536:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054590976 00000100:00100000:2.0:1746129828.107601:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11150 00000100:00100000:2.0:1746129828.107612:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31842:x1830949054590976:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129828.107631:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.107649:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439566a2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c0f expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.107723:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.107739:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.107745:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.107774:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.107785:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 9 pid: 16808 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.107797:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054116608:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.107933:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.109681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.109818:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054591104 00000100:00100000:3.0:1746129828.109824:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054591104 00010000:00010000:3.0:1746129828.109869:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 10 pid: 16808 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.109891:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8017 00000100:00100000:3.0:1746129828.109897:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054591104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.109908:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129828.109909:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054116608:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.109912:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 10 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.109920:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 10 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.109930:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129828.109938:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bf04a00/0x48868a4e43956694 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c08 expref: 10 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.110359:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.110364:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129828.110372:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129828.110377:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129828.110392:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129828.110416:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129828.110419:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054591104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 522us (744us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129828.110424:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129828.110425:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8017 00000004:00200000:2.0:1746129828.110457:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129828.110463:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129828.110477:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.110508:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439566a2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.110523:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.110529:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.110531:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129828.110534:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093360c00, rc 0) 00000100:00100000:2.0:1746129828.110589:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31842:x1830949054590976:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2978us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.110596:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11150 00000100:00100000:2.0:1746129828.114534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.114718:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054591232 00000100:00100000:0.0:1746129828.114726:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054591232 00000100:00100000:0.0:1746129828.114795:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16016 00000100:00100000:0.0:1746129828.114804:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054591232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129828.114817:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.114830:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a061000/0x48868a4e439566b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c16 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129828.114882:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116736:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129828.115055:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.118615:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009206ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116736:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129828.118648:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a061000/0x48868a4e439566b0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c16 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.118659:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a061000/0x48868a4e439566b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c16 expref: 11 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.118684:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a061000, rc 0) 00000100:00100000:3.0:1746129828.118733:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054591232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3929us (4204us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129828.118740:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16016 00000100:00100000:0.0:1746129828.122531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.123678:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054591488 00000100:00100000:2.0:1746129828.123688:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054591488 00000100:00100000:2.0:1746129828.123737:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11151 00000100:00100000:2.0:1746129828.123747:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31842:x1830949054591488:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129828.123766:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.123785:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439566b7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c1d expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.124214:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124230:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124240:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124252:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124259:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124265:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124270:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa4800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129828.124273:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124278:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124289:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.124291:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746129828.124295:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124299:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439566be lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129828.124746:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439566b7 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c1d expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.124755:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439566b7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c1d expref: 9 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.124764:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa5200, rc 0) 00000100:00100000:2.0:1746129828.125157:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009206ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31842:x1830949054591488:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1409us (2628us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.125165:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11151 00000100:00100000:0.0:1746129828.128799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.129305:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054591744 00000100:00100000:2.0:1746129828.129371:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054591744 00000100:00100000:2.0:1746129828.129418:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4689 00000100:00100000:2.0:1746129828.129425:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31842:x1830949054591744:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129828.130014:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31842:x1830949054591744:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 585us (1222us total) trans 8589945181 rc 0/0 00000100:00100000:2.0:1746129828.130021:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4689 00000100:00100000:0.0:1746129828.163400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.163484:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054591872 00000100:00100000:3.0:1746129828.163492:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054591872 00000100:00100000:3.0:1746129828.163535:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16017 00000100:00100000:3.0:1746129828.163541:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31844:x1830949054591872:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129828.163556:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.163569:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c24 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.163590:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.163597:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.163603:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.163613:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.163615:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.163618:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [393216->1048575] (req 393216->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.163640:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 19 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.163649:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 19 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.163659:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116864:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.163733:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.163740:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 24 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.163746:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116992:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.163957:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 9 pid: 1140 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.163964:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 9 pid: 1140 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746129828.163976:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054117120:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.164578:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.166439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.166650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.166662:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054592128 00000100:00100000:3.0:1746129828.166668:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054592128 00000100:00100000:0.0:1746129828.166668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.166690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.166714:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054592384 00000100:00100000:3.0:1746129828.166716:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054592384 00010000:00010000:3.0:1746129828.166729:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 25 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.166741:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054592256 00000100:00100000:3.0:1746129828.166742:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054592256 00010000:00010000:3.0:1746129828.166748:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 20 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.166752:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11152 00000100:00100000:3.0:1746129828.166755:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054592512 00000100:00100000:3.0:1746129828.166756:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054592512 00010000:00010000:3.0:1746129828.166761:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 10 pid: 1140 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.166763:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:31848:x1830949054592128:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129828.166767:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8018 00000100:00100000:3.0:1746129828.166771:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054592384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.166778:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.166779:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.166791:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439566cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c2b expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.166792:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 25 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.166798:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 25 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.166812:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.166833:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1963:x1830949054592384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.166837:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8018 00000100:00100000:3.0:1746129828.166863:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8019 00000100:00100000:3.0:1746129828.166867:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054592256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.166871:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.166876:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 20 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.166880:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116864:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.166881:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 20 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.166885:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.166887:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800acc1fa00/0x48868a4e43956552 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b2f expref: 20 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.166888:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095230000/0x48868a4e43956559 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b3d expref: 24 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.166895:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746129828.166895:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00000100:00100000:2.0:1746129828.166901:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054116992:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.166903:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054592256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 36us (235us total) trans 0 rc 0/0 00010000:00010000:1.0:1746129828.166903:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129828.166906:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8019 00000100:00100000:3.0:1746129828.166911:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8020 00010000:00010000:1.0:1746129828.166913:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129828.166914:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054592512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.166917:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.166918:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.166920:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 10 pid: 1140 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746129828.166923:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.166925:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 10 pid: 1140 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746129828.166925:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054117120:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.166931:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01a00/0x48868a4e43956487 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af0 expref: 10 pid: 1140 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.166935:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.166936:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.166941:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.166946:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.166957:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.166961:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.166966:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04800, rc 0) 00000100:00100000:3.0:1746129828.166967:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054117248:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129828.166983:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a04ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31844:x1830949054591872:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3443us (3590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.167002:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16017 00000100:00100000:3.0:1746129828.167007:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4092780 going to sleep for 11 seconds 00010000:00010000:1.0:1746129828.167025:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167035:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167040:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.167046:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.167112:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167117:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167122:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167126:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.167129:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167134:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167140:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129828.167142:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.167145:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167149:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11600/0x48868a4e439566d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167159:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167166:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167170:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167173:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11e00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.167175:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167179:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167184:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8300) 00010000:00010000:1.0:1746129828.167185:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.167187:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167190:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e439566da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.167218:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e439566cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 14 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.167227:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.167232:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.167234:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129828.167235:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00000100:00100000:1.0:1746129828.167270:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31848:x1830949054592128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 510us (835us total) trans 8589945182 rc 0/0 00000100:00100000:1.0:1746129828.167276:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11152 00000100:00100000:3.0:1746129828.168427:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054117248:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.168436:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.168458:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054592512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1543us (1766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.168469:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8020 00000100:00100000:0.0:1746129828.169591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.169700:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054592768 00000100:00100000:3.0:1746129828.169705:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054592768 00002000:00100000:3.0:1746129828.169735:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (393216->397311) req@ffff88009fbee300 x1830949054592768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.169743:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbee300 with x1830949054592768 ext(393216->397311) 00002000:00010000:3.0:1746129828.169747:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbee300 00000100:00100000:3.0:1746129828.169770:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7226 00000100:00100000:3.0:1746129828.169775:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054592768:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129828.169924:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1962:x1830949054592768:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 148us (334us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129828.169930:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7226 00002000:00100000:3.0:1746129828.169934:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (393216->397311) req@ffff88009fbee300 x1830949054592768/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.169940:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbee300 with x1830949054592768 ext(393216->397311) 00002000:00010000:3.0:1746129828.169942:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbee300 00000100:00100000:0.0:1746129828.171223:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.171295:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054592896 00000100:00100000:2.0:1746129828.171299:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054592896 00000100:00100000:2.0:1746129828.171404:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16018 00000100:00100000:2.0:1746129828.171410:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054592896:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.171420:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.171430:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e439566ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c32 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.171467:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054117376:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129828.171625:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.175907:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054117376:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.175932:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e439566ef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c32 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.175945:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093360800/0x48868a4e439566ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c32 expref: 19 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.175974:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093360800, rc 0) 00000100:00100000:2.0:1746129828.176027:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1961:x1830949054592896:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4615us (4805us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.176034:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16018 00000100:00100000:0.0:1746129828.176811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.176869:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054593024 00000100:00100000:2.0:1746129828.176877:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054593024 00000100:00100000:2.0:1746129828.176908:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16019 00000100:00100000:2.0:1746129828.176913:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31844:x1830949054593024:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129828.176969:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.176981:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c39 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.177013:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.177021:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.177026:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.177031:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.177032:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.177035:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.177055:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.177065:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.177073:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054117504:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.177117:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.177125:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 33 pid: 20441 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.177131:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054117632:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.177151:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 10 pid: 20441 timeout: 0 lvb_type: 1 00000100:00080000:0.0:1746129828.177177:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746129828.177295:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746129828.177304:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054117760:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.177389:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.180122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.180153:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba39500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054117504:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129828.180155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.180164:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054117632:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.180171:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054117760:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129828.180181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129828.180199:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [1048576->1130495] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.180212:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800924f9e00, rc 0) 00000100:00100000:2.0:1746129828.180265:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31844:x1830949054593024:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3350us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.180272:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16019 00000100:00100000:1.0:1746129828.180274:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054593152 00000100:00100000:1.0:1746129828.180280:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054593152 00010000:00010000:1.0:1746129828.180304:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.180326:0:10980:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054593408 00000100:00100000:1.0:1746129828.180328:0:10980:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054593408 00010000:00010000:1.0:1746129828.180337:0:10980:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 11 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.180348:0:10980:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8021 00000100:00100000:1.0:1746129828.180353:0:10980:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054593152:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129828.180363:0:10980:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.180379:0:10980:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.180388:0:10980:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.180405:0:10980:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4ff3400/0x48868a4e43956591 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b59 expref: 21 pid: 10930 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.180419:0:10980:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129828.180429:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8022 00000100:00100000:1.0:1746129828.180436:0:10980:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054593152:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129828.180436:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1964:x1830949054593408:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746129828.180444:0:10980:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8021 00010000:00010000:0.0:1746129828.180444:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129828.180453:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 11 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.180461:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 11 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.180473:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094c15e00/0x48868a4e4395649c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356af7 expref: 11 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.180495:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129828.180511:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1964:x1830949054593408:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 77us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.180512:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054593536 00000100:00100000:3.0:1746129828.180516:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054593536 00000100:00100000:0.0:1746129828.180517:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8022 00002000:00100000:3.0:1746129828.180541:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->393215) req@ffff88009f938a80 x1830949054593536/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.180548:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830949054593536 ext(0->393215) 00002000:00010000:3.0:1746129828.180551:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:3.0:1746129828.180561:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7227 00000100:00100000:3.0:1746129828.180564:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054593536:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.184010:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.184035:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054593664 00000100:00100000:0.0:1746129828.184041:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054593664 00000100:00100000:1.0:1746129828.184044:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.184061:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054593920 00010000:00010000:0.0:1746129828.184063:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 34 pid: 20441 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.184064:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054593920 00000100:00100000:0.0:1746129828.184086:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8023 00000100:00100000:0.0:1746129828.184091:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054593664:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129828.184101:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129828.184174:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 34 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.184185:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 34 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.184203:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094be4c00/0x48868a4e43956598 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b60 expref: 34 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.184214:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.184216:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.184222:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.184229:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.184257:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.184264:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11153 00000100:00100000:0.0:1746129828.184267:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054117888:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129828.184270:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+287:31850:x1830949054593920:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.184288:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.184300:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439566fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c40 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.184439:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184449:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184457:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184469:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184474:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184479:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184563:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184570:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184576:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.184583:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.184647:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184653:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184658:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184662:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb10800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.184665:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184671:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184677:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129828.184679:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.184682:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184687:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10800/0x48868a4e43956704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184694:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184698:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184706:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184709:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fb11c00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.184711:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184715:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184721:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8a00) 00010000:00010000:1.0:1746129828.184723:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.184725:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184729:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11c00/0x48868a4e4395670b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.184756:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e439566fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 290 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.184765:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 289 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.184770:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.184772:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746129828.184774:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11e00, rc 0) 00000100:00100000:1.0:1746129828.184795:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31850:x1830949054593920:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 525us (752us total) trans 8589945183 rc 0/0 00000100:00100000:0.0:1746129828.184804:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.184862:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11153 00000100:00100000:2.0:1746129828.187396:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054117888:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129828.187414:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.187442:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054593664:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3350us (3438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.187450:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8023 00000100:00100000:0.0:1746129828.187626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.187924:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:1964:x1830949054593536:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7357us (7766us total) trans 0 rc 393216/393216 00000100:00100000:3.0:1746129828.187935:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7227 00002000:00100000:3.0:1746129828.187943:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ed:0x0] (0->393215) req@ffff88009f938a80 x1830949054593536/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 393216/393216 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.187951:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830949054593536 ext(0->393215) 00002000:00010000:3.0:1746129828.187955:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:3.0:1746129828.187969:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054594176 00000100:00100000:3.0:1746129828.187973:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054594176 00002000:00100000:3.0:1746129828.188006:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1126400->1130495) req@ffff88009f938700 x1830949054594176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.188013:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830949054594176 ext(1126400->1130495) 00002000:00010000:3.0:1746129828.188016:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938700 00000100:00100000:3.0:1746129828.188028:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7228 00000100:00100000:3.0:1746129828.188034:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054594176:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.188131:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054594176:12345-192.168.204.31@tcp:3:cat.0 Request processed in 96us (505us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129828.188137:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7228 00002000:00100000:3.0:1746129828.188141:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f2:0x0] (1126400->1130495) req@ffff88009f938700 x1830949054594176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.188147:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938700 with x1830949054594176 ext(1126400->1130495) 00002000:00010000:3.0:1746129828.188149:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938700 00000100:00100000:0.0:1746129828.193925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.194546:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054594432 00000100:00100000:2.0:1746129828.194553:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054594432 00000100:00100000:0.0:1746129828.194564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.194632:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4690 00000100:00100000:2.0:1746129828.194640:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+13:31844:x1830949054594432:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129828.194804:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054594688 00000100:00100000:3.0:1746129828.194808:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054594688 00002000:00100000:3.0:1746129828.194845:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1130496->2097151) req@ffff88009f938e00 x1830949054594688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.194890:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830949054594688 ext(1130496->2097151) 00002000:00010000:3.0:1746129828.194898:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938e00 00000100:00100000:3.0:1746129828.194921:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7229 00000100:00100000:3.0:1746129828.194927:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054594688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129828.195434:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31844:x1830949054594432:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 794us (1514us total) trans 8589945184 rc 0/0 00000100:00100000:2.0:1746129828.195441:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4690 00000100:00100000:0.0:1746129828.196109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.196177:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054594816 00000100:00100000:2.0:1746129828.196180:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054594816 00000100:00100000:2.0:1746129828.196834:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16020 00000100:00100000:2.0:1746129828.196842:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31850:x1830949054594816:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129828.196879:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.196894:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c47 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.196918:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.196925:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129828.196927:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129828.196931:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1667072->1916927] (req 1667072->1916927) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 34 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.196957:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 21 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.196968:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.196984:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118016:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.197505:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.201973:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118016:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.202012:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1667072->1916927] (req 1667072->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 34 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.202026:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216c00, rc 0) 00000100:00100000:0.0:1746129828.202097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.202749:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1963:x1830949054594688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7820us (8183us total) trans 0 rc 966656/966656 00000100:00100000:2.0:1746129828.202749:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31850:x1830949054594816:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5905us (6637us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.202757:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7229 00000100:00100000:2.0:1746129828.202757:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16020 00002000:00100000:3.0:1746129828.202764:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f2:0x0] (1130496->2097151) req@ffff88009f938e00 x1830949054594688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.202772:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830949054594688 ext(1130496->2097151) 00010000:00010000:3.0:1746129828.202779:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.202791:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.202797:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938e00 00000100:00100000:1.0:1746129828.203126:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054594944 00000100:00100000:1.0:1746129828.203132:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054594944 00002000:00100000:1.0:1746129828.203160:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1130495) req@ffff88008fad1880 x1830949054594944/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.203167:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1880 with x1830949054594944 ext(1048576->1130495) 00010000:00010000:1.0:1746129828.203172:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.203180:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.203185:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad1880 00000100:00100000:1.0:1746129828.203211:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1944 00000100:00100000:1.0:1746129828.203216:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1961:x1830949054594944:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129828.207731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.207753:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054595072 00000100:00100000:2.0:1746129828.207760:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054595072 00000100:00100000:2.0:1746129828.207793:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16021 00000100:00100000:2.0:1746129828.207799:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31848:x1830949054595072:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.207813:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.207826:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c4e expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.207880:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.207888:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129828.207889:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129828.207892:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.207920:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.207931:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.207942:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054118144:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.208025:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.208620:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054594944:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5402us (6523us total) trans 17179874231 rc 0/0 00000100:00100000:1.0:1746129828.208629:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1944 00002000:00100000:1.0:1746129828.208637:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->1130495) req@ffff88008fad1880 x1830949054594944/t17179874231(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.208646:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1880 with x1830949054594944 ext(1048576->1130495) 00010000:00010000:1.0:1746129828.208652:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 22 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.208662:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 22 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.208672:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad1880 00000100:00100000:2.0:1746129828.209320:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054118144:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.209340:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 19 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.209351:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217400, rc 0) 00000100:00100000:2.0:1746129828.209556:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31848:x1830949054595072:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1755us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.209563:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16021 00000100:00100000:0.0:1746129828.209961:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.210054:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054595200 00000100:00100000:1.0:1746129828.210058:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054595200 00002000:00100000:1.0:1746129828.210082:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1327104->1445887) req@ffff8800a022a680 x1830949054595200/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.210089:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a022a680 with x1830949054595200 ext(1327104->1445887) 00010000:00010000:1.0:1746129828.210093:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 24 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.210101:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 24 pid: 8436 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.210107:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a022a680 00000100:00100000:1.0:1746129828.210235:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1945 00000100:00100000:1.0:1746129828.210242:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054595200:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129828.212279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.212413:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054595328 00000100:00100000:3.0:1746129828.212420:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054595328 00010000:00010000:3.0:1746129828.212449:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 22 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.212474:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8024 00000100:00100000:3.0:1746129828.212480:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054595328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.212492:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.212507:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 22 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.212517:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 22 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.212536:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800924f9e00/0x48868a4e439566f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c39 expref: 22 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.212549:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.212551:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.212556:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.212563:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.212587:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.212597:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054118272:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.212642:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.212897:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054595200:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 2654us (2935us total) trans 21474841428 rc 0/0 00000100:00100000:1.0:1746129828.212905:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1945 00002000:00100000:1.0:1746129828.212913:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1327104->1445887) req@ffff8800a022a680 x1830949054595200/t21474841428(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.212921:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a022a680 with x1830949054595200 ext(1327104->1445887) 00010000:00010000:1.0:1746129828.212927:0:21605:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.212943:0:21605:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.212948:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a022a680 00000100:00100000:0.0:1746129828.214702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.214755:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054595456 00000100:00100000:1.0:1746129828.214761:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054595456 00010000:00010000:1.0:1746129828.214784:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.214822:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8025 00000100:00100000:1.0:1746129828.214828:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054595456:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129828.214841:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.214883:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.214894:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.214914:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10a00/0x48868a4e43956632 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1327104->1445887) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bde expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.214940:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.214942:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.214948:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.214960:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.215001:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.215012:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054118400:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129828.215076:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.215291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.215543:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054595712 00000100:00100000:1.0:1746129828.215546:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054595712 00002000:00100000:1.0:1746129828.215568:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1667072->1671167) req@ffff8800a0229c00 x1830949054595712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.215576:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0229c00 with x1830949054595712 ext(1667072->1671167) 00002000:00010000:1.0:1746129828.215579:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0229c00 00000100:00100000:1.0:1746129828.215592:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7230 00000100:00100000:1.0:1746129828.215597:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054595712:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129828.215646:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054118272:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.215664:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.215686:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054595328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3206us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.215693:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8024 00000100:00100000:1.0:1746129828.215701:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054595712:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 104us (410us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129828.215707:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7230 00002000:00100000:1.0:1746129828.215712:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1667072->1671167) req@ffff8800a0229c00 x1830949054595712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.215719:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0229c00 with x1830949054595712 ext(1667072->1671167) 00002000:00010000:1.0:1746129828.215721:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0229c00 00000100:00100000:1.0:1746129828.217797:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054118400:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129828.218024:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129828.218061:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+25:1961:x1830949054595456:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3231us (3363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.218069:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8025 00000100:00100000:0.0:1746129828.221282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.221334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.221346:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054595968 00000100:00100000:1.0:1746129828.221353:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054595968 00002000:00100000:1.0:1746129828.221390:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a0229880 x1830949054595968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.221399:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0229880 with x1830949054595968 ext(1048576->2097151) 00002000:00010000:1.0:1746129828.221404:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0229880 00000100:00100000:1.0:1746129828.221433:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054596224 00000100:00100000:1.0:1746129828.221436:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054596224 00002000:00100000:1.0:1746129828.221447:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1912832->1916927) req@ffff8800a022bb80 x1830949054596224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.221454:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a022bb80 with x1830949054596224 ext(1912832->1916927) 00002000:00010000:1.0:1746129828.221457:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a022bb80 00000100:00100000:3.0:1746129828.221467:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7231 00000100:00100000:1.0:1746129828.221477:0:21605:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7232 00000100:00100000:3.0:1746129828.221479:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054595968:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.221483:0:21605:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054596224:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129828.221616:0:21605:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054596224:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 132us (281us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129828.221622:0:21605:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7232 00002000:00100000:1.0:1746129828.221627:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1912832->1916927) req@ffff8800a022bb80 x1830949054596224/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.221633:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a022bb80 with x1830949054596224 ext(1912832->1916927) 00002000:00010000:1.0:1746129828.221636:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a022bb80 00010000:00010000:2.0:1746129828.225033:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129828.226103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.226189:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054596480 00000100:00100000:2.0:1746129828.226198:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054596480 00000100:00100000:2.0:1746129828.226249:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4691 00000100:00100000:2.0:1746129828.226256:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+289:31850:x1830949054596480:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129828.226691:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31850:x1830949054596480:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 434us (593us total) trans 8589945185 rc 0/0 00000100:00100000:2.0:1746129828.226698:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4691 00000100:00100000:3.0:1746129828.230910:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054595968:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9426us (9625us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.230922:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7231 00002000:00100000:3.0:1746129828.230932:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a0229880 x1830949054595968/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.230941:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0229880 with x1830949054595968 ext(1048576->2097151) 00002000:00010000:3.0:1746129828.230947:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0229880 00000100:00100000:0.0:1746129828.239137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.239231:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054596608 00000100:00100000:2.0:1746129828.239240:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054596608 00000100:00100000:2.0:1746129828.239277:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16022 00000100:00100000:2.0:1746129828.239283:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054596608:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.239298:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.239312:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217600/0x48868a4e4395672e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c55 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.239428:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118528:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129828.240010:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.242105:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118528:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.242132:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217600/0x48868a4e4395672e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c55 expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.242145:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217600/0x48868a4e4395672e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c55 expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.244341:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217600, rc 0) 00000100:00100000:2.0:1746129828.244411:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054596608:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5124us (5278us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.244419:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16022 00000100:00100000:0.0:1746129828.253558:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.253612:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054596736 00000100:00100000:2.0:1746129828.253618:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054596736 00000100:00100000:2.0:1746129828.253658:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16023 00000100:00100000:2.0:1746129828.253666:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054596736:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.253682:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.253696:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5216600/0x48868a4e43956735 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c5c expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.253736:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118656:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129828.253820:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.256401:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118656:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.256430:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216600/0x48868a4e43956735 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c5c expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.256442:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216600/0x48868a4e43956735 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c5c expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.256468:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216600, rc 0) 00000100:00100000:2.0:1746129828.256501:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1963:x1830949054596736:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2835us (2949us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.256509:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16023 00000100:00100000:0.0:1746129828.261455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.262147:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054596864 00000100:00100000:3.0:1746129828.262155:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054596864 00000100:00100000:3.0:1746129828.262200:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16024 00000100:00100000:3.0:1746129828.262207:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054596864:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129828.262221:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.262234:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012bf04400/0x48868a4e4395673c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c63 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.262281:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118784:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129828.262339:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.267521:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054118784:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129828.267555:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012bf04400/0x48868a4e4395673c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c63 expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.267574:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012bf04400/0x48868a4e4395673c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c63 expref: 22 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.267598:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf04400, rc 0) 00000100:00100000:3.0:1746129828.267651:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054596864:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5444us (6203us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129828.267659:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16024 00000100:00100000:0.0:1746129828.274514:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.274619:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054597120 00000100:00100000:2.0:1746129828.274627:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054597120 00000100:00100000:2.0:1746129828.274675:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4692 00000100:00100000:2.0:1746129828.274682:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+14:31848:x1830949054597120:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:2.0:1746129828.275417:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31848:x1830949054597120:12345-192.168.204.31@tcp:35:cat.0 Request processed in 734us (908us total) trans 8589945186 rc 0/0 00000100:00100000:2.0:1746129828.275423:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4692 00000100:00100000:0.0:1746129828.286659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.286829:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054597376 00000100:00100000:1.0:1746129828.286838:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054597376 00000100:00100000:1.0:1746129828.287108:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11154 00000100:00100000:1.0:1746129828.287116:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+290:31855:x1830949054597376:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.287134:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.287147:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c6a expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.287238:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395674a lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.287251:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395674a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.287259:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395674a lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.287269:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.287363:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11200/0x48868a4e43956743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c6a expref: 293 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.287391:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395674a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c6a expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.287398:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.287401:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746129828.287403:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10400, rc 0) 00000100:00100000:1.0:1746129828.287453:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31855:x1830949054597376:12345-192.168.204.31@tcp:101:cat.0 Request processed in 338us (802us total) trans 8589945187 rc 0/0 00000100:00100000:1.0:1746129828.287462:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11154 00000100:00100000:0.0:1746129828.290669:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.290718:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.290797:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054597504 00000100:00100000:1.0:1746129828.290804:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054597504 00000100:00100000:1.0:1746129828.290834:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054597632 00000100:00100000:1.0:1746129828.290836:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054597632 00000100:00100000:1.0:1746129828.290871:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16025 00000100:00100000:3.0:1746129828.290978:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16026 00000100:00100000:3.0:1746129828.290998:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054597632:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129828.291012:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.291024:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c78 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.291044:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.291046:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.291053:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 27 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.291065:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 27 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.291074:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bf05a00, rc 0) 00000100:00100000:3.0:1746129828.291110:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054597632:12345-192.168.204.31@tcp:101:cat.0 Request processed in 126us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.291117:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16026 00000100:00100000:1.0:1746129828.291241:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a022b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054597504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.291248:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.291255:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e4395675f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c71 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.291287:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054118912:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.291385:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.293639:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054118912:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.293662:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e4395675f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c71 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.293674:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb11800/0x48868a4e4395675f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c71 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.293685:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11800, rc 0) 00000100:00100000:1.0:1746129828.293825:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a022b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054597504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2945us (3162us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129828.293833:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16025 00000100:00100000:0.0:1746129828.299952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.300043:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054597760 00000100:00100000:1.0:1746129828.300051:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054597760 00000100:00100000:1.0:1746129828.300491:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16027 00000100:00100000:1.0:1746129828.300499:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:31855:x1830949054597760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.300514:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.300527:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c7f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.300550:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.300556:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.300558:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.300561:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.300585:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.300595:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 18 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.300605:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054119040:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.301351:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.303615:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054119040:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.303637:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 27 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.303652:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10800, rc 0) 00000100:00100000:1.0:1746129828.303689:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31855:x1830949054597760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3190us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.303697:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16027 00000100:00100000:0.0:1746129828.304568:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.305001:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054597888 00000100:00100000:3.0:1746129828.305008:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054597888 00002000:00100000:3.0:1746129828.305046:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (393216->1048575) req@ffff8801305bca80 x1830949054597888/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.305060:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bca80 with x1830949054597888 ext(393216->1048575) 00010000:00010000:3.0:1746129828.305067:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 19 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.305078:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 19 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.305084:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305bca80 00000100:00100000:3.0:1746129828.305172:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1946 00000100:00100000:3.0:1746129828.305179:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1961:x1830949054597888:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129828.317141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.317348:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598144 00000100:00100000:1.0:1746129828.317355:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598144 00000100:00100000:1.0:1746129828.317398:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11155 00000100:00100000:1.0:1746129828.317406:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+15:31858:x1830949054598144:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.317527:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.317543:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x48868a4e4395676d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c86 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317710:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.317722:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317728:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317733:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 291 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317737:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.317760:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 291 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317768:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 291 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.317779:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054119168:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.317867:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317874:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 16 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.317881:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054119296:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.317901:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 8 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.317907:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 8 pid: 16808 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.317913:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054119424:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.317923:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.319894:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054119168:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.319905:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054119296:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.319912:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054119424:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.319929:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:0.0:1746129828.320507:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.320573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.320601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.320628:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598272 00000100:00100000:2.0:1746129828.320634:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598272 00010000:00010000:2.0:1746129828.320658:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 292 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.320688:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598400 00000100:00100000:2.0:1746129828.320690:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598400 00010000:00010000:2.0:1746129828.320698:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 17 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.320708:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598528 00000100:00100000:2.0:1746129828.320710:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598528 00010000:00010000:2.0:1746129828.320716:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 9 pid: 16808 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.320736:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8026 00000100:00100000:2.0:1746129828.320742:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1962:x1830949054598272:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129828.320745:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8027 00010000:00010000:2.0:1746129828.320753:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746129828.320754:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+17:1961:x1830949054598400:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.320757:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 292 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.320759:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.320762:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 17 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.320766:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 292 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.320778:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 17 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.320803:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8028 00000100:00100000:1.0:1746129828.320810:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1961:x1830949054598528:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129828.320819:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.320824:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 9 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.320836:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11e00/0x48868a4e43956712 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c40 expref: 292 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.320838:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb11a00/0x48868a4e439566e1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c2b expref: 17 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.320840:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 9 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.320866:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093360c00/0x48868a4e439566a9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c0f expref: 9 pid: 16808 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.320867:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.320872:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.320879:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.320885:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.320953:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.320956:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.320998:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:1962:x1830949054598272:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 255us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.321004:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8026 00010000:00010000:1.0:1746129828.321060:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.321063:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129828.321070:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129828.321081:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1961:x1830949054598528:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 273us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.321086:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8028 00000100:00100000:3.0:1746129828.321089:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:1961:x1830949054598400:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 338us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.321094:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8027 00010000:00010000:1.0:1746129828.321105:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.321110:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.321124:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000100:00100000:3.0:1746129828.321186:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054597888:12345-192.168.204.31@tcp:4:cat.0 Request processed in 16008us (16620us total) trans 21474841429 rc 0/0 00000100:00100000:3.0:1746129828.321194:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1946 00002000:00100000:3.0:1746129828.321201:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ed:0x0] (393216->1048575) req@ffff8801305bca80 x1830949054597888/t21474841429(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.321209:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801305bca80 with x1830949054597888 ext(393216->1048575) 00010000:00010000:1.0:1746129828.321209:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10e00/0x48868a4e4395676d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 17 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.321216:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.321219:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 16 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.321225:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.321225:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.321227:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129828.321229:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10a00, rc 0) 00002000:00010000:3.0:1746129828.321231:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801305bca80 00000100:00100000:1.0:1746129828.321248:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31858:x1830949054598144:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3843us (4113us total) trans 8589945188 rc 0/0 00000100:00100000:1.0:1746129828.321253:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11155 00000100:00100000:0.0:1746129828.324678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.324731:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.324806:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598656 00000100:00100000:1.0:1746129828.324814:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598656 00000100:00100000:1.0:1746129828.324879:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16028 00000100:00100000:1.0:1746129828.324887:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31858:x1830949054598656:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.324901:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.324914:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c8d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.324939:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.324946:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.324952:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.324957:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.324959:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.324961:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2183168->2240511] (req 2183168->2240511) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.325002:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.325010:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.325021:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054119552:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.325084:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 9 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.325090:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 9 pid: 3624 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.325097:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054119680:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.325115:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.325122:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 33 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.325128:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054119808:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.325139:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584240 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.325334:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598784 00000100:00100000:3.0:1746129828.325338:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598784 00010000:00010000:3.0:1746129828.325357:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.325375:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8029 00000100:00100000:3.0:1746129828.325380:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054598784:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.325388:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.325404:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.325412:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.325426:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf04800/0x48868a4e439566c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 393216->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c24 expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.325438:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.325440:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.325445:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.325451:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.325469:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 26 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.325478:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054119936:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.325503:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.327821:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054119552:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.327832:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054119680:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.327838:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054119808:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.327868:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054119936:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129828.327877:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2183168->2240511] (req 2183168->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 22 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.327885:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129828.327889:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11c00, rc 0) 00000100:00100000:3.0:1746129828.327912:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054598784:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2532us (3180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.327912:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31858:x1830949054598656:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3026us (3241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.327919:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8029 00000100:00100000:2.0:1746129828.327919:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16028 00000100:00100000:0.0:1746129828.329898:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.329944:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054599040 00000100:00100000:3.0:1746129828.329951:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054599040 00010000:00010000:3.0:1746129828.329977:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 34 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.330020:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8030 00000100:00100000:3.0:1746129828.330027:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054599040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.330083:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.330102:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 34 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.330113:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 34 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.330133:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801373f9c00/0x48868a4e439565fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc2 expref: 34 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.330147:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.330184:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1962:x1830949054599040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 158us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.330191:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8030 00000100:00100000:0.0:1746129828.330906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.330943:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054598912 00000100:00100000:3.0:1746129828.330947:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054598912 00010000:00010000:3.0:1746129828.330961:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 10 pid: 3624 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746129828.330997:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8031 00000100:00100000:3.0:1746129828.331002:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054598912:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.331009:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.331017:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 10 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.331025:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 10 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.331035:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e43956686 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c01 expref: 10 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.331044:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.331073:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054598912:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.331078:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8031 00000100:00100000:0.0:1746129828.334035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.334117:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054599168 00000100:00100000:1.0:1746129828.334124:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054599168 00010000:00010000:1.0:1746129828.334149:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.334189:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8032 00000100:00100000:1.0:1746129828.334196:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054599168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129828.334206:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.334224:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.334236:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.334252:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091f32600/0x48868a4e43956601 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bc9 expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.334263:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.334265:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.334271:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.334278:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.334600:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.334611:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054120064:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129828.335225:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.337131:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.337343:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.337368:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.337377:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054120064:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129828.337391:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129828.337394:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.337409:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054599424 00000100:00100000:0.0:1746129828.337414:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054599424 00000100:00100000:1.0:1746129828.337422:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054599168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3226us (3395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.337430:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8032 00002000:00100000:0.0:1746129828.337446:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880094eb4380 x1830949054599424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129828.337455:0:21605:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054599680 00002000:00100000:0.0:1746129828.337455:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4380 with x1830949054599424 ext(0->1048575) 00000100:00100000:1.0:1746129828.337458:0:21605:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054599680 00002000:00010000:0.0:1746129828.337458:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4380 00002000:00100000:1.0:1746129828.337613:0:21605:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094eb7480 x1830949054599680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 504/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.337621:0:21605:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7480 with x1830949054599680 ext(1048576->2097151) 00002000:00010000:1.0:1746129828.337624:0:21605:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7480 00000100:00100000:0.0:1746129828.337894:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054600064 00000100:00100000:0.0:1746129828.337898:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054600064 00000100:00100000:2.0:1746129828.337904:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054600192 00000100:00100000:2.0:1746129828.337908:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054600192 00002000:00100000:0.0:1746129828.337911:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2183168->2187263) req@ffff88009adae300 x1830949054600064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129828.337918:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae300 with x1830949054600064 ext(2183168->2187263) 00002000:00010000:0.0:1746129828.337921:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adae300 00002000:00100000:2.0:1746129828.337923:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009adae680 x1830949054600192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.337929:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae680 with x1830949054600192 ext(1048576->2097151) 00000100:00100000:0.0:1746129828.337930:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7233 00002000:00010000:2.0:1746129828.337932:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adae680 00000100:00100000:0.0:1746129828.337935:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054599424:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129828.337949:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7234 00000100:00100000:2.0:1746129828.337954:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054599680:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.338477:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7235 00000100:00100000:3.0:1746129828.338489:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7236 00000100:00100000:3.0:1746129828.338501:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054600192:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.339528:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054600064:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129828.339600:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054600064:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1116us (2230us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129828.339607:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7235 00002000:00100000:3.0:1746129828.339613:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2183168->2187263) req@ffff88009adae300 x1830949054600064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.339620:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae300 with x1830949054600064 ext(2183168->2187263) 00002000:00010000:3.0:1746129828.339624:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adae300 00000100:00100000:2.0:1746129828.345755:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1963:x1830949054599680:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7792us (8403us total) trans 0 rc 798720/798720 00000100:00100000:2.0:1746129828.345765:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7234 00002000:00100000:2.0:1746129828.345776:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff880094eb7480 x1830949054599680/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 504/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.345784:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb7480 with x1830949054599680 ext(1048576->2097151) 00002000:00010000:2.0:1746129828.345789:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb7480 00000100:00100000:3.0:1746129828.351544:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054600192:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13042us (14141us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.351555:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7236 00002000:00100000:3.0:1746129828.351565:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009adae680 x1830949054600192/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.351573:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adae680 with x1830949054600192 ext(1048576->2097151) 00002000:00010000:3.0:1746129828.351578:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adae680 00000100:00100000:0.0:1746129828.353036:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.353438:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054600448 00000100:00100000:3.0:1746129828.353445:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054600448 00002000:00100000:3.0:1746129828.353477:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2236416->2240511) req@ffff88009adac000 x1830949054600448/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.353486:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac000 with x1830949054600448 ext(2236416->2240511) 00002000:00010000:3.0:1746129828.353490:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac000 00000100:00100000:3.0:1746129828.353516:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7237 00000100:00100000:3.0:1746129828.353522:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054600448:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129828.353651:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054600448:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 129us (623us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129828.353657:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7237 00002000:00100000:3.0:1746129828.353662:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2236416->2240511) req@ffff88009adac000 x1830949054600448/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.353668:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adac000 with x1830949054600448 ext(2236416->2240511) 00002000:00010000:3.0:1746129828.353670:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adac000 00000100:00100000:1.0:1746129828.353822:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054599424:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15886us (16696us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.353829:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7233 00002000:00100000:1.0:1746129828.353834:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff880094eb4380 x1830949054599424/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.353840:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb4380 with x1830949054599424 ext(0->1048575) 00002000:00010000:1.0:1746129828.353843:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094eb4380 00000100:00100000:0.0:1746129828.370423:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.370551:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054600704 00000100:00100000:1.0:1746129828.370559:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054600704 00002000:00100000:1.0:1746129828.370595:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009adadf80 x1830949054600704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.370605:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadf80 with x1830949054600704 ext(2097152->3145727) 00002000:00010000:1.0:1746129828.370609:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadf80 00000100:00100000:1.0:1746129828.370639:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7238 00000100:00100000:1.0:1746129828.370647:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054600704:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.380379:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1964:x1830949054600704:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9725us (9955us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.380390:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7238 00002000:00100000:1.0:1746129828.380400:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009adadf80 x1830949054600704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.380408:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adadf80 with x1830949054600704 ext(2097152->3145727) 00002000:00010000:1.0:1746129828.380413:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adadf80 00000100:00100000:0.0:1746129828.386082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.386338:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054600832 00000100:00100000:2.0:1746129828.386346:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054600832 00000100:00100000:2.0:1746129828.386392:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16029 00000100:00100000:2.0:1746129828.386400:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31855:x1830949054600832:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.386414:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.386428:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c94 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.386452:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.386458:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129828.386460:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129828.386462:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.386485:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.386495:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 20 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.386505:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054120192:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.386591:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.395886:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1830949054120192:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129828.395913:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.395937:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054600960 00000100:00100000:1.0:1746129828.395943:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054600960 00010000:00010000:2.0:1746129828.395973:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746129828.395978:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2183168->2240511) req@ffff8800926a0700 x1830949054600960/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.396013:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a0700 with x1830949054600960 ext(2183168->2240511) 00010000:00010000:1.0:1746129828.396019:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 21 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.396031:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 21 pid: 8436 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.396038:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800926a0700 00000100:00100000:1.0:1746129828.396055:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1947 00000100:00100000:1.0:1746129828.396062:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054600960:12345-192.168.204.31@tcp:4:multiop.0 00010000:00010000:2.0:1746129828.396200:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fae7400, rc 0) 00000100:00100000:2.0:1746129828.396224:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31855:x1830949054600832:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9824us (10149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.396230:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16029 00000100:00100000:1.0:1746129828.398510:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054600960:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 2441us (2590us total) trans 17179874232 rc 0/0 00000100:00100000:1.0:1746129828.398523:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1947 00002000:00100000:1.0:1746129828.398531:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2183168->2240511) req@ffff8800926a0700 x1830949054600960/t17179874232(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.398539:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a0700 with x1830949054600960 ext(2183168->2240511) 00010000:00010000:1.0:1746129828.398547:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.398565:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.398572:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800926a0700 00000100:00100000:0.0:1746129828.399950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.400939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.401098:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054601216 00000100:00100000:1.0:1746129828.401104:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054601216 00000100:00100000:2.0:1746129828.401340:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054601344 00000100:00100000:2.0:1746129828.401344:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054601344 00010000:00010000:2.0:1746129828.401364:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.401605:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11156 00000100:00100000:1.0:1746129828.401613:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+16:31862:x1830949054601216:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.401631:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.401644:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e43956790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356c9b expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.401725:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401736:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401745:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401759:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401764:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401769:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401877:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439567a5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401884:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439567a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401891:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439567a5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.401898:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.401961:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401967:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401971:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401977:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373f8200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.401980:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.401997:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402006:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129828.402009:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.402012:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402017:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e43956797 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402038:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402042:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402047:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402051:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa5600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.402052:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402057:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402063:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8200) 00010000:00010000:1.0:1746129828.402065:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.402066:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402070:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e4395679e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.402099:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e43956790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c9b expref: 19 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.402109:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439567a5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c9b expref: 18 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.402115:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.402116:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129828.402119:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa5200, rc 0) 00000100:00100000:2.0:1746129828.402217:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8033 00000100:00100000:2.0:1746129828.402223:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054601344:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.402232:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129828.402245:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129828 -> 1746129829 00002000:00010000:2.0:1746129828.402247:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129828 -> 1746129829 00010000:00010000:2.0:1746129828.402252:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.402261:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.402273:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11c00/0x48868a4e43956782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2183168->2240511) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c8d expref: 23 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.402285:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.402286:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.402292:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.402298:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.402321:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 33 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.402330:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054120320:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129828.403878:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31862:x1830949054601216:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2260us (3927us total) trans 8589945189 rc 0/0 00000100:00100000:1.0:1746129828.403887:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11156 00000100:00100000:2.0:1746129828.404015:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.407159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.407187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.407316:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092adad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054120320:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129828.407335:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.407368:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054601344:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5145us (6430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.407377:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8033 00000100:00100000:0.0:1746129828.407625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.407976:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054601472 00000100:00100000:3.0:1746129828.407990:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054601472 00000100:00100000:3.0:1746129828.408027:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054601600 00000100:00100000:3.0:1746129828.408029:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054601600 00000100:00100000:3.0:1746129828.408041:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054601728 00000100:00100000:3.0:1746129828.408042:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054601728 00000100:00100000:3.0:1746129828.408054:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16030 00000100:00100000:3.0:1746129828.408060:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054601472:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129828.408074:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.408090:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a27f000/0x48868a4e439567b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ca2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.408751:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16031 00000100:00100000:1.0:1746129828.408758:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054601600:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.408767:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.408775:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e439567ba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ca9 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.408812:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054120448:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.408879:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.409059:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16032 00000100:00100000:0.0:1746129828.409065:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054601728:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129828.409071:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.409077:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cb0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.409088:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.409090:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.409096:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.409108:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.409118:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060400, rc 0) 00000100:00100000:0.0:1746129828.409139:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054601728:12345-192.168.204.31@tcp:101:cat.0 Request processed in 74us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129828.409144:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16032 00010000:00010000:3.0:1746129828.409413:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.409415:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.409424:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a27f000/0x48868a4e439567b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ca2 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.409436:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a27f000/0x48868a4e439567b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ca2 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.409442:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27f000, rc 0) 00000100:00100000:3.0:1746129828.409461:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054601472:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1401us (2310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.409466:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16030 00000100:00100000:0.0:1746129828.413340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.413410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.413429:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054602112 00000100:00100000:0.0:1746129828.413436:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054602112 00002000:00100000:0.0:1746129828.413469:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800926a1f80 x1830949054602112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129828.413483:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a1f80 with x1830949054602112 ext(3145728->4194303) 00002000:00010000:0.0:1746129828.413487:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800926a1f80 00000100:00100000:0.0:1746129828.413509:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054601984 00000100:00100000:0.0:1746129828.413511:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054601984 00002000:00100000:0.0:1746129828.413519:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800926a2680 x1830949054601984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129828.413524:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a2680 with x1830949054601984 ext(2097152->3145727) 00002000:00010000:0.0:1746129828.413527:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800926a2680 00000100:00100000:0.0:1746129828.413537:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7239 00000100:00100000:0.0:1746129828.413542:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054602112:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:1.0:1746129828.415542:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime: 1746129828 -> 1746129829 00000100:00100000:1.0:1746129828.415561:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054120448:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.415588:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e439567ba lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ca9 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.415600:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012baa5600/0x48868a4e439567ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ca9 expref: 24 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.415618:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012baa5600, rc 0) 00000100:00100000:1.0:1746129828.415648:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054601600:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6890us (8459us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129828.415654:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16031 00000100:00100000:3.0:1746129828.416036:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7240 00000100:00100000:3.0:1746129828.416049:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054601984:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.430001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.430420:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054602112:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16876us (17085us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.430430:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7239 00002000:00100000:2.0:1746129828.430438:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800926a1f80 x1830949054602112/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.430448:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a1f80 with x1830949054602112 ext(3145728->4194303) 00002000:00010000:2.0:1746129828.430452:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800926a1f80 00000100:00100000:2.0:1746129828.430469:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054602496 00000100:00100000:2.0:1746129828.430474:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054602496 00002000:00100000:2.0:1746129828.430494:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012ba1ad80 x1830949054602496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.430500:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1ad80 with x1830949054602496 ext(0->1048575) 00002000:00010000:2.0:1746129828.430503:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1ad80 00000100:00100000:2.0:1746129828.430513:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7241 00000100:00100000:2.0:1746129828.430517:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054602496:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.432068:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054601984:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16014us (18646us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.432076:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7240 00002000:00100000:3.0:1746129828.432083:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800926a2680 x1830949054601984/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.432090:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800926a2680 with x1830949054601984 ext(2097152->3145727) 00002000:00010000:3.0:1746129828.432094:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800926a2680 00000100:00100000:2.0:1746129828.439924:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054602496:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9397us (9934us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.439936:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7241 00002000:00100000:2.0:1746129828.439945:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ed:0x0] (0->1048575) req@ffff88012ba1ad80 x1830949054602496/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.439954:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1ad80 with x1830949054602496 ext(0->1048575) 00002000:00010000:2.0:1746129828.439959:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1ad80 00000100:00100000:2.0:1746129828.449505:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.449556:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.450140:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054602624 00000100:00100000:1.0:1746129828.450149:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054602624 00000100:00100000:1.0:1746129828.450313:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16033 00000100:00100000:1.0:1746129828.450321:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31862:x1830949054602624:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.450334:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.450347:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cb7 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450370:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450376:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.450378:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.450381:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb7 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450406:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 33 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450416:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 33 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.450430:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054120576:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.450506:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.450520:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054602880 00000100:00100000:1.0:1746129828.450523:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054602880 00000100:00100000:1.0:1746129828.450544:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11157 00000100:00100000:1.0:1746129828.450549:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+291:31864:x1830949054602880:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.450560:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.450569:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cbe expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450640:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.450651:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.450659:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.450667:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.450757:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 294 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450782:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 293 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.450789:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.450791:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746129828.450794:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373f8200, rc 0) 00000100:00100000:1.0:1746129828.450824:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31864:x1830949054602880:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 275us (1268us total) trans 8589945190 rc 0/0 00000100:00100000:1.0:1746129828.450830:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11157 00000100:00100000:1.0:1746129828.454578:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054120576:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.454603:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb7 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.454619:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5217e00, rc 0) 00000100:00100000:1.0:1746129828.454666:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31862:x1830949054602624:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4345us (5168us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.454673:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16033 00000100:00100000:0.0:1746129828.454729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.455022:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054603008 00000100:00100000:3.0:1746129828.455028:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054603008 00002000:00100000:3.0:1746129828.455063:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1667072->1916927) req@ffff88012e851880 x1830949054603008/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.455071:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e851880 with x1830949054603008 ext(1667072->1916927) 00010000:00010000:3.0:1746129828.455077:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 34 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.455088:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 34 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.455093:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e851880 00000100:00100000:3.0:1746129828.455106:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1948 00000100:00100000:3.0:1746129828.455112:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054603008:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129828.463383:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054603008:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8262us (8646us total) trans 17179874233 rc 0/0 00000100:00100000:3.0:1746129828.463398:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1948 00002000:00100000:3.0:1746129828.463408:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1667072->1916927) req@ffff88012e851880 x1830949054603008/t17179874233(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.463416:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e851880 with x1830949054603008 ext(1667072->1916927) 00010000:00010000:3.0:1746129828.463424:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 36 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.463437:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 36 pid: 7976 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.463443:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012e851880 00000100:00100000:0.0:1746129828.468150:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.469088:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054603136 00000100:00100000:2.0:1746129828.469097:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054603136 00010000:00010000:2.0:1746129828.469128:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 36 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.469319:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8034 00000100:00100000:2.0:1746129828.469327:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054603136:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.469339:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129828.469355:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129828 -> 1746129829 00010000:00010000:2.0:1746129828.469361:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 36 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.469375:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 36 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.469394:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5216c00/0x48868a4e43956720 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1667072->1916927) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c47 expref: 36 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.469527:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.469529:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.469536:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb7 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.469543:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb7 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.469570:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb7 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.469580:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054120704:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129828.470193:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.472550:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7108:1830949054120704:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129828.473059:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.473108:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054603136:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3780us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.473117:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8034 00000100:00100000:0.0:1746129828.478819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.478926:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054603264 00000100:00100000:1.0:1746129828.478934:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054603264 00000100:00100000:0.0:1746129828.479414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.479488:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054603520 00000100:00100000:2.0:1746129828.479492:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054603520 00002000:00100000:2.0:1746129828.479522:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012e852300 x1830949054603520/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.479531:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e852300 with x1830949054603520 ext(1048576->2097151) 00002000:00010000:2.0:1746129828.479536:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e852300 00000100:00100000:2.0:1746129828.479550:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7242 00000100:00100000:2.0:1746129828.479556:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054603520:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.480074:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16034 00000100:00100000:1.0:1746129828.480081:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:31864:x1830949054603264:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.480090:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.480105:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cc5 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.480125:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.480132:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.480137:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.480139:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.480143:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1409024->1843199] (req 1409024->1843199) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.480167:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.480177:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.480187:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054120832:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.480251:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 20 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.480259:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 20 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.480266:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054120960:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.480284:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.483756:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054120832:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.483769:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054120960:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.483789:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1409024->1843199] (req 1409024->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.483804:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5216c00, rc 0) 00000100:00100000:1.0:1746129828.483831:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31864:x1830949054603264:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3750us (5018us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.483839:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16034 00000100:00100000:0.0:1746129828.486467:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.487330:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054603904 00000100:00100000:1.0:1746129828.487338:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054603904 00000100:00100000:1.0:1746129828.487392:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11158 00000100:00100000:1.0:1746129828.487399:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+18:31867:x1830949054603904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.487418:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.487441:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e439567eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ccc expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.487539:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487550:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487558:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487568:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487573:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487577:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487650:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417ce00/0x48868a4e43956800 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487657:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417ce00/0x48868a4e43956800 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487662:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417ce00/0x48868a4e43956800 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.487668:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.487733:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487739:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487743:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487747:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa4800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.487750:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487755:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487762:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129828.487764:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.487766:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487770:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa4800/0x48868a4e439567f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487793:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487797:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487804:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487808:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012baa5600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.487810:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487813:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487818:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8900) 00010000:00010000:1.0:1746129828.487819:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.487821:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487824:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5600/0x48868a4e439567f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.487862:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5217600/0x48868a4e439567eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ccc expref: 21 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.487871:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417ce00/0x48868a4e43956800 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ccc expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.487875:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.487877:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129828.487878:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b417ce00, rc 0) 00000100:00100000:1.0:1746129828.487918:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31867:x1830949054603904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 520us (1457us total) trans 8589945191 rc 0/0 00000100:00100000:1.0:1746129828.487923:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11158 00000100:00100000:0.0:1746129828.488312:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.488353:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054603648 00000100:00100000:2.0:1746129828.488357:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054603648 00010000:00010000:2.0:1746129828.488374:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746129828.489491:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8035 00000100:00100000:3.0:1746129828.489504:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054603648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.489514:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.489533:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.489542:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.489557:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012bf05a00/0x48868a4e43956758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c78 expref: 28 pid: 7976 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.489610:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.489634:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054603648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 136us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.489640:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8035 00000100:00100000:0.0:1746129828.489775:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.489964:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054603520:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10407us (10550us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.489970:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7242 00002000:00100000:2.0:1746129828.489978:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff88012e852300 x1830949054603520/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.489995:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e852300 with x1830949054603520 ext(1048576->2097151) 00002000:00010000:2.0:1746129828.489998:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012e852300 00000100:00100000:3.0:1746129828.490040:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054604032 00000100:00100000:3.0:1746129828.490043:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054604032 00010000:00010000:3.0:1746129828.490057:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.490081:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8036 00000100:00100000:3.0:1746129828.490086:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054604032:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.490091:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.490098:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.490106:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.490116:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5217400/0x48868a4e43956727 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c4e expref: 21 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.490124:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.490126:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.490131:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.490138:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.490169:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 26 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.490179:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054121088:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.490227:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.490706:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.490762:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054604160 00000100:00100000:2.0:1746129828.490765:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054604160 00000100:00100000:2.0:1746129828.490784:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 748 00000100:00100000:2.0:1746129828.490789:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1964:x1830949054604160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.490795:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.490808:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b417ce00/0x48868a4e43956800 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ccc expref: 20 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.491057:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.491061:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.491084:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e852a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:1964:x1830949054604160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 294us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.491090:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 748 00000100:00100000:0.0:1746129828.491780:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.491944:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054604416 00000100:00100000:2.0:1746129828.491948:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054604416 00000100:00100000:2.0:1746129828.491975:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4693 00000100:00100000:2.0:1746129828.491991:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+19:31867:x1830949054604416:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129828.492185:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31867:x1830949054604416:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 203us (405us total) trans 8589945192 rc 0/0 00000100:00100000:2.0:1746129828.492191:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4693 00000100:00100000:3.0:1746129828.493022:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054121088:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.493041:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.493061:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:1962:x1830949054604032:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2975us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.493067:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8036 00000100:00100000:0.0:1746129828.493743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.493994:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054604672 00000100:00100000:2.0:1746129828.493998:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054604672 00002000:00100000:2.0:1746129828.494023:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1409024->1413119) req@ffff88012e853b80 x1830949054604672/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.494032:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e853b80 with x1830949054604672 ext(1409024->1413119) 00002000:00010000:2.0:1746129828.494036:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e853b80 00000100:00100000:2.0:1746129828.494048:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7243 00000100:00100000:2.0:1746129828.494053:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054604672:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129828.494151:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1962:x1830949054604672:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 98us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.494157:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7243 00002000:00100000:2.0:1746129828.494162:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1409024->1413119) req@ffff88012e853b80 x1830949054604672/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.494169:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e853b80 with x1830949054604672 ext(1409024->1413119) 00002000:00010000:2.0:1746129828.494172:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e853b80 00000100:00100000:0.0:1746129828.502162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.502569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.502622:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054605056 00000100:00100000:1.0:1746129828.502629:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054604800 00000100:00100000:2.0:1746129828.502630:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054605056 00000100:00100000:1.0:1746129828.502633:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054604800 00002000:00100000:2.0:1746129828.502661:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1839104->1843199) req@ffff88012e850700 x1830949054605056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746129828.502668:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16035 00002000:00100000:2.0:1746129828.502670:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850700 with x1830949054605056 ext(1839104->1843199) 00000100:00100000:1.0:1746129828.502674:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31862:x1830949054604800:12345-192.168.204.31@tcp:101:cat.0 00002000:00010000:2.0:1746129828.502675:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e850700 00010000:00010000:1.0:1746129828.502686:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746129828.502692:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7244 00000100:00100000:2.0:1746129828.502698:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054605056:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:1.0:1746129828.502698:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cd3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.502717:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.502722:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.502724:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.502727:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.502749:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.502758:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.502766:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121216:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129828.502821:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054605056:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 123us (251us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.502827:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7244 00000100:00100000:1.0:1746129828.502828:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00002000:00100000:2.0:1746129828.502832:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1839104->1843199) req@ffff88012e850700 x1830949054605056/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.502838:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850700 with x1830949054605056 ext(1839104->1843199) 00010000:00010000:2.0:1746129828.502843:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.502880:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129828.502886:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e850700 00000100:00100000:1.0:1746129828.512208:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121216:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.512231:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 21 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.512251:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b417c200, rc 0) 00000100:00100000:0.0:1746129828.512387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.512424:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e853480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31862:x1830949054604800:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9749us (10269us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.512431:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16035 00000100:00100000:3.0:1746129828.512508:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054605312 00000100:00100000:3.0:1746129828.512514:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054605312 00002000:00100000:3.0:1746129828.512544:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1409024->1843199) req@ffff88012e850380 x1830949054605312/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.512552:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850380 with x1830949054605312 ext(1409024->1843199) 00010000:00010000:3.0:1746129828.512558:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.512567:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.512572:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e850380 00000100:00100000:3.0:1746129828.513242:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1949 00000100:00100000:3.0:1746129828.513250:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1963:x1830949054605312:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:3.0:1746129828.520760:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054605312:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 7503us (8366us total) trans 21474841430 rc 0/0 00000100:00100000:3.0:1746129828.520773:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1949 00002000:00100000:3.0:1746129828.520782:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1409024->1843199) req@ffff88012e850380 x1830949054605312/t21474841430(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.520790:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850380 with x1830949054605312 ext(1409024->1843199) 00010000:00010000:3.0:1746129828.520798:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 29 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.520810:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 29 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.520816:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012e850380 00000100:00100000:0.0:1746129828.526071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.526276:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054605440 00000100:00100000:3.0:1746129828.526285:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054605440 00010000:00010000:3.0:1746129828.526319:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 29 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.527391:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8037 00000100:00100000:3.0:1746129828.527402:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054605440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.527414:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129828.527430:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129828 -> 1746129829 00002000:00010000:3.0:1746129828.527432:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129828 -> 1746129829 00010000:00010000:3.0:1746129828.527437:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 29 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.527447:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 29 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.527467:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5216c00/0x48868a4e439567e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1409024->1843199) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cc5 expref: 29 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.528629:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.528632:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.528640:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.528648:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.528680:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.528692:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054121344:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.529211:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.532191:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054121344:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.532217:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.532264:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e851500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054605440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4862us (6197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.532274:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8037 00000100:00100000:0.0:1746129828.534063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.534187:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054605696 00000100:00100000:3.0:1746129828.534195:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054605696 00002000:00100000:3.0:1746129828.534241:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012e850a80 x1830949054605696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.534257:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850a80 with x1830949054605696 ext(1048576->2097151) 00002000:00010000:3.0:1746129828.534261:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e850a80 00000100:00100000:3.0:1746129828.534359:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7245 00000100:00100000:3.0:1746129828.534370:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054605696:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.542738:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e850a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054605696:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8365us (8676us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.542748:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7245 00002000:00100000:3.0:1746129828.542757:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88012e850a80 x1830949054605696/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.542766:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012e850a80 with x1830949054605696 ext(1048576->2097151) 00002000:00010000:3.0:1746129828.542771:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012e850a80 00000100:00100000:0.0:1746129828.554638:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.554693:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.554793:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054605952 00000100:00100000:3.0:1746129828.554795:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054606080 00000100:00100000:3.0:1746129828.554800:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054606080 00000100:00100000:2.0:1746129828.554801:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054605952 00002000:00100000:3.0:1746129828.554841:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ece00 x1830949054606080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.554910:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ece00 with x1830949054606080 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.554915:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ece00 00000100:00100000:3.0:1746129828.554935:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7246 00000100:00100000:3.0:1746129828.554943:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054606080:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:2.0:1746129828.554947:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094eb5f80 x1830949054605952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.554954:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5f80 with x1830949054605952 ext(2097152->3145727) 00002000:00010000:2.0:1746129828.554957:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5f80 00000100:00100000:2.0:1746129828.554969:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7247 00000100:00100000:2.0:1746129828.554974:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054605952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.567481:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054606080:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12531us (12779us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.567492:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7246 00002000:00100000:3.0:1746129828.567503:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f6ece00 x1830949054606080/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.567512:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f6ece00 with x1830949054606080 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.567517:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f6ece00 00000100:00100000:2.0:1746129828.572700:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094eb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054605952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17718us (18061us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.572712:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7247 00002000:00100000:2.0:1746129828.572722:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880094eb5f80 x1830949054605952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.572731:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094eb5f80 with x1830949054605952 ext(2097152->3145727) 00002000:00010000:2.0:1746129828.572737:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094eb5f80 00000100:00100000:0.0:1746129828.579681:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.580409:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054606464 00000100:00100000:1.0:1746129828.580416:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054606464 00000100:00100000:1.0:1746129828.580458:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4694 00000100:00100000:1.0:1746129828.580465:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+20:31862:x1830949054606464:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:1.0:1746129828.580682:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f6ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31862:x1830949054606464:12345-192.168.204.31@tcp:35:cat.0 Request processed in 216us (1007us total) trans 8589945193 rc 0/0 00000100:00100000:1.0:1746129828.580691:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4694 00000100:00100000:0.0:1746129828.618185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.618247:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054606592 00000100:00100000:1.0:1746129828.618255:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054606592 00000100:00100000:1.0:1746129828.618302:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16036 00000100:00100000:1.0:1746129828.618309:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31867:x1830949054606592:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.618325:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.618339:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cda expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.618364:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.618372:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.618383:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.618389:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.618391:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.618394:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2891776->3145727] (req 2891776->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.618418:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 27 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.618429:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.618438:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121472:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.618529:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 8 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.618536:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 8 pid: 3624 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.618543:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121600:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.618566:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.618576:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.618583:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121728:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.618602:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.623068:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121472:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.623080:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121600:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.623088:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054121728:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.623112:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2891776->3145727] (req 2891776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 22 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.623127:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094555a00, rc 0) 00000100:00100000:1.0:1746129828.623161:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d634000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31867:x1830949054606592:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4852us (4982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.623169:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16036 00000100:00100000:0.0:1746129828.623829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.623893:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054606720 00000100:00100000:3.0:1746129828.623898:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054606720 00000100:00100000:0.0:1746129828.623920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129828.623924:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 9 pid: 3624 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746129828.623947:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054606848 00000100:00100000:3.0:1746129828.623949:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054606848 00010000:00010000:3.0:1746129828.623959:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.623972:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8038 00000100:00100000:3.0:1746129828.623986:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054606720:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.623996:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746129828.623998:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8039 00000100:00100000:2.0:1746129828.624004:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1962:x1830949054606848:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.624010:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.624013:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 9 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746129828.624016:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.624022:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 9 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746129828.624241:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.624259:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa01800/0x48868a4e439565f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bbb expref: 22 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.624273:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.624306:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054606848:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 302us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.624312:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8039 00010000:00010000:3.0:1746129828.624438:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012baa4600/0x48868a4e4395667f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bfa expref: 9 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.624451:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.624471:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d637100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:1962:x1830949054606720:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 493us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.624476:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8038 00000100:00100000:0.0:1746129828.627330:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.627439:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054606976 00000100:00100000:3.0:1746129828.627448:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054606976 00010000:00010000:3.0:1746129828.627485:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.627523:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8040 00000100:00100000:3.0:1746129828.627530:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1961:x1830949054606976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.627545:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.627564:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.627575:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.627592:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091f33800/0x48868a4e43956608 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd0 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.627603:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.627605:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.627611:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.627617:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.627646:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 20 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.627657:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054121856:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.627733:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012d001300 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.629190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.629254:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054607232 00000100:00100000:2.0:1746129828.629260:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054607232 00002000:00100000:2.0:1746129828.629291:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2891776->2895871) req@ffff88012ba39500 x1830949054607232/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.629299:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39500 with x1830949054607232 ext(2891776->2895871) 00002000:00010000:2.0:1746129828.629304:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39500 00000100:00100000:2.0:1746129828.629319:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7248 00000100:00100000:2.0:1746129828.629325:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054607232:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129828.629458:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1961:x1830949054607232:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 132us (271us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.629464:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7248 00002000:00100000:2.0:1746129828.629470:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2891776->2895871) req@ffff88012ba39500 x1830949054607232/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.629477:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39500 with x1830949054607232 ext(2891776->2895871) 00002000:00010000:2.0:1746129828.629480:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba39500 00000100:00100000:3.0:1746129828.629671:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054121856:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.629689:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.629726:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+27:1961:x1830949054606976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2196us (2404us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.629734:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8040 00000100:00100000:0.0:1746129828.637378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.637442:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054607360 00000100:00100000:1.0:1746129828.637450:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054607360 00000100:00100000:1.0:1746129828.637502:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16037 00000100:00100000:1.0:1746129828.637509:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31867:x1830949054607360:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.637523:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.637538:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ce1 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.637566:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.637574:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.637581:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.637582:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.637585:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->2674687] (req 2097152->2674687) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.637609:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.637620:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.637630:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054121984:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.637716:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.637724:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 34 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.637736:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054122112:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.637754:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.639805:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054121984:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.639815:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054122112:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.639836:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->2674687] (req 2097152->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 25 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.640029:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094555000, rc 0) 00000100:00100000:1.0:1746129828.640073:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31867:x1830949054607360:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2563us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.640081:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16037 00000100:00100000:0.0:1746129828.645338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.645391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.645425:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054607616 00000100:00100000:3.0:1746129828.645434:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054607616 00000100:00100000:2.0:1746129828.645444:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054607488 00000100:00100000:2.0:1746129828.645448:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054607488 00010000:00010000:3.0:1746129828.645469:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746129828.645469:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 35 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.645508:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8041 00000100:00100000:3.0:1746129828.645515:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800926a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054607616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129828.645517:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8042 00000100:00100000:2.0:1746129828.645521:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054607488:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.645528:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.645528:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.645546:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 35 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.645551:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746129828.645555:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 35 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.645616:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746129828.645641:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fae7400/0x48868a4e43956789 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c94 expref: 35 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.645693:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a060400/0x48868a4e439567c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb0 expref: 25 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:2.0:1746129828.645696:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.645698:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.645703:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.645715:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.645725:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129828.645742:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.645752:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054122240:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.645999:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800926a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054607616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 484us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.646078:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68780 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.646142:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8041 00000100:00100000:3.0:1746129828.652739:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054122240:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.652758:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.653082:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054607488:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7557us (7688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.653092:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8042 00000100:00100000:0.0:1746129828.653402:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.658585:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054607872 00000100:00100000:2.0:1746129828.658597:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054607872 00002000:00100000:2.0:1746129828.658641:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2670592->2674687) req@ffff88009207e680 x1830949054607872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.658651:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e680 with x1830949054607872 ext(2670592->2674687) 00002000:00010000:2.0:1746129828.658655:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e680 00000100:00100000:2.0:1746129828.658681:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7249 00000100:00100000:2.0:1746129828.658688:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054607872:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129828.658828:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054607872:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 139us (5426us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.658834:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7249 00002000:00100000:2.0:1746129828.658839:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2670592->2674687) req@ffff88009207e680 x1830949054607872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.658845:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009207e680 with x1830949054607872 ext(2670592->2674687) 00002000:00010000:2.0:1746129828.659170:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009207e680 00000100:00100000:0.0:1746129828.681146:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.681188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.681215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.681250:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.681300:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054608000 00000100:00100000:1.0:1746129828.681308:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054608000 00000100:00100000:0.0:1746129828.681331:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054608256 00000100:00100000:0.0:1746129828.681334:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054608256 00000100:00100000:1.0:1746129828.681342:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054608128 00000100:00100000:1.0:1746129828.681344:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054608128 00000100:00100000:0.0:1746129828.681350:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054608384 00000100:00100000:0.0:1746129828.681352:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054608384 00000100:00100000:1.0:1746129828.681359:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16038 00000100:00100000:1.0:1746129828.681365:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054608000:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129828.681368:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16039 00000100:00100000:0.0:1746129828.681373:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054608256:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.681381:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.681381:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.681395:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ce8 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.681395:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb75600/0x48868a4e4395682a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cf6 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.681410:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.681412:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.681420:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 36 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.681432:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 36 pid: 8435 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746129828.681433:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054122368:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.681450:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094555600, rc 0) 00000100:00100000:2.0:1746129828.681483:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16040 00000100:00100000:2.0:1746129828.681491:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1963:x1830949054608128:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:0.0:1746129828.681492:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746129828.681497:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.681505:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cef expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129828.681509:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16041 00010000:00010000:2.0:1746129828.681514:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129828.681514:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054608384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129828.681516:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.681520:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 30 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.681520:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.681527:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb75000/0x48868a4e43956838 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356cfd expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.681533:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 30 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.681539:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c15000, rc 0) 00000100:00100000:0.0:1746129828.681549:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054122496:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.681814:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949054608000:12345-192.168.204.31@tcp:101:cat.0 Request processed in 448us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.681819:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16038 00000100:00100000:2.0:1746129828.681922:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1963:x1830949054608128:12345-192.168.204.31@tcp:101:cat.0 Request processed in 431us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.681927:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16040 00000100:00100000:0.0:1746129828.682010:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00002000:00010000:2.0:1746129828.685046:0:7976:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime: 1746129828 -> 1746129829 00002000:00010000:2.0:1746129828.685052:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime: 1746129828 -> 1746129829 00002000:00010000:2.0:1746129828.685054:0:7976:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime: 1746129828 -> 1746129829 00000100:00100000:2.0:1746129828.685072:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054122368:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.685097:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb75600/0x48868a4e4395682a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cf6 expref: 29 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.685107:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb75600/0x48868a4e4395682a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cf6 expref: 29 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.685757:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb75600, rc 0) 00000100:00100000:2.0:1746129828.686015:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1963:x1830949054608256:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4639us (4824us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.686023:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16039 00002000:00010000:0.0:1746129828.686103:0:20441:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129828 -> 1746129829 00000100:00100000:0.0:1746129828.686118:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a504ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054122496:192.168.204.31@tcp:106: 00010000:00010000:0.0:1746129828.686133:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb75000/0x48868a4e43956838 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cfd expref: 36 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.686142:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb75000/0x48868a4e43956838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cfd expref: 36 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.686261:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb75000, rc 0) 00000100:00100000:0.0:1746129828.686280:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054608384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4766us (5029us total) trans 0 rc 301/301 00000100:00100000:0.0:1746129828.686285:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16041 00000100:00100000:0.0:1746129828.694531:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.694907:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054608768 00000100:00100000:2.0:1746129828.694915:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054608768 00002000:00100000:2.0:1746129828.694952:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504ed80 x1830949054608768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.694966:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ed80 with x1830949054608768 ext(1048576->2097151) 00002000:00010000:2.0:1746129828.694970:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504ed80 00000100:00100000:2.0:1746129828.695010:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7250 00000100:00100000:2.0:1746129828.695017:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a504ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054608768:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.695245:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.695317:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054608896 00000100:00100000:3.0:1746129828.695321:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054608896 00002000:00100000:3.0:1746129828.695340:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88008ec9d180 x1830949054608896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.695347:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9d180 with x1830949054608896 ext(1048576->2097151) 00002000:00010000:3.0:1746129828.695349:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9d180 00000100:00100000:3.0:1746129828.695363:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7251 00000100:00100000:3.0:1746129828.695368:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054608896:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129828.714044:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.714262:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a504ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054608768:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19242us (19735us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129828.714272:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7250 00002000:00100000:3.0:1746129828.714281:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f2:0x0] (1048576->2097151) req@ffff8800a504ed80 x1830949054608768/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.714291:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a504ed80 with x1830949054608768 ext(1048576->2097151) 00002000:00010000:3.0:1746129828.714295:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a504ed80 00000100:00100000:1.0:1746129828.715281:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054609152 00000100:00100000:1.0:1746129828.715288:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054609152 00000100:00100000:2.0:1746129828.715874:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054608896:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20504us (21288us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.715882:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7251 00002000:00100000:2.0:1746129828.715889:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88008ec9d180 x1830949054608896/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.715897:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ec9d180 with x1830949054608896 ext(1048576->2097151) 00002000:00010000:2.0:1746129828.715901:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ec9d180 00000100:00100000:1.0:1746129828.717002:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11159 00000100:00100000:1.0:1746129828.717011:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:31876:x1830949054609152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.717028:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.717041:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061200/0x48868a4e4395683f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d04 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.717112:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717121:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717129:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717137:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717142:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717147:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717513:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061e00/0x48868a4e43956854 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717521:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061e00/0x48868a4e43956854 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.717526:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061e00/0x48868a4e43956854 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:1.0:1746129828.717533:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129828.718766:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718774:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718779:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718784:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a061600 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.718787:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718792:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718802:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:1.0:1746129828.718804:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.718806:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718810:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061600/0x48868a4e43956846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718869:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718874:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718878:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718882:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a060200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129828.718884:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718888:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718895:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8e00) 00010000:00010000:1.0:1746129828.718896:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746129828.718899:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718903:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060200/0x48868a4e4395684d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.718945:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061200/0x48868a4e4395683f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d04 expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.718955:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061e00/0x48868a4e43956854 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d04 expref: 23 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.718961:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129828.718963:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746129828.718965:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a061e00, rc 0) 00000100:00100000:1.0:1746129828.719041:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31876:x1830949054609152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2031us (5005us total) trans 8589945194 rc 0/0 00000100:00100000:1.0:1746129828.719048:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11159 00000100:00100000:0.0:1746129828.733309:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.733491:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.733538:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.733621:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054609280 00000100:00100000:3.0:1746129828.733629:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054609280 00000100:00100000:3.0:1746129828.733684:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 749 00000100:00100000:3.0:1746129828.733692:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054609280:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.733704:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.733727:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061e00/0x48868a4e43956854 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d04 expref: 23 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.733747:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.733751:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.733793:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1961:x1830949054609280:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 103us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.733805:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 749 00000100:00100000:1.0:1746129828.734004:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054609536 00000100:00100000:1.0:1746129828.734008:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054609536 00000100:00100000:1.0:1746129828.734041:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054609408 00000100:00100000:1.0:1746129828.734044:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054609408 00000100:00100000:1.0:1746129828.734058:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16042 00000100:00100000:1.0:1746129828.734063:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054609536:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.734075:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.734086:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a060800/0x48868a4e43956862 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d12 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.734114:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16043 00000100:00100000:3.0:1746129828.734121:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054609408:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129828.734121:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054122624:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129828.734127:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.734136:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d43a400/0x48868a4e43956869 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d0b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.734158:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054122752:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.734425:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.734426:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093144840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.742675:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.743626:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054609664 00000100:00100000:1.0:1746129828.743635:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054609664 00000100:00100000:1.0:1746129828.743689:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11160 00000100:00100000:1.0:1746129828.743697:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+8:31879:x1830949054609664:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:1.0:1746129828.743717:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.743732:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e43956870 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d19 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.743784:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743798:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743807:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743817:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743821:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743826:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743934:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743943:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 21 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.743949:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.743954:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:1.0:1746129828.743988:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 292 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.743998:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 292 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.744012:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054122880:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.745348:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 21 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.745359:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 21 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.745369:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054123008:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.745414:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.746241:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054122624:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.746262:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a060800/0x48868a4e43956862 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d12 expref: 36 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.746272:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a060800/0x48868a4e43956862 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d12 expref: 36 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.746294:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060800, rc 0) 00000100:00100000:1.0:1746129828.746322:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054609536:12345-192.168.204.31@tcp:101:cat.0 Request processed in 12257us (12829us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129828.746330:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16042 00000100:00100000:3.0:1746129828.746764:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054122752:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129828.746786:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d43a400/0x48868a4e43956869 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d0b expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.746794:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d43a400/0x48868a4e43956869 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d0b expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129828.746813:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d43a400, rc 0) 00000100:00100000:3.0:1746129828.746838:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054609408:12345-192.168.204.31@tcp:101:cat.0 Request processed in 12718us (13299us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129828.746843:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16043 00000100:00100000:0.0:1746129828.747922:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.747990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.748113:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054122880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.748122:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054123008:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.748137:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129828.748188:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054609792 00000100:00100000:3.0:1746129828.748193:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054609792 00010000:00010000:3.0:1746129828.748218:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 293 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.748239:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8043 00000100:00100000:3.0:1746129828.748245:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:1963:x1830949054609792:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746129828.748245:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054610048 00000100:00100000:2.0:1746129828.748250:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054610048 00010000:00010000:3.0:1746129828.748256:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.748261:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 293 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.748269:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 293 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.748274:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4695 00000100:00100000:2.0:1746129828.748279:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:27193:x1830949054610048:12345-192.168.204.31@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1746129828.748284:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373f8200/0x48868a4e439567d6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cbe expref: 293 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.748302:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.748306:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.748313:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.748318:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.748323:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.748349:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:1963:x1830949054609792:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 104us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.748354:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8043 00000100:00100000:2.0:1746129828.748488:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:27193:x1830949054610048:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 208us (570us total) trans 8589945195 rc 0/0 00000100:00100000:2.0:1746129828.748494:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4695 00000100:00100000:1.0:1746129828.753517:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.753575:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.753635:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054610304 00000100:00100000:2.0:1746129828.753642:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054610304 00002000:00100000:2.0:1746129828.753679:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3399679) req@ffff88012ba19880 x1830949054610304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 504/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.753693:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949054610304 ext(2097152->3399679) 00002000:00010000:2.0:1746129828.753698:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19880 00000100:00100000:2.0:1746129828.753710:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054610560 00000100:00100000:2.0:1746129828.753713:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054610560 00002000:00100000:2.0:1746129828.753723:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3399680->4194303) req@ffff88012ba19f80 x1830949054610560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.753729:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949054610560 ext(3399680->4194303) 00002000:00010000:2.0:1746129828.753732:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19f80 00000100:00100000:2.0:1746129828.753753:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7252 00000100:00100000:2.0:1746129828.753759:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1964:x1830949054610304:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.754940:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7253 00000100:00100000:3.0:1746129828.754953:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054610560:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.755829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.755865:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054610816 00000100:00100000:0.0:1746129828.755869:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054610816 00002000:00100000:0.0:1746129828.755893:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2674688->3723263) req@ffff8800a0094e00 x1830949054610816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129828.755901:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094e00 with x1830949054610816 ext(2674688->3723263) 00002000:00010000:0.0:1746129828.755905:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0094e00 00000100:00100000:0.0:1746129828.755921:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7254 00000100:00100000:0.0:1746129828.755926:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054610816:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.760119:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.760330:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.762404:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611200 00000100:00100000:3.0:1746129828.762415:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611200 00000100:00100000:3.0:1746129828.762461:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16044 00000100:00100000:3.0:1746129828.762468:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:31873:x1830949054611200:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129828.762484:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.762498:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d20 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.762522:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.762532:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129828.762534:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129828.762537:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.762562:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.762572:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.762582:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054123136:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.762664:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093144840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.764325:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.764351:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611328 00000100:00100000:0.0:1746129828.764356:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611328 00010000:00010000:0.0:1746129828.764383:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 23 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746129828.764423:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8044 00000100:00100000:0.0:1746129828.764429:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054611328:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129828.764439:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129828.764444:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 23 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.764453:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 23 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.764474:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10a00/0x48868a4e43956774 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c86 expref: 23 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.764490:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:0.0:1746129828.764495:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129828.764502:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129828.764508:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129828.764524:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129828.764551:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:1963:x1830949054611328:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129828.764557:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8044 00000100:00100000:2.0:1746129828.764812:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611072 00000100:00100000:2.0:1746129828.764816:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611072 00002000:00100000:2.0:1746129828.764841:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3723264->4194303) req@ffff88012ba18000 x1830949054611072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.764862:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949054611072 ext(3723264->4194303) 00002000:00010000:2.0:1746129828.764865:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:2.0:1746129828.764887:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7255 00000100:00100000:2.0:1746129828.764893:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054611072:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:2.0:1746129828.765840:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765865:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129828.765898:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:2.0:1746129828.765903:0:1851:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746129828.765916:0:1851:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765924:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765931:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765936:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765941:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765945:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a060000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129828.765948:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765953:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765962:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129828.765964:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129828.765967:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.765970:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060000/0x48868a4e43956877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766004:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766009:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766013:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766017:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a061800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129828.766019:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766023:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766029:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012e2d8a00) 00010000:00010000:2.0:1746129828.766030:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746129828.766032:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766036:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a061800/0x48868a4e4395687e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.766063:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060600/0x48868a4e43956870 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.766073:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 9 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.766079:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.766081:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746129828.766083:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a060400, rc 0) 00000100:00100000:2.0:1746129828.766105:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ec9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31879:x1830949054609664:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 22409us (23438us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.766110:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11160 00000100:00100000:2.0:1746129828.775104:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054610304:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21335us (21583us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.775115:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7252 00002000:00100000:2.0:1746129828.775125:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3399679) req@ffff88012ba19880 x1830949054610304/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 504/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.775134:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949054610304 ext(2097152->3399679) 00010000:00010000:2.0:1746129828.775143:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 23 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.775157:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 23 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129828.775163:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba19880 00000100:00100000:3.0:1746129828.775944:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1964:x1830949054610560:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20994us (22367us total) trans 0 rc 794624/794624 00000100:00100000:3.0:1746129828.775951:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7253 00002000:00100000:3.0:1746129828.775956:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3399680->4194303) req@ffff88012ba19f80 x1830949054610560/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 794624/794624 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.775963:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949054610560 ext(3399680->4194303) 00010000:00010000:3.0:1746129828.775968:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 21 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.775989:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 21 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.776000:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba19f80 00000100:00100000:3.0:1746129828.776284:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1830949054123136:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129828.776308:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 29 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.776320:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d43ac00, rc 0) 00000100:00100000:3.0:1746129828.776340:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31873:x1830949054611200:12345-192.168.204.31@tcp:101:cat.0 Request processed in 13873us (16011us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.776346:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16044 00000100:00100000:0.0:1746129828.783273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.784005:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611456 00000100:00100000:3.0:1746129828.784013:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611456 00002000:00100000:3.0:1746129828.784049:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2891776->3145727) req@ffff8800a0095c00 x1830949054611456/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.784059:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095c00 with x1830949054611456 ext(2891776->3145727) 00010000:00010000:3.0:1746129828.784066:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 21 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.784079:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 21 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.784085:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0095c00 00000100:00100000:3.0:1746129828.785277:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1950 00000100:00100000:3.0:1746129828.785288:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+21:1962:x1830949054611456:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129828.785546:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054610816:12345-192.168.204.31@tcp:3:cat.0 Request processed in 29617us (29716us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.785553:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7254 00002000:00100000:1.0:1746129828.785560:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2674688->3723263) req@ffff8800a0094e00 x1830949054610816/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.785566:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094e00 with x1830949054610816 ext(2674688->3723263) 00002000:00010000:1.0:1746129828.785570:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0094e00 00000100:00100000:2.0:1746129828.786604:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054611072:12345-192.168.204.31@tcp:3:cat.0 Request processed in 21707us (26489us total) trans 0 rc 471040/471040 00000100:00100000:2.0:1746129828.786612:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7255 00002000:00100000:2.0:1746129828.786619:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3723264->4194303) req@ffff88012ba18000 x1830949054611072/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 471040/471040 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.786626:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949054611072 ext(3723264->4194303) 00002000:00010000:2.0:1746129828.786630:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:0.0:1746129828.790089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.790118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.790130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.790142:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611584 00000100:00100000:0.0:1746129828.790143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.790155:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611712 00000100:00100000:2.0:1746129828.790156:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611584 00000100:00100000:0.0:1746129828.790158:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611712 00000100:00100000:2.0:1746129828.790185:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611840 00000100:00100000:2.0:1746129828.790187:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611840 00000100:00100000:1.0:1746129828.790246:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.791075:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054612096 00000100:00100000:0.0:1746129828.791075:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054611968 00000100:00100000:2.0:1746129828.791079:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054612096 00000100:00100000:0.0:1746129828.791079:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054611968 00000100:00100000:1.0:1746129828.791087:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16045 00000100:00100000:1.0:1746129828.791094:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054611584:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:2.0:1746129828.791097:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16046 00000100:00100000:2.0:1746129828.791102:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054611712:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129828.791111:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.791111:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.791123:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e4395689a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d2e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.791123:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2db400/0x48868a4e43956893 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d27 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129828.791123:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16047 00000100:00100000:0.0:1746129828.791129:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054611840:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:0.0:1746129828.791138:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.791140:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.791140:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.791141:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.791141:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.791145:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d35 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.791148:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2db400/0x48868a4e43956893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d27 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.791149:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e4395689a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d2e expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.791155:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.791156:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129828.791161:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e4395689a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d2e expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.791161:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2db400/0x48868a4e43956893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d27 expref: 12 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.791161:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129828.791169:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 12 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.791170:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb11a00, rc 0) 00010000:00010000:1.0:1746129828.791171:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2db400, rc 0) 00010000:00010000:0.0:1746129828.791176:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb74c00, rc 0) 00000100:00100000:2.0:1746129828.791202:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054611712:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 99us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.791202:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054611584:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 109us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.791207:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16046 00000100:00100000:1.0:1746129828.791209:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16045 00000100:00100000:2.0:1746129828.791219:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16048 00000100:00100000:1.0:1746129828.791221:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16049 00000100:00100000:2.0:1746129828.791223:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054612096:12345-192.168.204.31@tcp:101:mirror_io.0 00000100:00100000:1.0:1746129828.791224:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1963:x1830949054611968:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:2.0:1746129828.791228:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.791228:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.791233:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x48868a4e439568af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d43 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.791233:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2db600/0x48868a4e439568a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d3c expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.791259:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054123264:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.791259:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054123392:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.791291:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129828.791590:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.791602:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.791613:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054612352 00000100:00100000:2.0:1746129828.791616:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054612352 00002000:00100000:2.0:1746129828.791632:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012ba18700 x1830949054612352/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.791640:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18700 with x1830949054612352 ext(4194304->4931583) 00010000:00010000:2.0:1746129828.791645:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 23 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.791655:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 23 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129828.791660:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba18700 00000100:00100000:2.0:1746129828.791677:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1951 00000100:00100000:2.0:1746129828.791682:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054612352:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129828.793666:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054611456:12345-192.168.204.31@tcp:4:cat.0 Request processed in 8375us (10394us total) trans 21474841431 rc 0/0 00000100:00100000:3.0:1746129828.793676:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1950 00002000:00100000:3.0:1746129828.793683:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2891776->3145727) req@ffff8800a0095c00 x1830949054611456/t21474841431(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746129828.793686:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054611840:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 2554us (3552us total) trans 0 rc 0/0 00002000:00100000:3.0:1746129828.793691:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0095c00 with x1830949054611456 ext(2891776->3145727) 00000100:00100000:0.0:1746129828.793692:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16047 00010000:00010000:3.0:1746129828.793698:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 25 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.793709:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 25 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.793715:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0095c00 00000100:00100000:3.0:1746129828.793868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.794414:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054612480 00000100:00100000:0.0:1746129828.794420:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054612480 00000100:00100000:0.0:1746129828.794447:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16050 00000100:00100000:0.0:1746129828.794453:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31876:x1830949054612480:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129828.794464:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.794474:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d4a expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.794491:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129828.794493:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129828.794497:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.794510:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.794517:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb74600, rc 0) 00000100:00100000:0.0:1746129828.794538:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31876:x1830949054612480:12345-192.168.204.31@tcp:101:cat.0 Request processed in 85us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129828.794542:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16050 00000100:00100000:1.0:1746129828.795933:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054123392:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.795959:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2db600/0x48868a4e439568a8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d3c expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.795970:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db600/0x48868a4e439568a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d3c expref: 11 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.796007:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2db600, rc 0) 00000100:00100000:1.0:1746129828.796046:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054611968:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 4819us (5900us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129828.796055:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16049 00000100:00100000:2.0:1746129828.796306:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054123264:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.796324:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x48868a4e439568af lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d43 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.796333:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb10c00/0x48868a4e439568af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d43 expref: 11 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.796343:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fb10c00, rc 0) 00000100:00100000:2.0:1746129828.796523:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1963:x1830949054612096:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 5298us (6275us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.796528:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16048 00000100:00100000:2.0:1746129828.797986:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054612352:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6289us (6370us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129828.797994:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1951 00002000:00100000:2.0:1746129828.798001:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012ba18700 x1830949054612352/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.798009:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18700 with x1830949054612352 ext(4194304->4931583) 00010000:00010000:2.0:1746129828.798789:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.798801:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129828.798807:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012ba18700 00000100:00100000:0.0:1746129828.799169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.799274:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054612736 00000100:00100000:3.0:1746129828.799280:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054612736 00000100:00100000:3.0:1746129828.799324:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11161 00000100:00100000:3.0:1746129828.799331:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31879:x1830949054612736:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129828.799343:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.799355:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d51 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.799422:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.799432:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.799437:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.799461:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.799469:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 10 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.799478:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054123520:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.799539:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093144840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.802926:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.804389:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.804473:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054612864 00000100:00100000:1.0:1746129828.804481:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054612864 00010000:00010000:1.0:1746129828.804545:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.804574:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054612992 00000100:00100000:1.0:1746129828.804577:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054612992 00010000:00010000:1.0:1746129828.804587:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 11 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.804598:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8045 00000100:00100000:1.0:1746129828.804604:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054612864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129828.804615:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.804631:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.804640:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.804656:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094555a00/0x48868a4e43956815 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2891776->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cda expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.804670:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.804672:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.804677:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.804688:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.804695:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.804696:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.804698:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.804703:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.804725:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 23 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.804733:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054123648:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129828.804799:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 28 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.804807:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054123776:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129828.804825:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.805167:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8046 00000100:00100000:0.0:1746129828.805174:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054612992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129828.805182:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129828.805189:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 11 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.805197:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 11 pid: 1851 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746129828.805208:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:0.0:1746129828.805212:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129828.805220:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129828.805228:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129828.805238:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129828.805256:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013680e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054612992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 83us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129828.805262:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8046 00010000:00010000:2.0:1746129828.805753:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a060400/0x48868a4e43956885 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d19 expref: 10 pid: 1851 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.806132:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054123520:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.806153:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.806159:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129828.806164:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129828.806179:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129828.806292:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d51 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.806308:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d51 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.806315:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129828.806317:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129828.806319:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbf400, rc 0) 00000100:00100000:2.0:1746129828.806712:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31879:x1830949054612736:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 7379us (7541us total) trans 8589945196 rc 0/0 00000100:00100000:2.0:1746129828.806809:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11161 00000100:00100000:1.0:1746129828.807235:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054123648:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129828.807244:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054123776:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129828.807255:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129828.807287:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054612864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2682us (4368us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.807295:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8045 00000100:00100000:0.0:1746129828.814095:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.814189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.814214:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054613504 00000100:00100000:2.0:1746129828.814220:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054613504 00002000:00100000:2.0:1746129828.814253:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f939f80 x1830949054613504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.814261:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830949054613504 ext(2097152->3145727) 00002000:00010000:2.0:1746129828.814265:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939f80 00000100:00100000:0.0:1746129828.815104:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.815165:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054613248 00000100:00100000:3.0:1746129828.815169:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054613248 00000100:00100000:3.0:1746129828.815207:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11162 00000100:00100000:3.0:1746129828.815214:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31879:x1830949054613248:12345-192.168.204.31@tcp:101:mirror_io.0 00010000:00010000:3.0:1746129828.815232:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.815235:0:1851:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746129828.815256:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568c4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d51 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.815273:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.815276:0:1851:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129828.815302:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e439568d2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d58 expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.815366:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815376:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815386:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815396:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815401:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815406:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815410:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbfe00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.815413:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815418:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815424:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.815426:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129828.815428:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815432:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568d9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.815452:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e439568d2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d58 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.815458:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e439568d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d58 expref: 10 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.815468:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbfc00, rc 0) 00000100:00100000:3.0:1746129828.815505:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31879:x1830949054613248:12345-192.168.204.31@tcp:101:mirror_io.0 Request processed in 291us (1418us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129828.815511:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11162 00000100:00100000:2.0:1746129828.815712:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054613760 00000100:00100000:2.0:1746129828.815715:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054613760 00000100:00100000:1.0:1746129828.815720:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7256 00000100:00100000:1.0:1746129828.815728:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054613504:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:2.0:1746129828.815733:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a0094a80 x1830949054613760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.815741:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094a80 with x1830949054613760 ext(3145728->4194303) 00002000:00010000:2.0:1746129828.815745:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0094a80 00000100:00100000:2.0:1746129828.815767:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7257 00000100:00100000:2.0:1746129828.815773:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054613760:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.824136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.827179:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054614016 00000100:00100000:2.0:1746129828.827190:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054614016 00000100:00100000:2.0:1746129828.827229:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4696 00000100:00100000:2.0:1746129828.827235:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:31879:x1830949054614016:12345-192.168.204.31@tcp:35:mirror_io.0 00000100:00100000:2.0:1746129828.827425:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31879:x1830949054614016:12345-192.168.204.31@tcp:35:mirror_io.0 Request processed in 189us (3296us total) trans 8589945197 rc 0/0 00000100:00100000:2.0:1746129828.827432:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4696 00000100:00100000:0.0:1746129828.828276:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.828340:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054614272 00000100:00100000:1.0:1746129828.828344:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054614272 00000100:00100000:3.0:1746129828.829833:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11163 00000100:00100000:3.0:1746129828.829870:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+22:31881:x1830949054614272:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129828.829895:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129828.829911:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d5f expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.830022:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830034:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830042:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830053:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830058:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830062:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830147:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830155:0:1851:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830160:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:3.0:1746129828.830166:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129828.830228:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830233:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830238:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830242:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbfa00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.830246:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830251:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830259:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129828.830262:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.830265:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830269:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e439568e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830287:0:1851:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830294:0:1851:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830298:0:1851:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830301:0:1851:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbf400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129828.830303:0:1851:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830307:0:1851:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830312:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244300) 00010000:00010000:3.0:1746129828.830314:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129828.830315:0:1851:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830319:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e439568ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129828.830348:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e439568e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 25 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.830358:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 24 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.830363:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129828.830364:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129828.830366:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbf200, rc 0) 00000100:00100000:3.0:1746129828.830407:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31881:x1830949054614272:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 567us (2132us total) trans 8589945198 rc 0/0 00000100:00100000:3.0:1746129828.830413:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11163 00000100:00100000:1.0:1746129828.831408:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054613504:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15679us (17217us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.831416:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7256 00002000:00100000:1.0:1746129828.831423:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f939f80 x1830949054613504/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.831432:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830949054613504 ext(2097152->3145727) 00002000:00010000:1.0:1746129828.831435:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f939f80 00000100:00100000:2.0:1746129828.831655:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054613760:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15880us (16551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.831661:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7257 00002000:00100000:2.0:1746129828.831666:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff8800a0094a80 x1830949054613760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.831672:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0094a80 with x1830949054613760 ext(3145728->4194303) 00002000:00010000:2.0:1746129828.831675:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0094a80 00000100:00100000:2.0:1746129828.838943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.839092:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054614400 00000100:00100000:0.0:1746129828.839101:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054614400 00000100:00100000:0.0:1746129828.839166:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16051 00000100:00100000:0.0:1746129828.839176:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31873:x1830949054614400:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129828.839193:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129828.839210:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d66 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.839240:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.839247:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129828.839249:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746129828.839252:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.839283:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 23 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.839296:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 23 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746129828.839308:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054123904:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129828.839418:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.849498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.849570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.849595:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.849691:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0096a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054123904:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.849714:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.849728:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb74e00, rc 0) 00000100:00100000:1.0:1746129828.849779:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31873:x1830949054614400:12345-192.168.204.31@tcp:101:cat.0 Request processed in 10605us (10845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.849787:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16051 00000100:00100000:1.0:1746129828.849806:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054614912 00000100:00100000:1.0:1746129828.849811:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054614912 00000100:00100000:1.0:1746129828.849836:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16052 00000100:00100000:1.0:1746129828.849841:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:31881:x1830949054614912:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.849873:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.849885:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d6d expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.849907:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.849914:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.849921:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.849926:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.849927:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.849930:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1433600->1646591] (req 1433600->1646591) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.849952:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 28 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.849961:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 28 pid: 3624 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.849971:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054124032:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.850038:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 9 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.850051:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 9 pid: 7976 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.850058:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054124160:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.850090:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 24 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.850097:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.850103:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054124288:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.850116:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.850136:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054614656 00000100:00100000:1.0:1746129828.850139:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054614656 00002000:00100000:1.0:1746129828.850159:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b026300 x1830949054614656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.850167:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026300 with x1830949054614656 ext(4194304->4931583) 00002000:00010000:1.0:1746129828.850170:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026300 00000100:00100000:1.0:1746129828.850189:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054614784 00000100:00100000:1.0:1746129828.850192:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054614784 00002000:00100000:1.0:1746129828.850203:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2674687) req@ffff88012b024000 x1830949054614784/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.850209:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024000 with x1830949054614784 ext(2097152->2674687) 00000100:00100000:3.0:1746129828.850211:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7258 00010000:00010000:1.0:1746129828.850213:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.850221:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054614656:12345-192.168.204.31@tcp:3:cat.0 00010000:00010000:1.0:1746129828.850221:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 24 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746129828.850226:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b024000 00000100:00100000:1.0:1746129828.850236:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1952 00000100:00100000:1.0:1746129828.850241:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054614784:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129828.861213:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054124288:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.868133:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054124032:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.868191:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054124160:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.868223:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [1433600->1646591] (req 1433600->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 26 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.868242:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2db200, rc 0) 00000100:00100000:1.0:1746129828.868291:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31881:x1830949054614912:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 18446us (18718us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.868300:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16052 00000100:00100000:1.0:1746129828.868352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.868379:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054615040 00000100:00100000:1.0:1746129828.868386:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054615040 00010000:00010000:1.0:1746129828.868411:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 26 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.868456:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8047 00000100:00100000:1.0:1746129828.868464:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1962:x1830949054615040:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129828.868476:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129828.868497:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 26 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.868507:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 26 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.868529:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b417c200/0x48868a4e4395680e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cd3 expref: 26 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746129828.869449:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.869473:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.869485:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054615296 00000100:00100000:0.0:1746129828.869488:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054615296 00010000:00010000:0.0:1746129828.869502:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 10 pid: 7976 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746129828.869514:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054615168 00000100:00100000:0.0:1746129828.869515:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054615168 00010000:00010000:0.0:1746129828.869523:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 29 pid: 3624 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746129828.869541:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8048 00000100:00100000:0.0:1746129828.869546:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054615296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129828.869552:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129828.869560:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 10 pid: 7976 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.869570:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 10 pid: 7976 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.869581:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74c00/0x48868a4e439568a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d35 expref: 10 pid: 7976 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.869592:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129828.869608:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054615296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129828.869612:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8048 00000100:00100000:0.0:1746129828.869621:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8049 00000100:00100000:0.0:1746129828.869626:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054615168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129828.869631:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129828.869637:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 29 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.869644:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 29 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.869653:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c15000/0x48868a4e43956831 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cef expref: 29 pid: 3624 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746129828.869659:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.869660:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129828.869666:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.869673:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129828.869696:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129828.869706:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b026a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054124416:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129828.869747:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.870106:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054614656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19885us (20612us total) trans 0 rc 737280/737280 00000100:00100000:3.0:1746129828.870114:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7258 00002000:00100000:3.0:1746129828.870123:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012b026300 x1830949054614656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.870131:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b026300 with x1830949054614656 ext(4194304->4931583) 00002000:00010000:3.0:1746129828.870135:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b026300 00000100:00100000:2.0:1746129828.873095:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054614784:12345-192.168.204.31@tcp:4:cat.0 Request processed in 22845us (23490us total) trans 17179874234 rc 0/0 00000100:00100000:2.0:1746129828.873104:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1952 00002000:00100000:2.0:1746129828.873111:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2674687) req@ffff88012b024000 x1830949054614784/t17179874234(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.873118:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024000 with x1830949054614784 ext(2097152->2674687) 00010000:00010000:2.0:1746129828.873125:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 26 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.873143:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 26 pid: 8435 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746129828.873149:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b024000 00010000:00010000:1.0:1746129828.873668:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129828.873700:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1962:x1830949054615040:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5234us (5346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.873708:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8047 00000100:00100000:2.0:1746129828.880009:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b026a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054124416:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129828.880030:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.880081:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054615168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 10453us (10606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.880091:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8049 00000100:00100000:0.0:1746129828.880182:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.880490:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054615552 00000100:00100000:2.0:1746129828.880495:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054615552 00002000:00100000:2.0:1746129828.880525:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1433600->1437695) req@ffff88012b025500 x1830949054615552/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.880533:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025500 with x1830949054615552 ext(1433600->1437695) 00002000:00010000:2.0:1746129828.880537:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b025500 00000100:00100000:2.0:1746129828.880561:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7259 00000100:00100000:2.0:1746129828.880567:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054615552:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129828.880700:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1963:x1830949054615552:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 132us (517us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.880705:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7259 00002000:00100000:2.0:1746129828.880710:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1433600->1437695) req@ffff88012b025500 x1830949054615552/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.880717:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b025500 with x1830949054615552 ext(1433600->1437695) 00002000:00010000:2.0:1746129828.880720:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b025500 00000100:00100000:0.0:1746129828.883569:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.883756:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.883824:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054615936 00000100:00100000:3.0:1746129828.883830:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054615936 00002000:00100000:3.0:1746129828.883880:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1642496->1646591) req@ffff88012b024380 x1830949054615936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.883889:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024380 with x1830949054615936 ext(1642496->1646591) 00002000:00010000:3.0:1746129828.883893:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b024380 00000100:00100000:3.0:1746129828.883956:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7260 00000100:00100000:3.0:1746129828.883962:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054615936:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129828.884143:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054615680 00000100:00100000:1.0:1746129828.884147:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054615680 00000100:00100000:3.0:1746129828.884658:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1964:x1830949054615936:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 694us (900us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129828.884664:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7260 00002000:00100000:3.0:1746129828.884669:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3ef:0x0] (1642496->1646591) req@ffff88012b024380 x1830949054615936/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.884681:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b024380 with x1830949054615936 ext(1642496->1646591) 00002000:00010000:3.0:1746129828.884684:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b024380 00000100:00100000:1.0:1746129828.884919:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16053 00000100:00100000:1.0:1746129828.884925:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054615680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.884934:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.884947:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2db800/0x48868a4e43956911 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d74 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129828.884992:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054124544:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129828.885189:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129828.885254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.885818:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054616064 00000100:00100000:3.0:1746129828.885822:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054616064 00010000:00010000:3.0:1746129828.885839:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.885879:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8050 00000100:00100000:3.0:1746129828.885884:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054616064:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.885892:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.885907:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.885917:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 28 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.885933:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.885935:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.885940:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 35 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.885947:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 35 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.885964:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 35 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.885989:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054124672:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.886019:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a87f0600 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.890600:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054124672:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.890623:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.890658:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b026a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054616064:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4772us (5402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.890666:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8050 00010000:00010000:1.0:1746129828.890900:0:20441:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88012ba18e00 x1830949054124544) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746129828.890929:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094555000/0x48868a4e4395681c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2674687) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce1 expref: 27 pid: 8435 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.891025:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054124544:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.891047:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2db800/0x48868a4e43956911 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d74 expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.891057:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2db800/0x48868a4e43956911 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d74 expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.891064:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2db800, rc 0) 00000100:00100000:1.0:1746129828.891095:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054615680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6171us (7537us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129828.891101:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16053 00000100:00100000:0.0:1746129828.893369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.893448:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054616320 00000100:00100000:2.0:1746129828.893454:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054616320 00000100:00100000:2.0:1746129828.893489:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4697 00000100:00100000:2.0:1746129828.893495:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31881:x1830949054616320:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129828.893673:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5491500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31881:x1830949054616320:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 177us (309us total) trans 8589945199 rc 0/0 00000100:00100000:2.0:1746129828.893679:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4697 00000100:00100000:0.0:1746129828.894245:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.894301:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054616448 00000100:00100000:1.0:1746129828.894305:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054616448 00000100:00100000:1.0:1746129828.894325:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16054 00000100:00100000:1.0:1746129828.894330:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054616448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129828.894339:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.894351:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d7b expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.894365:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.894367:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.894374:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.894385:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 26 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.894393:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2db600, rc 0) 00000100:00100000:1.0:1746129828.894421:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054616448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 90us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.894426:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16054 00000100:00100000:0.0:1746129828.898607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129828.898664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.898727:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054616704 00000100:00100000:0.0:1746129828.898733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.898734:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054616704 00002000:00100000:3.0:1746129828.898770:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a5490e00 x1830949054616704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.898778:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490e00 with x1830949054616704 ext(2097152->3145727) 00002000:00010000:3.0:1746129828.898782:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490e00 00000100:00100000:3.0:1746129828.898807:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054616960 00000100:00100000:3.0:1746129828.898810:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054616960 00002000:00100000:3.0:1746129828.898822:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880136a39050 x1830949054616960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.898828:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a39050 with x1830949054616960 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.898830:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a39050 00000100:00100000:3.0:1746129828.898844:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054617216 00000100:00100000:3.0:1746129828.898874:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054617216 00002000:00100000:3.0:1746129828.898889:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880095241500 x1830949054617216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.898895:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241500 with x1830949054617216 ext(3145728->4194303) 00000100:00100000:0.0:1746129828.898958:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7261 00000100:00100000:0.0:1746129828.898965:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054616704:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129828.899032:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7262 00000100:00100000:1.0:1746129828.899038:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054616960:12345-192.168.204.31@tcp:3:cat.0 00002000:00010000:3.0:1746129828.899989:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241500 00000100:00100000:3.0:1746129828.900004:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7263 00000100:00100000:3.0:1746129828.900010:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054617216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.908487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.908599:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054617472 00000100:00100000:2.0:1746129828.908608:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054617472 00000100:00100000:3.0:1746129828.908958:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4698 00000100:00100000:3.0:1746129828.908971:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31876:x1830949054617472:12345-192.168.204.31@tcp:35:cat.0 00000100:00100000:3.0:1746129828.909164:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31876:x1830949054617472:12345-192.168.204.31@tcp:35:cat.0 Request processed in 198us (684us total) trans 8589945200 rc 0/0 00000100:00100000:3.0:1746129828.909171:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4698 00000100:00100000:1.0:1746129828.909579:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5490e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054616704:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10614us (10981us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.909587:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7261 00002000:00100000:1.0:1746129828.909595:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800a5490e00 x1830949054616704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129828.909603:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a5490e00 with x1830949054616704 ext(2097152->3145727) 00002000:00010000:1.0:1746129828.909609:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a5490e00 00000100:00100000:2.0:1746129828.913378:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054616960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14332us (14706us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129828.913389:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7262 00002000:00100000:2.0:1746129828.913398:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880136a39050 x1830949054616960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.913407:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a39050 with x1830949054616960 ext(3145728->4194303) 00002000:00010000:2.0:1746129828.913413:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a39050 00000100:00100000:0.0:1746129828.913995:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129828.914207:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054617600 00000100:00100000:1.0:1746129828.914214:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054617600 00000100:00100000:1.0:1746129828.914245:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16055 00000100:00100000:1.0:1746129828.914251:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31878:x1830949054617600:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.914263:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129828.914548:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d82 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.914574:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.914580:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.914585:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.914590:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.914591:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129828.914594:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [1859584->2097151] (req 1859584->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.914616:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.914625:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 25 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.914635:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054124800:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.914678:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 37 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.914684:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 37 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746129828.914691:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054124928:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.914708:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 9 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129828.914714:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 9 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746129828.914720:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054125056:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129828.914733:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+28:1962:x1830949054617216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14724us (15999us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129828.914733:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.914740:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7263 00002000:00100000:3.0:1746129828.914746:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880095241500 x1830949054617216/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.914753:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241500 with x1830949054617216 ext(3145728->4194303) 00002000:00010000:3.0:1746129828.914992:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241500 00000100:00100000:1.0:1746129828.916897:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054124800:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129828.919764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.920078:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054617728 00000100:00100000:3.0:1746129828.920085:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054617728 00010000:00010000:3.0:1746129828.920115:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 38 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.920139:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8051 00000100:00100000:3.0:1746129828.920144:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949054617728:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.920154:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.920172:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 38 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.920181:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 38 pid: 7976 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.920200:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.920233:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949054617728:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 89us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.920237:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8051 00000100:00100000:0.0:1746129828.920546:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.920663:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054617856 00000100:00100000:2.0:1746129828.920667:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054617856 00010000:00010000:0.0:1746129828.920710:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f17600/0x48868a4e439565c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b8a expref: 37 pid: 7976 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746129828.920726:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054124928:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.920840:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.920880:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8052 00000100:00100000:2.0:1746129828.920885:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054617856:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129828.920892:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129828.920899:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.920908:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.920919:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d6c3800/0x48868a4e439565c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b91 expref: 26 pid: 8436 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746129828.920930:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129828.920949:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054617856:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 64us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.920954:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8052 00000100:00100000:0.0:1746129828.921381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.921419:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054617984 00000100:00100000:3.0:1746129828.921422:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054617984 00010000:00010000:3.0:1746129828.921436:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746129828.921448:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8053 00000100:00100000:3.0:1746129828.921453:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054617984:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.921459:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.921466:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.921474:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746129828.921484:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.921486:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.921492:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.921502:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.921526:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.921535:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054125184:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.921588:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093144840 going to sleep for 11 seconds 00010000:00010000:2.0:1746129828.921810:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130a39c00/0x48868a4e4395648e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356afe expref: 10 pid: 20441 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746129828.921819:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054125056:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129828.921836:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 36 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129828.921843:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42c00, rc 0) 00000100:00100000:2.0:1746129828.921879:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31878:x1830949054617600:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7629us (7885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129828.921885:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16055 00000100:00100000:3.0:1746129828.922874:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054125184:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.922885:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.922903:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1962:x1830949054617984:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1450us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.922909:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8053 00000100:00100000:0.0:1746129828.923405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.923459:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054618240 00000100:00100000:2.0:1746129828.923463:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054618240 00002000:00100000:2.0:1746129828.923487:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1859584->1863679) req@ffff880095243100 x1830949054618240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.923500:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243100 with x1830949054618240 ext(1859584->1863679) 00002000:00010000:2.0:1746129828.923503:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243100 00000100:00100000:2.0:1746129828.923522:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7264 00000100:00100000:2.0:1746129828.923527:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054618240:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129828.923631:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054618240:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 103us (227us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.923636:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7264 00002000:00100000:2.0:1746129828.923640:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1859584->1863679) req@ffff880095243100 x1830949054618240/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.923646:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095243100 with x1830949054618240 ext(1859584->1863679) 00002000:00010000:2.0:1746129828.923649:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095243100 00000100:00100000:0.0:1746129828.927916:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.927957:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054618368 00000100:00100000:2.0:1746129828.927963:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054618368 00000100:00100000:0.0:1746129828.927991:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.928010:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054618496 00000100:00100000:2.0:1746129828.928012:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054618496 00000100:00100000:2.0:1746129828.928031:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16056 00000100:00100000:1.0:1746129828.928036:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16057 00000100:00100000:2.0:1746129828.928038:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054618368:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129828.928041:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31878:x1830949054618496:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129828.928055:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.928062:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129828.928069:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948c1600/0x48868a4e43956926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d89 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.928069:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d90 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.928091:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.928097:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.928099:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129828.928101:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129828.928106:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054125312:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129828.928121:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 22 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.928131:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 22 pid: 20441 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746129828.928303:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129828.928376:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054125440:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129828.928397:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00002000:00010000:2.0:1746129828.929371:0:7976:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime: 1746129828 -> 1746129829 00000100:00100000:2.0:1746129828.929390:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:7976:1830949054125312:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129828.929408:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948c1600/0x48868a4e43956926 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d89 expref: 31 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.929418:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948c1600/0x48868a4e43956926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d89 expref: 31 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129828.929426:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948c1600, rc 0) 00000100:00100000:2.0:1746129828.929450:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1961:x1830949054618368:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1412us (1540us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129828.929457:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16056 00000100:00100000:1.0:1746129828.929487:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054125440:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129828.929501:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129828.929511:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43a00, rc 0) 00000100:00100000:1.0:1746129828.929533:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:31878:x1830949054618496:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1491us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129828.929539:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16057 00000100:00100000:0.0:1746129828.929894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129828.930101:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054618624 00000100:00100000:3.0:1746129828.930106:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054618624 00002000:00100000:3.0:1746129828.930134:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1433600->1646591) req@ffff880095241180 x1830949054618624/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.930141:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241180 with x1830949054618624 ext(1433600->1646591) 00010000:00010000:3.0:1746129828.930147:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 23 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.930156:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 23 pid: 20441 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.930164:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095241180 00000100:00100000:3.0:1746129828.930191:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1953 00000100:00100000:3.0:1746129828.930197:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+23:1961:x1830949054618624:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129828.932703:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.932991:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054618880 00000100:00100000:2.0:1746129828.932998:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054618880 00002000:00100000:2.0:1746129828.933025:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880095242a00 x1830949054618880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.933033:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949054618880 ext(4194304->4931583) 00002000:00010000:2.0:1746129828.933038:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242a00 00000100:00100000:3.0:1746129828.933657:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054618624:12345-192.168.204.31@tcp:4:cat.0 Request processed in 3459us (3761us total) trans 21474841432 rc 0/0 00000100:00100000:3.0:1746129828.933665:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1953 00002000:00100000:3.0:1746129828.933671:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1433600->1646591) req@ffff880095241180 x1830949054618624/t21474841432(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:569/0 lens 488/448 e 0 to 0 dl 1746129839 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129828.933677:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241180 with x1830949054618624 ext(1433600->1646591) 00010000:00010000:3.0:1746129828.933683:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.933696:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746129828.933702:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095241180 00000100:00100000:3.0:1746129828.933718:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7265 00000100:00100000:3.0:1746129828.933724:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054618880:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129828.938431:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.941307:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095242a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1961:x1830949054618880:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7576us (8601us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129828.941318:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7265 00002000:00100000:2.0:1746129828.941327:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880095242a00 x1830949054618880/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/440 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.941336:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095242a00 with x1830949054618880 ext(4194304->4931583) 00002000:00010000:2.0:1746129828.941341:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095242a00 00000100:00100000:3.0:1746129828.941409:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054619008 00000100:00100000:3.0:1746129828.941415:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054619008 00010000:00010000:3.0:1746129828.941439:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746129828.941475:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8054 00000100:00100000:3.0:1746129828.941482:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054619008:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129828.941497:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129828.941512:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.941522:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.941539:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db200/0x48868a4e4395690a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1433600->1646591) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d6d expref: 25 pid: 20441 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746129828.941563:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.941565:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129828.941571:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.941578:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129828.941605:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129828.941621:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054125568:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129828.941684:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c590c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129828.943285:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054125568:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129828.943301:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129828.943336:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054619008:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1853us (4909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129828.943342:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8054 00000100:00100000:0.0:1746129828.946784:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.947231:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054619264 00000100:00100000:2.0:1746129828.947239:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054619264 00002000:00100000:2.0:1746129828.947274:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1671168->1675263) req@ffff880095241880 x1830949054619264/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/0 e 0 to 0 dl 1746129839 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.947282:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241880 with x1830949054619264 ext(1671168->1675263) 00002000:00010000:2.0:1746129828.947286:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241880 00000100:00100000:2.0:1746129828.947313:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7266 00000100:00100000:2.0:1746129828.947320:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054619264:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129828.947446:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1964:x1830949054619264:12345-192.168.204.31@tcp:3:cat.0 Request processed in 126us (666us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129828.947452:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7266 00002000:00100000:2.0:1746129828.947457:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1671168->1675263) req@ffff880095241880 x1830949054619264/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:569/0 lens 488/4536 e 0 to 0 dl 1746129839 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129828.947463:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095241880 with x1830949054619264 ext(1671168->1675263) 00002000:00010000:2.0:1746129828.947466:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095241880 00000100:00100000:0.0:1746129828.949739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129828.949950:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054619520 00000100:00100000:2.0:1746129828.949956:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054619520 00000100:00100000:3.0:1746129828.951592:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4699 00000100:00100000:3.0:1746129828.951608:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+292:31878:x1830949054619520:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:3.0:1746129828.951794:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095241f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31878:x1830949054619520:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 193us (2060us total) trans 8589945201 rc 0/0 00000100:00100000:3.0:1746129828.951800:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4699 00000100:00100000:0.0:1746129829.046508:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.046601:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054619776 00000100:00100000:2.0:1746129829.046610:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054619776 00000100:00100000:2.0:1746129829.046872:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11164 00000100:00100000:2.0:1746129829.046881:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31889:x1830949054619776:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129829.046901:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.046916:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c1000/0x48868a4e43956934 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d97 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746129829.047013:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746129829.047104:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c0e00/0x48868a4e4395693b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.047120:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c0e00/0x48868a4e4395693b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.047130:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c0e00/0x48868a4e4395693b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129829.047138:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129829.047918:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c1000/0x48868a4e43956934 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d97 expref: 29 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.049661:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c0e00/0x48868a4e4395693b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d97 expref: 28 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.049671:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129829.049673:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129829.049676:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948c0e00, rc 0) 00000100:00100000:2.0:1746129829.049780:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31889:x1830949054619776:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2899us (3277us total) trans 8589945202 rc 0/0 00000100:00100000:2.0:1746129829.049788:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11164 00000100:00100000:0.0:1746129829.052827:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.053011:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.053265:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054619904 00000100:00100000:1.0:1746129829.053274:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054619904 00000100:00100000:1.0:1746129829.053312:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054620032 00000100:00100000:1.0:1746129829.053315:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054620032 00000100:00100000:1.0:1746129829.053328:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16058 00000100:00100000:1.0:1746129829.053334:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054619904:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.053349:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.053361:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db42a00/0x48868a4e43956949 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356d9e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.053402:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054125696:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129829.053467:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.053553:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16059 00000100:00100000:0.0:1746129829.053559:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054620032:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:0.0:1746129829.053565:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129829.053573:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb75e00/0x48868a4e43956950 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356da5 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129829.053593:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054125824:192.168.204.31@tcp:106: 00000100:00100000:0.0:1746129829.053613:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00002000:00010000:1.0:1746129829.057250:0:8435:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime: 1746129828 -> 1746129829 00002000:00010000:1.0:1746129829.057257:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime: 1746129828 -> 1746129829 00002000:00010000:1.0:1746129829.057259:0:8435:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime: 1746129828 -> 1746129829 00000100:00100000:1.0:1746129829.057279:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054125696:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.057302:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db42a00/0x48868a4e43956949 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d9e expref: 26 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.057313:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db42a00/0x48868a4e43956949 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d9e expref: 26 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.057336:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42a00, rc 0) 00000100:00100000:1.0:1746129829.057375:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1962:x1830949054619904:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4041us (4555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.057382:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16058 00000100:00100000:1.0:1746129829.057641:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01bb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054125824:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.057656:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb75e00/0x48868a4e43956950 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356da5 expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.057664:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb75e00/0x48868a4e43956950 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356da5 expref: 25 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.057672:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb75e00, rc 0) 00000100:00100000:1.0:1746129829.057690:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054620032:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4131us (4680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.057695:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16059 00000100:00100000:0.0:1746129829.066539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.066769:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054620160 00000100:00100000:1.0:1746129829.066776:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054620160 00000100:00100000:1.0:1746129829.069662:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16060 00000100:00100000:1.0:1746129829.069676:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31889:x1830949054620160:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.069693:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.069708:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356dac expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.069733:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 35 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.069740:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.069742:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.069745:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dac expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.069770:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 35 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.069780:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 35 pid: 7976 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.069790:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054125952:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.069883:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.073132:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054125952:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.073156:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dac expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.073171:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43600, rc 0) 00000100:00100000:1.0:1746129829.073205:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:31889:x1830949054620160:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3533us (6671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.073212:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16060 00000100:00100000:0.0:1746129829.073425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.073517:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054620288 00000100:00100000:1.0:1746129829.073522:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054620288 00002000:00100000:1.0:1746129829.073552:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1859584->2097151) req@ffff8800a01b8a80 x1830949054620288/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.073561:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8a80 with x1830949054620288 ext(1859584->2097151) 00010000:00010000:1.0:1746129829.073566:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 36 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.073578:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 36 pid: 7976 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746129829.073583:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01b8a80 00000100:00100000:1.0:1746129829.073609:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1954 00000100:00100000:1.0:1746129829.073616:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054620288:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129829.076130:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054620288:12345-192.168.204.31@tcp:4:cat.0 Request processed in 2508us (2698us total) trans 17179874235 rc 0/0 00000100:00100000:1.0:1746129829.076139:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1954 00002000:00100000:1.0:1746129829.076148:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1859584->2097151) req@ffff8800a01b8a80 x1830949054620288/t17179874235(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.076156:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b8a80 with x1830949054620288 ext(1859584->2097151) 00010000:00010000:1.0:1746129829.076163:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 38 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.076173:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 38 pid: 7976 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746129829.076179:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01b8a80 00000100:00100000:2.0:1746129829.076545:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.079999:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054620544 00000100:00100000:3.0:1746129829.080011:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054620544 00000100:00100000:3.0:1746129829.080064:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11165 00000100:00100000:3.0:1746129829.080072:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+293:31891:x1830949054620544:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129829.080092:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.080106:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e4395695e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356db3 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.080181:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.080193:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 27 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.080199:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.080223:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 27 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.080233:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 27 pid: 1851 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.080243:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054126080:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129829.080329:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c590c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.081317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.081369:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054620672 00000100:00100000:3.0:1746129829.081373:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054620672 00010000:00010000:3.0:1746129829.081393:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 38 pid: 7976 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.081422:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8055 00000100:00100000:3.0:1746129829.081428:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1963:x1830949054620672:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.081437:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.081452:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 38 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.081462:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 38 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.081479:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db42c00/0x48868a4e4395691f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d82 expref: 38 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.081494:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.081495:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.081500:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dac expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.081511:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dac expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.081531:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dac expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129829.081539:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054126208:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129829.081580:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129829.082770:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054126080:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129829.082787:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129829.082946:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.083056:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054620800 00000100:00100000:2.0:1746129829.083061:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054620800 00010000:00010000:2.0:1746129829.083077:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 28 pid: 1851 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.083185:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8056 00000100:00100000:2.0:1746129829.083191:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054620800:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.083202:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.083207:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 28 pid: 1851 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.083215:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 28 pid: 1851 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.083229:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf200/0x48868a4e439568f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d5f expref: 28 pid: 1851 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.085031:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129829.085038:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.085048:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.085054:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.085080:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.085120:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054620800:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1928us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.085127:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8056 00010000:00010000:3.0:1746129829.085276:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.085283:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129829.085299:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129829.085412:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e4395695e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 296 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.085428:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 295 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.085434:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.085437:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129829.085439:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbfa00, rc 0) 00000100:00100000:3.0:1746129829.085471:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31891:x1830949054620544:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 5401us (8928us total) trans 8589945203 rc 0/0 00000100:00100000:3.0:1746129829.085477:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11165 00000100:00100000:0.0:1746129829.086123:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.086176:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054126208:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129829.086191:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.086217:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1963:x1830949054620672:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4789us (4901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.086223:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8055 00000100:00100000:1.0:1746129829.086454:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054621056 00000100:00100000:1.0:1746129829.086459:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054621056 00002000:00100000:1.0:1746129829.086481:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a01b9c00 x1830949054621056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.086490:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9c00 with x1830949054621056 ext(1048576->2097151) 00002000:00010000:1.0:1746129829.086494:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b9c00 00000100:00100000:1.0:1746129829.086505:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7267 00000100:00100000:1.0:1746129829.086510:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054621056:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.095814:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1961:x1830949054621056:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9291us (9680us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129829.095826:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7267 00002000:00100000:1.0:1746129829.095839:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800a01b9c00 x1830949054621056/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.096104:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9c00 with x1830949054621056 ext(1048576->2097151) 00002000:00010000:1.0:1746129829.096109:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01b9c00 00000100:00100000:0.0:1746129829.101477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.101791:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054621184 00000100:00100000:1.0:1746129829.101799:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054621184 00000100:00100000:1.0:1746129829.101844:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16061 00000100:00100000:1.0:1746129829.101876:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31889:x1830949054621184:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.101891:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.101904:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356dba expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.101933:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.101940:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.101941:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.101944:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.101979:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.101989:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 28 pid: 8435 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.102001:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054126336:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.103105:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.104927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.105140:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054126336:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.105161:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.105180:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42c00, rc 0) 00000100:00100000:1.0:1746129829.105215:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31889:x1830949054621184:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3341us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.105223:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16061 00000100:00100000:2.0:1746129829.105477:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054621312 00000100:00100000:2.0:1746129829.105483:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054621312 00002000:00100000:2.0:1746129829.105512:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1675263) req@ffff8800a01b9500 x1830949054621312/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.105520:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9500 with x1830949054621312 ext(1048576->1675263) 00010000:00010000:2.0:1746129829.105527:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 29 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.105538:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 29 pid: 8435 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.105543:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b9500 00000100:00100000:2.0:1746129829.105964:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1955 00000100:00100000:2.0:1746129829.105979:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+29:1962:x1830949054621312:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:3.0:1746129829.120032:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054621312:12345-192.168.204.31@tcp:4:cat.0 Request processed in 14049us (15098us total) trans 21474841433 rc 0/0 00000100:00100000:3.0:1746129829.120044:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1955 00002000:00100000:3.0:1746129829.120056:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1675263) req@ffff8800a01b9500 x1830949054621312/t21474841433(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.120065:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01b9500 with x1830949054621312 ext(1048576->1675263) 00010000:00010000:3.0:1746129829.120074:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.120087:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.120093:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a01b9500 00000100:00100000:0.0:1746129829.125101:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.125254:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054621440 00000100:00100000:3.0:1746129829.125265:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054621440 00010000:00010000:3.0:1746129829.125302:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.125353:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8057 00000100:00100000:3.0:1746129829.125361:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054621440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.125374:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.125392:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.125403:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.125422:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e4395692d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d90 expref: 31 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.125450:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.125452:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.125458:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.125466:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.125492:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129829.125503:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054126464:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129829.125582:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.129096:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.129152:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054621696 00000100:00100000:3.0:1746129829.129159:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054621696 00000100:00100000:3.0:1746129829.129209:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11166 00000100:00100000:3.0:1746129829.129217:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31894:x1830949054621696:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129829.129236:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.129250:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e4395697a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356dc1 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.129327:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.129339:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.129347:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129829.129355:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129829.129442:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e4395697a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 30 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.129455:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 29 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.129462:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.129464:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129829.129467:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbfe00, rc 0) 00000100:00100000:3.0:1746129829.129523:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31894:x1830949054621696:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 303us (428us total) trans 8589945204 rc 0/0 00000100:00100000:3.0:1746129829.129528:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11166 00000100:00100000:3.0:1746129829.130204:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054126464:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129829.130218:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.130253:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054621440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4892us (5158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.130259:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8057 00000100:00100000:0.0:1746129829.136796:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.137006:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054621952 00000100:00100000:2.0:1746129829.137014:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054621952 00002000:00100000:2.0:1746129829.137049:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a01baa00 x1830949054621952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.137058:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01baa00 with x1830949054621952 ext(1048576->2097151) 00002000:00010000:2.0:1746129829.137062:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01baa00 00000100:00100000:2.0:1746129829.137413:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7268 00000100:00100000:2.0:1746129829.137421:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054621952:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.149034:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054621952:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11603us (12235us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129829.149047:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7268 00002000:00100000:1.0:1746129829.149058:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800a01baa00 x1830949054621952/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.149066:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01baa00 with x1830949054621952 ext(1048576->2097151) 00002000:00010000:1.0:1746129829.149071:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01baa00 00000100:00100000:2.0:1746129829.166291:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.166595:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.166651:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.166710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.166738:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054622336 00000100:00100000:2.0:1746129829.166747:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054622336 00002000:00100000:2.0:1746129829.166789:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f938e00 x1830949054622336/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.166804:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830949054622336 ext(2097152->3145727) 00002000:00010000:2.0:1746129829.166809:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938e00 00000100:00100000:2.0:1746129829.166828:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054622592 00000100:00100000:2.0:1746129829.166833:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054622592 00002000:00100000:2.0:1746129829.166876:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f939f80 x1830949054622592/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.166883:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830949054622592 ext(2097152->3145727) 00002000:00010000:2.0:1746129829.166887:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f939f80 00000100:00100000:0.0:1746129829.166887:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054622720 00000100:00100000:2.0:1746129829.166906:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7269 00000100:00100000:2.0:1746129829.166915:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054622336:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129829.166999:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054622720 00002000:00100000:0.0:1746129829.167017:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f938380 x1830949054622720/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746129829.167025:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830949054622720 ext(3145728->4194303) 00002000:00010000:0.0:1746129829.167028:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f938380 00000100:00100000:0.0:1746129829.167046:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7270 00000100:00100000:0.0:1746129829.167051:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054622592:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129829.167619:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7271 00000100:00100000:3.0:1746129829.167629:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054622720:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129829.169026:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054622080 00000100:00100000:1.0:1746129829.169033:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054622080 00000100:00100000:1.0:1746129829.169064:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16062 00000100:00100000:1.0:1746129829.169070:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31894:x1830949054622080:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129829.169081:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.169095:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356dc8 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.169118:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.169126:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 31 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.169137:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.169138:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.169141:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2658304->3080191] (req 2658304->3080191) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 31 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.169173:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 31 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.169183:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 31 pid: 20441 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746129829.169193:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054126592:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.169251:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.169258:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 36 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.169265:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054126720:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.169282:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.178529:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054622592:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 11465us (11867us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129829.178541:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7270 00002000:00100000:2.0:1746129829.178645:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88009f939f80 x1830949054622592/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.178655:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f939f80 with x1830949054622592 ext(2097152->3145727) 00010000:00010000:2.0:1746129829.178665:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 30 pid: 20441 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.178676:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 30 pid: 20441 timeout: 875 lvb_type: 1 00002000:00010000:2.0:1746129829.178682:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f939f80 00000100:00100000:1.0:1746129829.180401:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054126592:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.180414:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10930:1830949054126720:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129829.180414:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129829.180436:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2658304->3080191] (req 2658304->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.180456:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43000, rc 0) 00000100:00100000:1.0:1746129829.180487:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31894:x1830949054622080:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 11416us (14205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.180494:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16062 00000100:00100000:2.0:1746129829.180571:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054622976 00000100:00100000:2.0:1746129829.180588:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054622976 00010000:00010000:2.0:1746129829.180609:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.181054:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054622720:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13427us (14343us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.181062:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7271 00002000:00100000:3.0:1746129829.181069:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88009f938380 x1830949054622720/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.181077:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938380 with x1830949054622720 ext(3145728->4194303) 00010000:00010000:3.0:1746129829.181081:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 27 pid: 20441 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746129829.181089:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 27 pid: 20441 timeout: 875 lvb_type: 1 00002000:00010000:3.0:1746129829.181095:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f938380 00000100:00100000:2.0:1746129829.181154:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8058 00000100:00100000:2.0:1746129829.181161:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054622976:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.181173:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.181187:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.181196:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.181213:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb74e00/0x48868a4e43956903 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d66 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.181241:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.181300:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054622976:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 139us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.181306:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8058 00000100:00100000:3.0:1746129829.182554:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054622336:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 15640us (15959us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.182561:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7269 00002000:00100000:3.0:1746129829.182567:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88009f938e00 x1830949054622336/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.182579:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938e00 with x1830949054622336 ext(2097152->3145727) 00002000:00010000:3.0:1746129829.182582:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938e00 00000100:00100000:0.0:1746129829.184096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.184140:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054623104 00000100:00100000:1.0:1746129829.184155:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054623104 00000100:00100000:1.0:1746129829.184187:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16063 00000100:00100000:1.0:1746129829.184193:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054623104:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.184206:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.184218:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356dcf expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.184237:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.184239:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.184245:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 37 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.184258:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 37 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.184267:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42400, rc 0) 00000100:00100000:1.0:1746129829.184294:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054623104:12345-192.168.204.31@tcp:101:cat.0 Request processed in 102us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.184299:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16063 00000100:00100000:0.0:1746129829.186990:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.187034:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.187056:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054623232 00000100:00100000:1.0:1746129829.187063:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054623232 00000100:00100000:1.0:1746129829.187105:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054623360 00000100:00100000:1.0:1746129829.187108:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054623360 00000100:00100000:1.0:1746129829.187123:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16064 00000100:00100000:1.0:1746129829.187129:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+30:1962:x1830949054623232:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.187141:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.187165:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356dd6 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.187183:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.187185:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.187191:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.187202:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 31 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.187210:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42800, rc 0) 00000100:00100000:2.0:1746129829.187236:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16065 00000100:00100000:1.0:1746129829.187242:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054623232:12345-192.168.204.31@tcp:101:cat.0 Request processed in 113us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.187244:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054623360:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129829.187248:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16064 00010000:00010000:2.0:1746129829.187252:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.187261:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d84a00/0x48868a4e439569a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ddd expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.187277:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.187284:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d84a00/0x48868a4e439569a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ddd expref: 38 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.187292:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d84a00/0x48868a4e439569a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ddd expref: 38 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.187304:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d84a00, rc 0) 00000100:00100000:2.0:1746129829.187322:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054623360:12345-192.168.204.31@tcp:101:cat.0 Request processed in 80us (289us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129829.187327:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16065 00000100:00100000:0.0:1746129829.187603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.187700:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054623488 00000100:00100000:3.0:1746129829.187704:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054623488 00000100:00100000:3.0:1746129829.187736:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16066 00000100:00100000:3.0:1746129829.187743:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31889:x1830949054623488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129829.187750:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.187756:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356de4 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.187768:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.187772:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2658304->3080191] (req 2658304->3080191) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 28 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.187778:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746129829.187780:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.188982:0:7976:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2658304->3080191] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 28 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129829.188996:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129829.189001:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.189010:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbf800, rc 0) 00000100:00100000:3.0:1746129829.189045:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31889:x1830949054623488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1303us (1442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.189052:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16066 00000100:00100000:2.0:1746129829.189310:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054623616 00000100:00100000:2.0:1746129829.189316:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054623616 00010000:00010000:2.0:1746129829.189336:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 28 pid: 20441 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746129829.189354:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8059 00000100:00100000:2.0:1746129829.189359:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054623616:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.189369:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.189387:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 28 pid: 20441 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.189396:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 28 pid: 20441 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.189416:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2db600/0x48868a4e43956918 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d7b expref: 28 pid: 20441 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.189426:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.189428:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.189432:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.189440:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60080000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.189464:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.189473:0:16449:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x70000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.189483:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054126976:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129829.189549:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.190786:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.190836:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054623872 00000100:00100000:3.0:1746129829.190842:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054623872 00002000:00100000:3.0:1746129829.190895:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2658304->2662399) req@ffff8800a01bb480 x1830949054623872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.190903:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb480 with x1830949054623872 ext(2658304->2662399) 00010000:00010000:3.0:1746129829.190910:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 28 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.190920:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 28 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.190925:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01bb480 00000100:00100000:3.0:1746129829.190941:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1956 00000100:00100000:3.0:1746129829.190946:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054623872:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129829.191099:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054623872:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 151us (314us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.191105:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1956 00002000:00100000:3.0:1746129829.191111:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2658304->2662399) req@ffff8800a01bb480 x1830949054623872/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.191118:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01bb480 with x1830949054623872 ext(2658304->2662399) 00010000:00010000:3.0:1746129829.191123:0:21601:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 28 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.191137:0:21601:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 28 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.191142:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a01bb480 00000100:00100000:2.0:1746129829.191306:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054126976:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.191319:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.191337:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054623616:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1978us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.191343:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8059 00000100:00100000:0.0:1746129829.194120:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.194252:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054624128 00000100:00100000:3.0:1746129829.194258:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054624128 00000100:00100000:0.0:1746129829.194272:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00002000:00100000:3.0:1746129829.194293:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800934d4380 x1830949054624128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.194302:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4380 with x1830949054624128 ext(1048576->2097151) 00002000:00010000:3.0:1746129829.194306:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4380 00000100:00100000:1.0:1746129829.194310:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054624384 00000100:00100000:1.0:1746129829.194315:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054624384 00002000:00100000:1.0:1746129829.194337:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800934d7800 x1830949054624384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.194345:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949054624384 ext(1048576->2097151) 00002000:00010000:1.0:1746129829.194348:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000100:00100000:3.0:1746129829.194363:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7272 00000100:00100000:3.0:1746129829.194372:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054624128:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.194693:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7273 00000100:00100000:1.0:1746129829.194711:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054624384:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.195187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.195291:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054624640 00000100:00100000:2.0:1746129829.195297:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054624640 00002000:00100000:2.0:1746129829.195320:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3076096->3080191) req@ffff8800934d7b80 x1830949054624640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.195328:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949054624640 ext(3076096->3080191) 00010000:00010000:2.0:1746129829.195336:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.195349:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.195356:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d7b80 00000100:00100000:2.0:1746129829.195407:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1957 00000100:00100000:2.0:1746129829.195416:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054624640:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129829.195535:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054624640:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 118us (346us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129829.195542:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1957 00002000:00100000:2.0:1746129829.195549:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3076096->3080191) req@ffff8800934d7b80 x1830949054624640/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.195556:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7b80 with x1830949054624640 ext(3076096->3080191) 00010000:00010000:2.0:1746129829.195561:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.195571:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.195580:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d7b80 00000100:00100000:0.0:1746129829.203752:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.204004:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054624896 00000100:00100000:2.0:1746129829.204012:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054624896 00002000:00100000:2.0:1746129829.204046:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2658304->3080191) req@ffff8800934d4700 x1830949054624896/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.204054:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949054624896 ext(2658304->3080191) 00010000:00010000:2.0:1746129829.204062:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.204073:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.204079:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d4700 00000100:00100000:2.0:1746129829.204093:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1958 00000100:00100000:2.0:1746129829.204099:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054624896:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129829.205800:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054624384:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11088us (11521us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129829.205811:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7273 00002000:00100000:0.0:1746129829.205818:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff8800934d7800 x1830949054624384/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129829.205826:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d7800 with x1830949054624384 ext(1048576->2097151) 00002000:00010000:0.0:1746129829.205830:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d7800 00000100:00100000:3.0:1746129829.208266:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054624128:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13888us (14145us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.208275:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7272 00002000:00100000:3.0:1746129829.208284:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f3:0x0] (1048576->2097151) req@ffff8800934d4380 x1830949054624128/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.208293:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4380 with x1830949054624128 ext(1048576->2097151) 00002000:00010000:3.0:1746129829.208297:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4380 00000100:00100000:2.0:1746129829.214535:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054624896:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 10427us (10782us total) trans 17179874236 rc 0/0 00000100:00100000:2.0:1746129829.214546:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1958 00002000:00100000:2.0:1746129829.214556:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2658304->3080191) req@ffff8800934d4700 x1830949054624896/t17179874236(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.214565:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4700 with x1830949054624896 ext(2658304->3080191) 00010000:00010000:2.0:1746129829.214573:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.214593:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.214599:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800934d4700 00000100:00100000:0.0:1746129829.218838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.218990:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054625024 00000100:00100000:2.0:1746129829.218997:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054625024 00010000:00010000:2.0:1746129829.219063:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746129829.219569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.219735:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8060 00000100:00100000:2.0:1746129829.219741:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054625024:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.219750:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.219768:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x60000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.219779:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.219797:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db43000/0x48868a4e4395698f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2658304->3080191) gid 0 flags: 0x44801000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc8 expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.219813:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.219814:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.219820:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.219831:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.219900:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129829.219912:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054127104:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129829.220015:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acc68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129829.220268:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054625152 00000100:00100000:3.0:1746129829.220272:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054625152 00000100:00100000:3.0:1746129829.220298:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16067 00000100:00100000:3.0:1746129829.220304:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:31897:x1830949054625152:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129829.220317:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.220325:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356deb expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.220338:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.220339:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.220343:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.220353:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 38 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.220359:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbf000, rc 0) 00000100:00100000:3.0:1746129829.220396:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31897:x1830949054625152:12345-192.168.204.31@tcp:101:cat.0 Request processed in 92us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.220401:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16067 00000100:00100000:2.0:1746129829.223012:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:16449:1830949054127104:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.223029:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.223074:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054625024:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3331us (4241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.223082:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8060 00000100:00100000:0.0:1746129829.226604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.226762:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.228051:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054625536 00000100:00100000:2.0:1746129829.228060:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054625536 00002000:00100000:2.0:1746129829.228097:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800934d4e00 x1830949054625536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.228106:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4e00 with x1830949054625536 ext(3145728->4194303) 00002000:00010000:2.0:1746129829.228110:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4e00 00000100:00100000:2.0:1746129829.228122:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054625408 00000100:00100000:2.0:1746129829.228124:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054625408 00002000:00100000:2.0:1746129829.228132:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800934d4a80 x1830949054625408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.228138:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4a80 with x1830949054625408 ext(2097152->3145727) 00002000:00010000:2.0:1746129829.228141:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4a80 00000100:00100000:2.0:1746129829.228150:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7274 00000100:00100000:2.0:1746129829.228156:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054625536:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.228466:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7275 00000100:00100000:0.0:1746129829.228473:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054625408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.229440:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.229456:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054625920 00000100:00100000:1.0:1746129829.229460:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054625920 00002000:00100000:1.0:1746129829.229477:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba1b480 x1830949054625920/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.229484:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1b480 with x1830949054625920 ext(2097152->3145727) 00002000:00010000:1.0:1746129829.229487:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1b480 00000100:00100000:1.0:1746129829.229498:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7276 00000100:00100000:1.0:1746129829.229502:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054625920:12345-192.168.204.31@tcp:3:multiop.0 00010000:00010000:2.0:1746129829.230362:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129829.230624:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.231106:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054626176 00000100:00100000:1.0:1746129829.231111:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054626176 00002000:00100000:1.0:1746129829.231132:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800934d5c00 x1830949054626176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.231139:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5c00 with x1830949054626176 ext(3145728->4194303) 00002000:00010000:1.0:1746129829.231143:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d5c00 00000100:00100000:1.0:1746129829.231156:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7277 00000100:00100000:1.0:1746129829.231161:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054626176:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:0.0:1746129829.231213:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.231230:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054626304 00000100:00100000:0.0:1746129829.231233:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054626304 00000100:00100000:0.0:1746129829.231253:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16068 00000100:00100000:0.0:1746129829.231258:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:31891:x1830949054626304:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:0.0:1746129829.231266:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129829.231279:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356df2 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.231298:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.231305:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129829.231311:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129829.231313:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129829.231315:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1114112->1982463] (req 1114112->1982463) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 32 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.231336:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129829.231344:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 875 lvb_type: 1 00000100:00100000:0.0:1746129829.231353:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c679500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127232:192.168.204.31@tcp:104: 00010000:00010000:0.0:1746129829.231410:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.231417:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 24 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746129829.231522:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c67a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127360:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129829.231539:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.236034:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c679500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127232:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129829.236549:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054625408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8073us (9784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129829.236558:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7275 00002000:00100000:2.0:1746129829.236568:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff8800934d4a80 x1830949054625408/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.236578:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4a80 with x1830949054625408 ext(2097152->3145727) 00002000:00010000:2.0:1746129829.236582:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4a80 00000100:00100000:1.0:1746129829.237716:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c67a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127360:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.237738:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1114112->1982463] (req 1114112->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 32 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.237756:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fac4600, rc 0) 00000100:00100000:1.0:1746129829.237790:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:31891:x1830949054626304:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6531us (6576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.237797:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16068 00000100:00100000:0.0:1746129829.243230:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.243265:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.244028:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054625920:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 14523us (14588us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129829.244039:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7276 00002000:00100000:1.0:1746129829.244048:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba1b480 x1830949054625920/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.244056:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1b480 with x1830949054625920 ext(2097152->3145727) 00002000:00010000:1.0:1746129829.244061:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba1b480 00000100:00100000:2.0:1746129829.244245:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054626432 00000100:00100000:2.0:1746129829.244252:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054626432 00000100:00100000:3.0:1746129829.244277:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054626560 00010000:00010000:2.0:1746129829.244277:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746129829.244281:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054626560 00010000:00010000:3.0:1746129829.244297:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 25 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.244297:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8061 00000100:00100000:3.0:1746129829.244312:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8062 00000100:00100000:3.0:1746129829.244317:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1963:x1830949054626560:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.244330:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.244347:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 25 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.244359:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 25 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.244377:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e43956973 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dba expref: 25 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.244396:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.244411:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054626560:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 95us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.244416:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8062 00000100:00100000:2.0:1746129829.244488:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054626432:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.244496:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.244504:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.244820:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.244835:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db42800/0x48868a4e4395699d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dd6 expref: 32 pid: 10930 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.244859:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.244861:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.244867:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.244873:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.244906:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 31 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129829.244915:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054127488:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129829.244957:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.245031:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054626176:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 13869us (14406us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129829.245037:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7277 00002000:00100000:1.0:1746129829.245043:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800934d5c00 x1830949054626176/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.245049:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d5c00 with x1830949054626176 ext(3145728->4194303) 00002000:00010000:1.0:1746129829.245052:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d5c00 00000100:00100000:3.0:1746129829.245577:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054625536:12345-192.168.204.31@tcp:3:cat.0 Request processed in 17420us (18979us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.245584:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7274 00002000:00100000:3.0:1746129829.245589:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff8800934d4e00 x1830949054625536/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.245596:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4e00 with x1830949054625536 ext(3145728->4194303) 00002000:00010000:3.0:1746129829.245599:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800934d4e00 00000100:00100000:2.0:1746129829.247431:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054127488:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.247449:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.247490:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1961:x1830949054626432:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3186us (4266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.247498:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8061 00000100:00100000:0.0:1746129829.247888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.248043:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054626816 00000100:00100000:3.0:1746129829.248049:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054626816 00002000:00100000:3.0:1746129829.248083:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1114112->1118207) req@ffff88009c679c00 x1830949054626816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.248092:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679c00 with x1830949054626816 ext(1114112->1118207) 00002000:00010000:3.0:1746129829.248095:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c679c00 00000100:00100000:3.0:1746129829.248121:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7278 00000100:00100000:3.0:1746129829.248128:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054626816:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129829.248267:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054626816:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 138us (378us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.248273:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7278 00002000:00100000:3.0:1746129829.248277:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1114112->1118207) req@ffff88009c679c00 x1830949054626816/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.248284:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c679c00 with x1830949054626816 ext(1114112->1118207) 00002000:00010000:3.0:1746129829.248286:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c679c00 00000100:00100000:0.0:1746129829.253628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.254332:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054626944 00000100:00100000:1.0:1746129829.254341:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054626944 00000100:00100000:1.0:1746129829.254391:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16069 00000100:00100000:1.0:1746129829.254398:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054626944:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.254416:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.254430:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43800/0x48868a4e439569c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356df9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.255195:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127616:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129829.256308:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.258536:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127616:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.258559:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43800/0x48868a4e439569c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df9 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.258570:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43800/0x48868a4e439569c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df9 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.258593:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43800, rc 0) 00000100:00100000:1.0:1746129829.258632:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1961:x1830949054626944:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4234us (5012us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.258940:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16069 00000100:00100000:0.0:1746129829.259747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.259870:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054627200 00000100:00100000:1.0:1746129829.259875:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054627200 00002000:00100000:1.0:1746129829.259905:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1978368->1982463) req@ffff88009c678a80 x1830949054627200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.259914:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678a80 with x1830949054627200 ext(1978368->1982463) 00002000:00010000:1.0:1746129829.259918:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c678a80 00000100:00100000:1.0:1746129829.259944:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7279 00000100:00100000:1.0:1746129829.259950:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054627200:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.260087:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054627200:12345-192.168.204.31@tcp:3:cat.0 Request processed in 136us (340us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129829.260092:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7279 00002000:00100000:1.0:1746129829.260098:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1978368->1982463) req@ffff88009c678a80 x1830949054627200/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.260104:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c678a80 with x1830949054627200 ext(1978368->1982463) 00002000:00010000:1.0:1746129829.260107:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c678a80 00000100:00100000:0.0:1746129829.262362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.262466:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054627328 00000100:00100000:1.0:1746129829.262472:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054627328 00000100:00100000:1.0:1746129829.262516:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16070 00000100:00100000:1.0:1746129829.262522:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054627328:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.262535:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.262548:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db42a00/0x48868a4e439569c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e00 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.262587:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127744:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129829.262660:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.263532:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127744:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.263550:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db42a00/0x48868a4e439569c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e00 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.263560:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db42a00/0x48868a4e439569c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e00 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.263582:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42a00, rc 0) 00000100:00100000:1.0:1746129829.263680:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1964:x1830949054627328:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1157us (1324us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.263687:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16070 00000100:00100000:0.0:1746129829.265689:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.265805:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054627456 00000100:00100000:1.0:1746129829.265811:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054627456 00000100:00100000:1.0:1746129829.265879:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16071 00000100:00100000:1.0:1746129829.265886:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054627456:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.265901:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.265914:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43400/0x48868a4e439569ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e07 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.265953:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127872:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129829.266038:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584300 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.267099:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054127872:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.267122:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43400/0x48868a4e439569ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e07 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.267132:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43400/0x48868a4e439569ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e07 expref: 25 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.267141:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43400, rc 0) 00000100:00100000:1.0:1746129829.267165:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1963:x1830949054627456:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1280us (1481us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.267171:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16071 00000100:00100000:0.0:1746129829.385303:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.385362:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054627712 00000100:00100000:1.0:1746129829.385373:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054627712 00002000:00100000:1.0:1746129829.385417:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009c67bb80 x1830949054627712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 504/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.385425:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67bb80 with x1830949054627712 ext(1048576->2097151) 00002000:00010000:1.0:1746129829.385430:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67bb80 00000100:00100000:1.0:1746129829.385458:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7280 00000100:00100000:1.0:1746129829.385464:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054627712:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.388145:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1962:x1830949054627712:12345-192.168.204.31@tcp:3:cat.0 Request processed in 2673us (2840us total) trans 0 rc 180224/180224 00000100:00100000:1.0:1746129829.388156:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7280 00002000:00100000:1.0:1746129829.388165:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009c67bb80 x1830949054627712/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 504/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 180224/180224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.388174:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67bb80 with x1830949054627712 ext(1048576->2097151) 00002000:00010000:1.0:1746129829.388178:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c67bb80 00000100:00100000:0.0:1746129829.486199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.486292:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054627840 00000100:00100000:1.0:1746129829.486299:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054627840 00000100:00100000:1.0:1746129829.486347:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16072 00000100:00100000:1.0:1746129829.486354:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31907:x1830949054627840:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129829.486370:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.486384:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e0e expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.486408:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.486415:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.486417:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.486420:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1556480->2097151] (req 1556480->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.486443:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.486453:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 30 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.486464:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054128000:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.486625:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.491032:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054128000:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.491058:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1556480->2097151] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 25 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.491072:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43e00, rc 0) 00000100:00100000:1.0:1746129829.491118:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31907:x1830949054627840:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 4763us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.491125:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16072 00000100:00100000:0.0:1746129829.491534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.491592:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054627968 00000100:00100000:1.0:1746129829.491597:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054627968 00002000:00100000:1.0:1746129829.491626:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1114112->1982463) req@ffff88009c67aa00 x1830949054627968/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.491634:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67aa00 with x1830949054627968 ext(1114112->1982463) 00010000:00010000:1.0:1746129829.491640:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 31 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.491650:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 31 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746129829.491656:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c67aa00 00000100:00100000:1.0:1746129829.491679:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1959 00000100:00100000:1.0:1746129829.491685:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+31:1963:x1830949054627968:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:0.0:1746129829.505688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.505894:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628096 00000100:00100000:1.0:1746129829.505902:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628096 00000100:00100000:1.0:1746129829.506481:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16073 00000100:00100000:1.0:1746129829.506489:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:31909:x1830949054628096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129829.506504:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.506516:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e15 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.506538:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.506546:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.506654:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.506655:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.506659:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2670592->2781183] (req 2670592->2781183) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 34 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.506689:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.506699:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 24 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.506708:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054128128:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.507474:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.507482:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.507490:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054128256:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.508587:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.518619:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054627968:12345-192.168.204.31@tcp:4:cat.0 Request processed in 26925us (27078us total) trans 21474841434 rc 0/0 00000100:00100000:1.0:1746129829.518630:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1959 00002000:00100000:1.0:1746129829.518639:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1114112->1982463) req@ffff88009c67aa00 x1830949054627968/t21474841434(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.518648:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c67aa00 with x1830949054627968 ext(1114112->1982463) 00010000:00010000:1.0:1746129829.518657:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 35 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.518675:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 35 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746129829.518682:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c67aa00 00000100:00100000:0.0:1746129829.519704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.519747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.521250:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054128128:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.521262:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054128256:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.521286:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2670592->2781183] (req 2670592->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 34 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.521301:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42200, rc 0) 00000100:00100000:1.0:1746129829.521354:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31909:x1830949054628096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 14865us (15671us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.521361:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16073 00000100:00100000:1.0:1746129829.521385:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628224 00000100:00100000:1.0:1746129829.521389:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628224 00000100:00100000:1.0:1746129829.521417:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628352 00000100:00100000:1.0:1746129829.521419:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628352 00000100:00100000:1.0:1746129829.521432:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16074 00000100:00100000:1.0:1746129829.521437:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054628224:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.521448:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.521461:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43000/0x48868a4e439569e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e1c expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.521494:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054128384:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129829.521545:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584180 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.521556:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16075 00000100:00100000:1.0:1746129829.521561:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054628352:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.521566:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.521572:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43c00/0x48868a4e439569ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e23 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.521581:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.521588:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43c00/0x48868a4e439569ea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e23 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.521596:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43c00/0x48868a4e439569ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e23 expref: 28 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.521607:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43c00, rc 0) 00000100:00100000:1.0:1746129829.521622:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054628352:12345-192.168.204.31@tcp:101:cat.0 Request processed in 61us (1874us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.521626:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16075 00000100:00100000:0.0:1746129829.522530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.522712:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628480 00000100:00100000:2.0:1746129829.522717:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628480 00010000:00010000:2.0:1746129829.522735:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.522757:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8063 00000100:00100000:2.0:1746129829.522763:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054628480:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.522770:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.522788:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.522796:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.522812:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d43ac00/0x48868a4e4395688c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d20 expref: 34 pid: 8436 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.522839:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.522889:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1961:x1830949054628480:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 125us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.522894:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8063 00000100:00100000:0.0:1746129829.523607:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.523639:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.523692:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628736 00000100:00100000:3.0:1746129829.523695:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628736 00010000:00010000:3.0:1746129829.523712:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 33 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.523725:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628608 00000100:00100000:3.0:1746129829.523727:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628608 00010000:00010000:3.0:1746129829.523734:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.523754:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8064 00000100:00100000:3.0:1746129829.523758:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+33:1964:x1830949054628736:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.523765:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746129829.523774:0:7107:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129829 -> 1746129830 00010000:00010000:3.0:1746129829.523779:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 33 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.523786:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 33 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.523798:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.523800:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.523805:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.523813:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.523835:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 27 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129829.523844:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054128512:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129829.523931:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8065 00000100:00100000:0.0:1746129829.523937:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1962:x1830949054628608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129829.523944:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129829.523951:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746129829.523960:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746129829.523981:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb74600/0x48868a4e439568b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d4a expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746129829.523991:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129829.523993:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129829.523996:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.524007:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.524024:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 33 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129829.524031:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054128640:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129829.524078:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129829.524321:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746129829.530080:0:10930:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88012ba19500 x1830949054128384) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 33 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.530113:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fac4600/0x48868a4e439569b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1114112->1982463) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356df2 expref: 33 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.530128:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054128384:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.530153:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43000/0x48868a4e439569e3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e1c expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.530163:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43000/0x48868a4e439569e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e1c expref: 26 pid: 10930 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746129829.530169:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054128512:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129829.530169:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43000, rc 0) 00010000:00010000:3.0:1746129829.530182:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.530202:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054628736:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6443us (6595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.530215:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8064 00000100:00100000:2.0:1746129829.530278:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a00c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054128640:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.530289:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129829.530320:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054628224:12345-192.168.204.31@tcp:101:cat.0 Request processed in 8882us (10618us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.530325:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16074 00000100:00100000:2.0:1746129829.530456:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:1962:x1830949054628608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6518us (6816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.530462:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8065 00000100:00100000:0.0:1746129829.530629:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.530719:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054628992 00000100:00100000:1.0:1746129829.530724:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054628992 00002000:00100000:1.0:1746129829.530750:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2670592->2674687) req@ffff8800a00c7800 x1830949054628992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.530759:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7800 with x1830949054628992 ext(2670592->2674687) 00002000:00010000:1.0:1746129829.530763:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c7800 00000100:00100000:1.0:1746129829.530785:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7281 00000100:00100000:1.0:1746129829.530791:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054628992:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129829.531037:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1963:x1830949054628992:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 246us (408us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746129829.531043:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7281 00002000:00100000:1.0:1746129829.531048:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2670592->2674687) req@ffff8800a00c7800 x1830949054628992/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.531055:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c7800 with x1830949054628992 ext(2670592->2674687) 00002000:00010000:1.0:1746129829.531058:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c7800 00000100:00100000:0.0:1746129829.536649:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.536697:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.536711:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054629120 00000100:00100000:1.0:1746129829.536720:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054629120 00000100:00100000:2.0:1746129829.536951:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054629376 00000100:00100000:2.0:1746129829.536956:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054629376 00002000:00100000:2.0:1746129829.536993:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2777088->2781183) req@ffff8800a00c4a80 x1830949054629376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.537013:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949054629376 ext(2777088->2781183) 00002000:00010000:2.0:1746129829.537017:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c4a80 00000100:00100000:1.0:1746129829.537469:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16076 00000100:00100000:1.0:1746129829.537477:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+24:31907:x1830949054629120:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129829.537488:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.537741:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e2a expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.537767:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 32 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.537773:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.537775:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.537778:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->2179071] (req 2097152->2179071) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.537807:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 32 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.537818:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 32 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.537829:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054128768:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.537906:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.538873:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1960 00000100:00100000:2.0:1746129829.538886:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054629376:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129829.539029:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1964:x1830949054629376:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 144us (2331us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129829.539034:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1960 00002000:00100000:2.0:1746129829.539040:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2777088->2781183) req@ffff8800a00c4a80 x1830949054629376/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.539049:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c4a80 with x1830949054629376 ext(2777088->2781183) 00010000:00010000:2.0:1746129829.539054:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 32 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.539064:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 32 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.539070:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a00c4a80 00000100:00100000:1.0:1746129829.540318:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054128768:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.540336:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->2179071] (req 2097152->2179071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 25 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.540348:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db43a00, rc 0) 00000100:00100000:1.0:1746129829.540382:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:31907:x1830949054629120:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2906us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.540388:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16076 00000100:00100000:0.0:1746129829.540704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.540736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.540745:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054629632 00000100:00100000:2.0:1746129829.540750:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054629632 00002000:00100000:2.0:1746129829.540770:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1556479) req@ffff8800a00c6a00 x1830949054629632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.540778:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6a00 with x1830949054629632 ext(1048576->1556479) 00002000:00010000:2.0:1746129829.540781:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6a00 00000100:00100000:1.0:1746129829.540924:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054629760 00000100:00100000:1.0:1746129829.540928:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054629760 00000100:00100000:3.0:1746129829.541521:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7283 00000100:00100000:1.0:1746129829.541537:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16077 00000100:00100000:1.0:1746129829.541543:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+32:1961:x1830949054629760:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.541552:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.541563:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e439569f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e31 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.541625:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054128896:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129829.541892:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054629632:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.541999:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.542151:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.542198:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054630016 00000100:00100000:2.0:1746129829.542202:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054630016 00002000:00100000:2.0:1746129829.542218:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2670592->2781183) req@ffff8800a00c6300 x1830949054630016/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.542225:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6300 with x1830949054630016 ext(2670592->2781183) 00010000:00010000:2.0:1746129829.542230:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 34 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.542239:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 34 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.542245:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a00c6300 00000100:00100000:2.0:1746129829.542266:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1961 00000100:00100000:2.0:1746129829.542272:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054630016:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:1.0:1746129829.546563:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054128896:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.546593:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e439569f8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e31 expref: 35 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.546605:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db42c00/0x48868a4e439569f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e31 expref: 35 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.546637:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db42c00, rc 0) 00000100:00100000:1.0:1746129829.546683:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1961:x1830949054629760:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5140us (5946us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.546694:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16077 00000100:00100000:2.0:1746129829.547397:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1964:x1830949054629632:12345-192.168.204.31@tcp:3:cat.0 Request processed in 5866us (6691us total) trans 0 rc 507904/507904 00000100:00100000:2.0:1746129829.547405:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7283 00002000:00100000:2.0:1746129829.547412:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->1556479) req@ffff8800a00c6a00 x1830949054629632/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 507904/507904 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.547421:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6a00 with x1830949054629632 ext(1048576->1556479) 00002000:00010000:2.0:1746129829.547425:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a00c6a00 00000100:00100000:2.0:1746129829.548388:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1964:x1830949054630016:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 6114us (6387us total) trans 21474841435 rc 0/0 00000100:00100000:2.0:1746129829.548394:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1961 00002000:00100000:2.0:1746129829.548399:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2670592->2781183) req@ffff8800a00c6300 x1830949054630016/t21474841435(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.548412:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a00c6300 with x1830949054630016 ext(2670592->2781183) 00010000:00010000:2.0:1746129829.548418:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 34 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.548429:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 34 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.548436:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a00c6300 00000100:00100000:0.0:1746129829.552204:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.552293:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.552373:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054630272 00000100:00100000:1.0:1746129829.552382:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054630272 00000100:00100000:1.0:1746129829.552430:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16078 00000100:00100000:1.0:1746129829.552436:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31915:x1830949054630272:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.552451:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.552466:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e38 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.552489:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.552501:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.552503:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.552505:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.552532:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 24 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.552543:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 24 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.552554:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054129024:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.552617:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.552804:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054630144 00000100:00100000:2.0:1746129829.552808:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054630144 00010000:00010000:2.0:1746129829.552824:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 36 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.552838:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8066 00000100:00100000:2.0:1746129829.552842:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054630144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.552980:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129829.552995:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129829 -> 1746129830 00002000:00010000:2.0:1746129829.552997:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129829 -> 1746129830 00010000:00010000:2.0:1746129829.553002:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 36 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.553010:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 36 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.553025:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db42200/0x48868a4e439569dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2670592->2781183) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e15 expref: 36 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.553048:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.553050:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.554247:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.554260:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.554285:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 24 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129829.554294:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054129152:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129829.554355:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.555634:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054129024:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129829.555634:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129829.555653:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 35 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.555664:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba35200, rc 0) 00000100:00100000:2.0:1746129829.555709:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054630400 00000100:00100000:2.0:1746129829.555714:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054630400 00002000:00100000:2.0:1746129829.555743:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1556480->2097151) req@ffff88009b00ed80 x1830949054630400/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.555755:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ed80 with x1830949054630400 ext(1556480->2097151) 00010000:00010000:2.0:1746129829.555762:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 25 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.555772:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 25 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.555777:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00ed80 00000100:00100000:2.0:1746129829.555807:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1962 00000100:00100000:2.0:1746129829.555813:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+25:1961:x1830949054630400:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:1.0:1746129829.555969:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31915:x1830949054630272:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3524us (3667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.555975:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16078 00000100:00100000:2.0:1746129829.556181:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054129152:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.556190:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.556220:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1962:x1830949054630144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3377us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.556227:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8066 00000100:00100000:2.0:1746129829.557187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.557343:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054630656 00000100:00100000:3.0:1746129829.557347:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054630656 00002000:00100000:3.0:1746129829.557369:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2174976->2179071) req@ffff88009f938a80 x1830949054630656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.557381:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830949054630656 ext(2174976->2179071) 00002000:00010000:3.0:1746129829.557384:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:3.0:1746129829.557475:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7284 00000100:00100000:3.0:1746129829.557481:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054630656:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129829.557594:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054630656:12345-192.168.204.31@tcp:3:cat.0 Request processed in 114us (408us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.557600:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7284 00002000:00100000:3.0:1746129829.557605:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2174976->2179071) req@ffff88009f938a80 x1830949054630656/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.557612:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f938a80 with x1830949054630656 ext(2174976->2179071) 00002000:00010000:3.0:1746129829.557614:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f938a80 00000100:00100000:2.0:1746129829.565178:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054630400:12345-192.168.204.31@tcp:4:cat.0 Request processed in 9357us (9538us total) trans 21474841436 rc 0/0 00000100:00100000:2.0:1746129829.565188:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1962 00002000:00100000:2.0:1746129829.565198:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3ef:0x0] (1556480->2097151) req@ffff88009b00ed80 x1830949054630400/t21474841436(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.565206:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ed80 with x1830949054630400 ext(1556480->2097151) 00010000:00010000:2.0:1746129829.565214:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 27 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.565225:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 27 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.565231:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00ed80 00000100:00100000:0.0:1746129829.566218:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.566258:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.566659:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054631040 00000100:00100000:2.0:1746129829.566666:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054631040 00002000:00100000:2.0:1746129829.566692:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (3227648->4194303) req@ffff88009b00df80 x1830949054631040/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.566706:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949054631040 ext(3227648->4194303) 00002000:00010000:2.0:1746129829.566709:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00df80 00000100:00100000:2.0:1746129829.566734:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054630912 00000100:00100000:2.0:1746129829.566736:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054630912 00002000:00100000:2.0:1746129829.566745:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (2179072->3227647) req@ffff88009b00dc00 x1830949054630912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.566751:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949054630912 ext(2179072->3227647) 00002000:00010000:2.0:1746129829.566753:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:2.0:1746129829.566770:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7285 00000100:00100000:2.0:1746129829.566775:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054631040:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129829.566778:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7286 00000100:00100000:3.0:1746129829.566787:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054630912:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.568046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.568071:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054631296 00000100:00100000:2.0:1746129829.568075:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054631296 00010000:00010000:2.0:1746129829.568093:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 31 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.568117:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8067 00000100:00100000:2.0:1746129829.568122:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054631296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.568133:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746129829.568144:0:7108:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129829 -> 1746129830 00002000:00010000:2.0:1746129829.568147:0:7108:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129829 -> 1746129830 00010000:00010000:2.0:1746129829.568152:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 31 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.568161:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 31 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.568179:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43e00/0x48868a4e439569d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1556480->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e0e expref: 31 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.568201:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.568203:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.568209:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.568216:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.568242:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 33 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129829.568252:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054129280:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129829.568311:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.574709:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054631040:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7926us (8485us total) trans 0 rc 966656/966656 00000100:00100000:2.0:1746129829.574719:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7285 00002000:00100000:2.0:1746129829.574728:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3227648->4194303) req@ffff88009b00df80 x1830949054631040/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 966656/966656 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.574736:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00df80 with x1830949054631040 ext(3227648->4194303) 00002000:00010000:2.0:1746129829.574741:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00df80 00000100:00100000:2.0:1746129829.576057:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054129280:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.576076:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.576563:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054631296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 8438us (8517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.576571:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8067 00000100:00100000:3.0:1746129829.576736:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1964:x1830949054630912:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9951us (10476us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.576744:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7286 00002000:00100000:3.0:1746129829.576750:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2179072->3227647) req@ffff88009b00dc00 x1830949054630912/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.576757:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00dc00 with x1830949054630912 ext(2179072->3227647) 00002000:00010000:3.0:1746129829.576761:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00dc00 00000100:00100000:0.0:1746129829.577724:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.578174:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054631552 00000100:00100000:3.0:1746129829.578181:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054631552 00002000:00100000:3.0:1746129829.578216:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00fb80 x1830949054631552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.578224:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054631552 ext(1048576->2097151) 00002000:00010000:3.0:1746129829.578228:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00fb80 00000100:00100000:3.0:1746129829.578259:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7287 00000100:00100000:3.0:1746129829.578267:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054631552:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.586553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.589244:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054631680 00000100:00100000:1.0:1746129829.589255:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054631680 00000100:00100000:1.0:1746129829.589304:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16079 00000100:00100000:1.0:1746129829.589312:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+26:1963:x1830949054631680:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.589327:0:10930:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.589342:0:10930:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e43956a06 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e3f expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.589360:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.589362:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.589369:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e43956a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e3f expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.589382:0:10930:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e43956a06 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e3f expref: 27 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.589393:0:10930:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880134ca7c00, rc 0) 00000100:00100000:1.0:1746129829.589435:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1963:x1830949054631680:12345-192.168.204.31@tcp:101:cat.0 Request processed in 124us (2890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.589441:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16079 00000100:00100000:3.0:1746129829.589890:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:1963:x1830949054631552:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11623us (12165us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.589897:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7287 00002000:00100000:3.0:1746129829.589904:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009b00fb80 x1830949054631552/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.589912:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00fb80 with x1830949054631552 ext(1048576->2097151) 00002000:00010000:3.0:1746129829.589917:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00fb80 00000100:00100000:0.0:1746129829.596976:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.597086:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054631936 00000100:00100000:2.0:1746129829.597095:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054631936 00000100:00100000:2.0:1746129829.597262:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16080 00000100:00100000:2.0:1746129829.597270:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+34:31915:x1830949054631936:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129829.597285:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.597298:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e46 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.597324:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.597331:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129829.597332:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129829.597335:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.597358:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 26 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.597367:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 26 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.597377:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054129408:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129829.597456:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.600727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.600794:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054632064 00000100:00100000:3.0:1746129829.600802:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054632064 00002000:00100000:3.0:1746129829.600841:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009b00c380 x1830949054632064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.600885:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949054632064 ext(4194304->4931583) 00010000:00010000:3.0:1746129829.600892:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.600904:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 27 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.600909:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00c380 00000100:00100000:3.0:1746129829.600938:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1963 00000100:00100000:3.0:1746129829.600946:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1964:x1830949054632064:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.603227:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.603283:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054632192 00000100:00100000:1.0:1746129829.603289:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054632192 00002000:00100000:1.0:1746129829.603316:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2179071) req@ffff88009b00d880 x1830949054632192/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.603324:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949054632192 ext(2097152->2179071) 00010000:00010000:1.0:1746129829.603332:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.603339:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054129408:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.603344:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746129829.603350:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00d880 00010000:00010000:2.0:1746129829.603359:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 35 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.603364:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1964 00000100:00100000:1.0:1746129829.603370:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054632192:12345-192.168.204.31@tcp:4:cat.0 00010000:00010000:2.0:1746129829.603371:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba84200, rc 0) 00000100:00100000:2.0:1746129829.603399:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31915:x1830949054631936:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6130us (6441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.603405:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16080 00000100:00100000:3.0:1746129829.608417:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054632064:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7465us (7691us total) trans 0 rc 737280/737280 00000100:00100000:1.0:1746129829.608417:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054632192:12345-192.168.204.31@tcp:4:cat.0 Request processed in 5040us (5188us total) trans 21474841437 rc 0/0 00000100:00100000:3.0:1746129829.608428:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1963 00000100:00100000:1.0:1746129829.608432:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1964 00002000:00100000:3.0:1746129829.608437:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009b00c380 x1830949054632064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.608438:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->2179071) req@ffff88009b00d880 x1830949054632192/t21474841437(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.608445:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00c380 with x1830949054632064 ext(4194304->4931583) 00002000:00100000:1.0:1746129829.608446:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00d880 with x1830949054632192 ext(2097152->2179071) 00010000:00010000:3.0:1746129829.608454:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 30 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.608455:0:2677:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 30 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.608466:0:2677:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 30 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746129829.608476:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00d880 00010000:00010000:3.0:1746129829.608584:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 29 pid: 10930 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.608591:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b00c380 00000100:00100000:0.0:1746129829.614085:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.619148:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.619260:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054632320 00000100:00100000:2.0:1746129829.619267:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054632448 00000100:00100000:3.0:1746129829.619268:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054632320 00000100:00100000:2.0:1746129829.619272:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054632448 00010000:00010000:2.0:1746129829.619300:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 30 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.619311:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16081 00000100:00100000:3.0:1746129829.619318:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1963:x1830949054632320:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:2.0:1746129829.619322:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8068 00000100:00100000:2.0:1746129829.619328:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054632448:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.619331:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.619340:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.619342:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009adbe200/0x48868a4e43956a14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e4d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129829.619355:0:7108:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129829 -> 1746129830 00010000:00010000:2.0:1746129829.619360:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 31 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.619371:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 31 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.619386:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054129536:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129829.619387:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.619388:0:7108:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.619395:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 34 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.619402:0:7108:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 34 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.619420:0:7108:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 34 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129829.619440:0:7108:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054129664:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129829.619458:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59600 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.619467:0:7108:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00010000:00010000:3.0:1746129829.625727:0:8435:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88012b7d8000 x1830949054129536) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 31 pid: 10930 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.625760:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db43a00/0x48868a4e439569f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2179071) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e2a expref: 31 pid: 10930 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.625788:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8435:1830949054129536:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129829.625817:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009adbe200/0x48868a4e43956a14 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e4d expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129829.625827:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009adbe200/0x48868a4e43956a14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e4d expref: 30 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129829.625834:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbe200, rc 0) 00000100:00100000:2.0:1746129829.626739:0:7108:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7108:1830949054129664:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129829.626750:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.626909:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054632320:12345-192.168.204.31@tcp:101:cat.0 Request processed in 7589us (7765us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129829.626916:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16081 00000100:00100000:2.0:1746129829.627032:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054632448:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 7703us (12956us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.627040:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8068 00000100:00100000:1.0:1746129829.627136:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.627442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.627489:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054632704 00000100:00100000:1.0:1746129829.627495:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054632704 00002000:00100000:1.0:1746129829.627524:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ba19500 x1830949054632704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.627532:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19500 with x1830949054632704 ext(2097152->3145727) 00002000:00010000:1.0:1746129829.627536:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19500 00000100:00100000:1.0:1746129829.627557:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054632960 00000100:00100000:1.0:1746129829.627560:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054632960 00002000:00100000:1.0:1746129829.627569:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009b00ce00 x1830949054632960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.627574:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ce00 with x1830949054632960 ext(3145728->4194303) 00002000:00010000:1.0:1746129829.627576:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ce00 00000100:00100000:1.0:1746129829.627585:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7288 00000100:00100000:1.0:1746129829.627590:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054632704:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129829.627910:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7289 00000100:00100000:3.0:1746129829.627919:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054632960:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129829.630333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.630353:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054633088 00000100:00100000:2.0:1746129829.630359:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054633088 00000100:00100000:2.0:1746129829.630406:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16082 00000100:00100000:2.0:1746129829.630413:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31912:x1830949054633088:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129829.630427:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.630441:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e54 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.630461:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.630463:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.630469:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.630482:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 29 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.630489:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba84400, rc 0) 00000100:00100000:2.0:1746129829.630518:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31912:x1830949054633088:12345-192.168.204.31@tcp:101:cat.0 Request processed in 106us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.630523:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16082 00000100:00100000:1.0:1746129829.639598:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054632704:12345-192.168.204.31@tcp:3:cat.0 Request processed in 11997us (12453us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129829.639608:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7288 00002000:00100000:1.0:1746129829.639617:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012ba19500 x1830949054632704/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.639625:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19500 with x1830949054632704 ext(2097152->3145727) 00002000:00010000:1.0:1746129829.639630:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba19500 00000100:00100000:0.0:1746129829.642324:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.642474:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054633344 00000100:00100000:1.0:1746129829.642482:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054633344 00002000:00100000:1.0:1746129829.642511:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff88009b00ca80 x1830949054633344/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.642519:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ca80 with x1830949054633344 ext(4927488->4931583) 00002000:00010000:1.0:1746129829.642524:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ca80 00000100:00100000:3.0:1746129829.642531:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054632960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14614us (15089us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.642539:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7289 00002000:00100000:3.0:1746129829.642545:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88009b00ce00 x1830949054632960/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.642556:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ce00 with x1830949054632960 ext(3145728->4194303) 00002000:00010000:3.0:1746129829.642559:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ce00 00000100:00100000:3.0:1746129829.642808:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7290 00000100:00100000:3.0:1746129829.642827:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054633344:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129829.642952:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054633344:12345-192.168.204.31@tcp:3:cat.0 Request processed in 129us (637us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.642957:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7290 00002000:00100000:3.0:1746129829.643309:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4927488->4931583) req@ffff88009b00ca80 x1830949054633344/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.643316:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b00ca80 with x1830949054633344 ext(4927488->4931583) 00002000:00010000:3.0:1746129829.643319:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b00ca80 00000100:00100000:0.0:1746129829.652710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.652897:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054633472 00000100:00100000:3.0:1746129829.652905:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054633472 00000100:00100000:3.0:1746129829.652948:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11167 00000100:00100000:3.0:1746129829.652954:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:31918:x1830949054633472:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129829.652984:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.652998:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e5b expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.653046:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653056:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653065:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653076:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653081:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653085:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653165:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653173:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.653179:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 28 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.653184:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.653208:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 28 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.653218:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 28 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.653227:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054129792:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129829.653313:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 294 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.653324:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 294 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.653331:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054129920:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129829.653350:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59480 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.653670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.653740:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054633728 00000100:00100000:3.0:1746129829.653743:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054633728 00002000:00100000:3.0:1746129829.653767:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009fbeea00 x1830949054633728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.653775:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949054633728 ext(4194304->4931583) 00002000:00010000:3.0:1746129829.653779:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:2.0:1746129829.654224:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7291 00000100:00100000:2.0:1746129829.654232:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054633728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.660030:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.660072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.660195:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054129792:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129829.660205:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054129920:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129829.660228:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:3.0:1746129829.661470:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054633984 00000100:00100000:3.0:1746129829.661477:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054633984 00000100:00100000:3.0:1746129829.661532:0:14317:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054634240 00000100:00100000:3.0:1746129829.661535:0:14317:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054634240 00000100:00100000:3.0:1746129829.661551:0:14317:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4700 00000100:00100000:3.0:1746129829.661558:0:14317:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:27192:x1830949054633984:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746129829.661604:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4701 00000100:00100000:1.0:1746129829.661612:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:27195:x1830949054634240:12345-192.168.204.31@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746129829.661775:0:14317:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:27192:x1830949054633984:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 216us (1752us total) trans 8589945205 rc 0/0 00000100:00100000:3.0:1746129829.661833:0:14317:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4700 00000100:00100000:1.0:1746129829.662071:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:27195:x1830949054634240:12345-192.168.204.31@tcp:35:ldlm_bl.0 Request processed in 459us (1997us total) trans 8589945206 rc 0/0 00000100:00100000:1.0:1746129829.662077:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4701 00000100:00100000:2.0:1746129829.663636:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1961:x1830949054633728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 9401us (9962us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129829.663645:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7291 00002000:00100000:2.0:1746129829.663652:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88009fbeea00 x1830949054633728/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.663661:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fbeea00 with x1830949054633728 ext(4194304->4931583) 00002000:00010000:2.0:1746129829.663665:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fbeea00 00000100:00100000:0.0:1746129829.665375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.665756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.666083:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054634368 00000100:00100000:2.0:1746129829.666090:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054634368 00010000:00010000:2.0:1746129829.666116:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 30 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.666148:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054634496 00000100:00100000:2.0:1746129829.666151:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054634496 00010000:00010000:2.0:1746129829.666160:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 296 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.666173:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8069 00000100:00100000:2.0:1746129829.666179:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054634368:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.666189:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.666193:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 30 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.666201:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 30 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.666366:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8070 00000100:00100000:3.0:1746129829.666377:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949054634496:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.666385:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.666388:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 296 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.666453:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfe00/0x48868a4e43956981 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dc1 expref: 30 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.666610:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 296 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.666621:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfa00/0x48868a4e43956965 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356db3 expref: 296 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.666814:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.666819:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.666827:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.666832:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.666867:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129829.667170:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129829.667173:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.667225:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:1962:x1830949054634496:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 850us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.667232:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8070 00010000:00010000:3.0:1746129829.667256:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667262:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129829.667295:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129829.667299:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129829.667312:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667319:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667327:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667331:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667335:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667339:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbe400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129829.667342:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667348:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667355:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:3.0:1746129829.667357:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129829.667359:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667362:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956a29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667369:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667374:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667378:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667381:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbe200 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129829.667383:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667386:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667391:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008f244100) 00010000:00010000:3.0:1746129829.667393:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129829.667395:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667399:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe200/0x48868a4e43956a30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.667428:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.667438:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 11 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.667443:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.667445:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129829.667447:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbf600, rc 0) 00000100:00100000:2.0:1746129829.667897:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054634368:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1717us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.667904:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8069 00000100:00100000:3.0:1746129829.668214:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31918:x1830949054633472:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 15260us (15511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.668221:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11167 00000100:00100000:1.0:1746129829.673292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.673328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.673353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.673392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.673453:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054634624 00000100:00100000:2.0:1746129829.673460:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054634624 00000100:00100000:2.0:1746129829.673494:0:10930:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054634752 00000100:00100000:2.0:1746129829.673496:0:10930:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054634752 00000100:00100000:2.0:1746129829.673510:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054634880 00000100:00100000:2.0:1746129829.673511:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054634880 00000100:00100000:2.0:1746129829.673520:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054635008 00000100:00100000:2.0:1746129829.673521:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054635008 00000100:00100000:2.0:1746129829.673531:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16083 00000100:00100000:2.0:1746129829.673537:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054634624:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129829.673551:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.673564:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba84e00/0x48868a4e43956a3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e62 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.673582:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673584:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673591:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba84e00/0x48868a4e43956a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e62 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673603:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba84e00/0x48868a4e43956a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e62 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673611:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba84e00, rc 0) 00000100:00100000:2.0:1746129829.673644:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054634624:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 108us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.673650:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16083 00000100:00100000:2.0:1746129829.673662:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16084 00000100:00100000:2.0:1746129829.673666:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054634752:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129829.673672:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.673680:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba84000/0x48868a4e43956a45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e69 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.673690:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673692:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673696:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84000/0x48868a4e43956a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e69 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673704:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84000/0x48868a4e43956a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e69 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673710:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba84000, rc 0) 00000100:00100000:2.0:1746129829.673723:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054634752:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 56us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.673727:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16084 00000100:00100000:2.0:1746129829.673736:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16085 00000100:00100000:2.0:1746129829.673740:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054634880:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129829.673745:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.673750:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e70 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.673759:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673760:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673764:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673771:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673777:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba84800, rc 0) 00000100:00100000:2.0:1746129829.673789:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054634880:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.673793:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16085 00000100:00100000:2.0:1746129829.673802:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16086 00000100:00100000:2.0:1746129829.673806:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1962:x1830949054635008:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129829.673813:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.673818:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e77 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.673826:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673828:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.673831:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673839:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.673844:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba84a00, rc 0) 00000100:00100000:2.0:1746129829.673877:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1962:x1830949054635008:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 70us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.673882:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16086 00000100:00080000:1.0:1746129829.674653:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129829.679611:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.680735:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.680806:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054635264 00000100:00100000:0.0:1746129829.680814:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054635264 00000100:00100000:0.0:1746129829.682233:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054635520 00000100:00100000:0.0:1746129829.682239:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054635520 00000100:00100000:0.0:1746129829.682383:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11168 00000100:00100000:0.0:1746129829.682391:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800937db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:31918:x1830949054635264:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129829.682407:0:1851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129829.682432:0:1851:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35a00/0x48868a4e43956a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e7e expref: -99 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.682507:0:1851:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129829.682521:0:1851:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.682527:0:1851:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 1851 initiator: MDT0 00010000:00010000:0.0:1746129829.682556:0:1851:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129829.682566:0:1851:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 12 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746129829.682575:0:1851:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054130048:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129829.682775:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11169 00000100:00100000:3.0:1746129829.682786:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+295:31921:x1830949054635520:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:3.0:1746129829.682795:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.682801:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbec00/0x48868a4e43956a68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e85 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.682840:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.682862:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.682868:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129829.683534:0:1851:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093cc2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.686834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.687025:0:1851:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fbed180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:1851:1830949054130048:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129829.687098:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054635648 00000100:00100000:3.0:1746129829.687104:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054635648 00010000:00010000:3.0:1746129829.687136:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 13 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.687139:0:1851:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000100:00100000:3.0:1746129829.687158:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8071 00000100:00100000:3.0:1746129829.687165:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1963:x1830949054635648:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.687175:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.687179:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 13 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.687187:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 13 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.687210:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf600/0x48868a4e43956a37 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e5b expref: 13 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.687753:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.687758:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129829.687767:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129829.687773:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 1851 initiator: MDT0 00010000:00010000:3.0:1746129829.687780:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.687784:0:7108:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.687789:0:7108:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.687816:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.687878:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1963:x1830949054635648:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 712us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.687884:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8071 00010000:00010000:2.0:1746129829.688008:0:1851:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00010000:00010000:2.0:1746129829.688014:0:1851:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 1851 initiator: MDT0 00000004:00200000:2.0:1746129829.688030:0:1851:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129829.688141:0:1851:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35a00/0x48868a4e43956a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.688161:0:1851:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 12 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.688167:0:1851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129829.688169:0:1851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129829.688171:0:1851:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba35c00, rc 0) 00000100:00100000:2.0:1746129829.688193:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800937db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31918:x1830949054635264:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 5803us (8590us total) trans 8589945207 rc 0/0 00000100:00100000:2.0:1746129829.688199:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11168 00010000:00010000:2.0:1746129829.688755:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.688762:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129829.688771:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129829.688820:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbec00/0x48868a4e43956a68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 298 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.688829:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 297 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.688835:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129829.688837:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129829.688839:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbee00, rc 0) 00000100:00100000:2.0:1746129829.688876:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31921:x1830949054635520:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6095us (8143us total) trans 8589945208 rc 0/0 00000100:00100000:2.0:1746129829.688884:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11169 00000100:00100000:0.0:1746129829.691273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.691984:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054635904 00000100:00100000:2.0:1746129829.691993:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054635904 00000100:00100000:2.0:1746129829.692047:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11170 00000100:00100000:2.0:1746129829.692056:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31924:x1830949054635904:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129829.692075:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.692091:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85000/0x48868a4e43956a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e8c expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.692174:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.692188:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.692197:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:2.0:1746129829.692208:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:2.0:1746129829.692312:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85000/0x48868a4e43956a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 32 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.692327:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 31 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.692335:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129829.692337:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129829.692339:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba85200, rc 0) 00000100:00100000:2.0:1746129829.693243:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31924:x1830949054635904:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1188us (1973us total) trans 8589945209 rc 0/0 00000100:00100000:2.0:1746129829.693250:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11170 00000100:00100000:0.0:1746129829.694287:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.694372:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054636032 00000100:00100000:2.0:1746129829.694377:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054636032 00000100:00100000:2.0:1746129829.694409:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11171 00000100:00100000:2.0:1746129829.694416:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31918:x1830949054636032:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129829.694430:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.694440:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85400/0x48868a4e43956a99 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e93 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.694501:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.694514:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.694521:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 296 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.694526:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 30 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.694532:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 6/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129829.694561:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 30 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.694573:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 30 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.694588:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054130176:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129829.695699:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 296 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.695708:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 296 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.695715:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054130304:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129829.696412:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 13 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.696420:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 13 pid: 1851 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.696428:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054130432:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129829.696533:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b280c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.699407:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054130176:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129829.699631:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.699783:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054130304:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129829.700000:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.700021:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054636160 00000100:00100000:3.0:1746129829.700026:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054636160 00010000:00010000:3.0:1746129829.700054:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 31 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.700716:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054636288 00000100:00100000:3.0:1746129829.700722:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054636288 00010000:00010000:3.0:1746129829.700742:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 297 pid: 16808 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.700769:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8072 00000100:00100000:3.0:1746129829.700778:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054636160:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.700791:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.700798:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 31 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.700808:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 31 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.700828:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85200/0x48868a4e43956a8b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e8c expref: 31 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.700881:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.700888:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.700896:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.700900:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.700905:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.700951:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054636160:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 173us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.700969:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8072 00000100:00100000:3.0:1746129829.700992:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8073 00000100:00100000:3.0:1746129829.700999:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:1962:x1830949054636288:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.701007:0:7108:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.701012:0:7108:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 297 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.701020:0:7108:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 297 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.701032:0:7108:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbee00/0x48868a4e43956a6f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e85 expref: 297 pid: 16808 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.701040:0:7108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.701043:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.701048:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.701052:0:7108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.701056:0:7108:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.701079:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:1962:x1830949054636288:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 80us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.701085:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8073 00000100:00100000:3.0:1746129829.701122:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054130432:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129829.701145:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129829.701542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.701728:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054636416 00000100:00100000:1.0:1746129829.701734:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054636416 00010000:00010000:1.0:1746129829.701754:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 14 pid: 1851 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.701775:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8074 00000100:00100000:1.0:1746129829.701782:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+14:1961:x1830949054636416:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129829.701790:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129829.701795:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 14 pid: 1851 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.701805:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 14 pid: 1851 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.701818:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba35c00/0x48868a4e43956a61 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e7e expref: 14 pid: 1851 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.701831:0:7107:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129829.701835:0:7107:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129829.701842:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129829.701878:0:7107:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129829.701898:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129829.701928:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054636416:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 145us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.701933:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8074 00010000:00010000:3.0:1746129829.702384:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.702392:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129829.702429:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:3.0:1746129829.702433:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746129829.702446:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.702476:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85400/0x48868a4e43956a99 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.702489:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.702495:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.702497:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746129829.702500:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba85600, rc 0) 00000100:00100000:3.0:1746129829.702534:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31918:x1830949054636032:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 8117us (8247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.702540:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11171 00000100:00100000:0.0:1746129829.707146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.707336:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054636672 00000100:00100000:3.0:1746129829.707345:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054636672 00000100:00100000:3.0:1746129829.707395:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11172 00000100:00100000:3.0:1746129829.707405:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31918:x1830949054636672:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129829.707424:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.707437:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe600/0x48868a4e43956aa7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356e9a expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.707511:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707522:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707530:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707540:0:16808:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707545:0:16808:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707549:0:16808:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707554:0:16808:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbfc00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129829.707556:0:16808:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707562:0:16808:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707570:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129829.707572:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129829.707575:0:16808:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707583:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbfc00/0x48868a4e43956aae lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129829.707604:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe600/0x48868a4e43956aa7 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e9a expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.707611:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe600/0x48868a4e43956aa7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e9a expref: 13 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.707617:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbe600, rc 0) 00000100:00100000:3.0:1746129829.707662:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31918:x1830949054636672:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 259us (534us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129829.707668:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11172 00000100:00100000:0.0:1746129829.709107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.709265:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054636928 00000100:00100000:1.0:1746129829.709273:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054636928 00000100:00100000:1.0:1746129829.710569:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4702 00000100:00100000:1.0:1746129829.710578:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:31918:x1830949054636928:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:1.0:1746129829.710745:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:31918:x1830949054636928:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 168us (1642us total) trans 8589945210 rc 0/0 00000100:00100000:1.0:1746129829.710752:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4702 00000100:00100000:0.0:1746129829.743936:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.744030:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637056 00000100:00100000:1.0:1746129829.744042:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637056 00000100:00100000:1.0:1746129829.744112:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16087 00000100:00100000:1.0:1746129829.744123:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:31921:x1830949054637056:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129829.744139:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.744156:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ea1 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.744185:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.744193:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.744199:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.744205:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.744206:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.744210:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.744241:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 28 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.744253:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 28 pid: 8435 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.744265:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054130560:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.744377:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.744384:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 10 pid: 8436 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746129829.744391:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054130688:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.744412:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.744419:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.744426:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054130816:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.744441:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.746923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.746991:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637184 00000100:00100000:2.0:1746129829.746998:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637184 00010000:00010000:2.0:1746129829.747024:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746129829.747045:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8075 00000100:00100000:2.0:1746129829.747051:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054637184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129829.747063:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746129829.747071:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054130560:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129829.747080:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746129829.747080:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054130688:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.747086:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054130816:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129829.747089:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746129829.747105:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84800/0x48868a4e43956a4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e70 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746129829.747111:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [3112960->3145727] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 36 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.747122:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3c3000, rc 0) 00010000:00010000:2.0:1746129829.747126:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129829.747152:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054637184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.747158:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8075 00000100:00100000:1.0:1746129829.747176:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:31921:x1830949054637056:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 3057us (3248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.747185:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16087 00000100:00100000:2.0:1746129829.750299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.750331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.750377:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637312 00000100:00100000:3.0:1746129829.750385:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637312 00010000:00010000:3.0:1746129829.750416:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 29 pid: 8435 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.750446:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637440 00000100:00100000:3.0:1746129829.750448:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637440 00010000:00010000:3.0:1746129829.750458:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.750469:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8076 00000100:00100000:3.0:1746129829.750474:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8077 00000100:00100000:2.0:1746129829.750478:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054637312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746129829.750480:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1963:x1830949054637440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.750489:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.750489:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129829.750507:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 29 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.750508:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.750517:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 29 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.750531:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.750597:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84400/0x48868a4e43956a1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4927488->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e54 expref: 29 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.750603:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84200/0x48868a4e43956a0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e46 expref: 36 pid: 8435 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.750619:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.750620:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.750626:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 35 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.750633:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 35 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.751066:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129829.751084:0:16449:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 35 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129829.751096:0:16449:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054130944:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129829.751108:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054637312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 632us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.751114:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8076 00000100:00100000:3.0:1746129829.751144:0:16449:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.756047:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.756201:0:16449:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:16449:1830949054130944:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129829.756225:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.757258:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1963:x1830949054637440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 6772us (6920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.757269:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8077 00000100:00100000:2.0:1746129829.757469:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637696 00000100:00100000:2.0:1746129829.757476:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637696 00002000:00100000:2.0:1746129829.757515:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3112960->3117055) req@ffff88008fad1f80 x1830949054637696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.757524:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1f80 with x1830949054637696 ext(3112960->3117055) 00002000:00010000:2.0:1746129829.757528:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad1f80 00000100:00100000:2.0:1746129829.757551:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7292 00000100:00100000:2.0:1746129829.757560:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054637696:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129829.757754:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054637696:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 193us (1714us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129829.757761:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7292 00002000:00100000:2.0:1746129829.757767:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3112960->3117055) req@ffff88008fad1f80 x1830949054637696/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.757773:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad1f80 with x1830949054637696 ext(3112960->3117055) 00002000:00010000:2.0:1746129829.757776:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fad1f80 00000100:00100000:0.0:1746129829.764973:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.766885:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637824 00000100:00100000:1.0:1746129829.766899:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637824 00000100:00100000:1.0:1746129829.766953:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16088 00000100:00100000:1.0:1746129829.766972:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:31921:x1830949054637824:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129829.767008:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.767028:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ea8 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.767060:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 27 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.767068:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.767074:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.767080:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.767081:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.767085:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.767115:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.767127:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.767141:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054131072:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.767270:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.767279:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 10 pid: 8436 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746129829.767288:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054131200:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.767326:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 27 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.767335:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 27 pid: 7976 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.767343:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054131328:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.767367:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129829.781076:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746129829.781093:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054131456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746129829.781142:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129829.781231:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054131456 00000100:00100000:0.0:1746129829.781238:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054131456 00000100:00100000:0.0:1746129829.781277:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1746129829.781283:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949054131456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746129829.781298:0:8438:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 611254272 pending 35782656 free 3852468224 avail 3850371072 00000100:00100000:0.0:1746129829.781328:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3296:x1830949054131456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129829.781334:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1746129829.781647:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746129829.781699:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054131456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746129829.781765:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054131072:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.781773:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054131200:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.781780:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054131328:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.781799:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [2097152->2527231] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.781818:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3c2800, rc 0) 00000100:00100000:1.0:1746129829.781872:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:31921:x1830949054637824:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 14901us (16924us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.781878:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16088 00000100:00100000:0.0:1746129829.786802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.786883:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054638080 00000100:00100000:3.0:1746129829.786891:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054638080 00010000:00010000:3.0:1746129829.786922:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746129829.786944:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8078 00000100:00100000:3.0:1746129829.786950:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054638080:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.786972:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.786991:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.787001:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.787020:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adbf000/0x48868a4e439569b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356deb expref: 39 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.787047:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.787082:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054638080:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 131us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.787087:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8078 00000100:00100000:0.0:1746129829.787999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.788377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.788730:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054637952 00000100:00100000:3.0:1746129829.788735:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054637952 00010000:00010000:3.0:1746129829.788755:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746129829.789421:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054638208 00000100:00100000:3.0:1746129829.789425:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054638208 00010000:00010000:3.0:1746129829.789440:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.789482:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8079 00000100:00100000:1.0:1746129829.789490:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+11:1961:x1830949054637952:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129829.789503:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129829.789519:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746129829.789528:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746129829.789544:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba84a00/0x48868a4e43956a53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e77 expref: 11 pid: 8436 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746129829.789561:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129829.789599:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+10:1961:x1830949054637952:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 110us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.789605:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8079 00000100:00100000:1.0:1746129829.789621:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8080 00000100:00100000:1.0:1746129829.789626:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1961:x1830949054638208:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129829.789632:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129829.789638:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.789646:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.789656:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adbf800/0x48868a4e439569ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356de4 expref: 28 pid: 7976 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.789662:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.789664:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.789669:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 37 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.789676:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 37 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.789701:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 37 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.789711:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054131584:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129829.789754:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.794823:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054131584:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129829.794836:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129829.794900:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1961:x1830949054638208:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 5272us (6521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.794908:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8080 00000100:00100000:0.0:1746129829.807372:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.807481:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054638464 00000100:00100000:3.0:1746129829.807490:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054638464 00002000:00100000:3.0:1746129829.807532:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2523136->2527231) req@ffff88008fad0700 x1830949054638464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.807542:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0700 with x1830949054638464 ext(2523136->2527231) 00002000:00010000:3.0:1746129829.807547:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0700 00000100:00100000:3.0:1746129829.808176:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7293 00000100:00100000:3.0:1746129829.808312:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054638464:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129829.808470:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054638464:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 286us (1106us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.808477:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7293 00002000:00100000:3.0:1746129829.808482:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2523136->2527231) req@ffff88008fad0700 x1830949054638464/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.808489:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0700 with x1830949054638464 ext(2523136->2527231) 00002000:00010000:3.0:1746129829.808492:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008fad0700 00000100:00100000:0.0:1746129829.811260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.811484:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054638720 00000100:00100000:2.0:1746129829.811490:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054638720 00000100:00100000:2.0:1746129829.811532:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4703 00000100:00100000:2.0:1746129829.811538:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+296:31921:x1830949054638720:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129829.811929:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31921:x1830949054638720:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 389us (674us total) trans 8589945211 rc 0/0 00000100:00100000:2.0:1746129829.811935:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4703 00000100:00100000:1.0:1746129829.830502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.830679:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3296:1830949054131968:0@lo:400:kworker.0 00000100:00100000:3.0:1746129829.830708:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949054131840:0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.830719:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129829.830743:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054131968 00000100:00100000:0.0:1746129829.830749:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054131968 00000100:00100000:2.0:1746129829.830750:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746129829.830754:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054132096:0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.830769:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129829.830779:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949054131712:0@lo:400:kworker.0 00000100:00080000:2.0:1746129829.830790:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129829.830793:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1746129829.830804:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830949054131968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129829.830805:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129829.830811:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054638848 00000100:00100000:2.0:1746129829.830814:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054638848 00000100:00100000:1.0:1746129829.830822:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949054132224:0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.830831:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054132096 00000100:00100000:2.0:1746129829.830833:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054132096 00000100:00100000:1.0:1746129829.830836:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129829.830861:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830949054131968:12345-0@lo:400:kworker.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.830864:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1746129829.830866:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1746129829.830870:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949054132096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746129829.830878:0:14311:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054131712 00000100:00100000:0.0:1746129829.830878:0:1851:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054132224 00000100:00100000:1.0:1746129829.830881:0:14311:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054131712 00000100:00100000:2.0:1746129829.830896:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3296:x1830949054132096:12345-0@lo:400:kworker.0 Request processed in 27us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.830899:0:14311:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1746129829.830901:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1746129829.830904:0:14311:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949054131712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.830913:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16089 00000100:00100000:2.0:1746129829.830917:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:31924:x1830949054638848:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129829.830925:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746129829.830927:0:14311:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ea7f7eb-2f74-477e-bfed-16dc08365411+18:3298:x1830949054131712:12345-0@lo:400:kworker.0 Request processed in 23us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.830932:0:14311:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:2.0:1746129829.830939:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356eaf expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.830970:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ea7f7eb-2f74-477e-bfed-16dc08365411:3298:1830949054131712:0@lo:400:kworker.0 00010000:00010000:2.0:1746129829.830973:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 37 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.830985:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129829.830987:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129829.830989:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3215360->4116479] (req 3215360->4116479) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.831008:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 37 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.831018:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.831026:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054132352:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129829.831054:0:1851:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054132224 00000100:00100000:2.0:1746129829.831061:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00080000:2.0:1746129829.831068:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746129829.831071:0:1851:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1746129829.831074:0:1851:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949054132224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.831082:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054132096:0@lo:400:kworker.0 00000100:00100000:3.0:1746129829.831083:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129829.831089:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3296:1830949054131968:0@lo:400:kworker.0 00000100:00100000:0.0:1746129829.831098:0:1851:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830949054132224:12345-0@lo:400:kworker.0 Request processed in 24us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.831103:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054131840 00000100:00100000:0.0:1746129829.831103:0:1851:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1746129829.831106:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054131840 00000100:00080000:3.0:1746129829.831120:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129829.831123:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1746129829.831127:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830949054131840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.831149:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1830949054131840:12345-0@lo:400:kworker.0 Request processed in 22us (66us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.831153:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1746129829.831187:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830949054132224:0@lo:400:kworker.0 00000100:00100000:3.0:1746129829.831783:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3299:1830949054131840:0@lo:400:kworker.0 00000100:00100000:2.0:1746129829.832777:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1830949054132352:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129829.832796:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3215360->4116479] (req 3215360->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.832808:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba85e00, rc 0) 00000100:00100000:2.0:1746129829.832869:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31924:x1830949054638848:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 1928us (2351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.832876:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16089 00000100:00100000:0.0:1746129829.833927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.834023:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054638976 00000100:00100000:2.0:1746129829.834028:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054638976 00002000:00100000:2.0:1746129829.834060:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2527231) req@ffff88008fad0a80 x1830949054638976/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.834069:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949054638976 ext(2097152->2527231) 00010000:00010000:2.0:1746129829.834076:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 38 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.834087:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 38 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.834093:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad0a80 00000100:00100000:2.0:1746129829.834118:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1965 00000100:00100000:2.0:1746129829.834124:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1962:x1830949054638976:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129829.842037:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054638976:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 7905us (8103us total) trans 17179874237 rc 0/0 00000100:00100000:2.0:1746129829.842047:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1965 00002000:00100000:2.0:1746129829.842056:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->2527231) req@ffff88008fad0a80 x1830949054638976/t17179874237(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.842065:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fad0a80 with x1830949054638976 ext(2097152->2527231) 00010000:00010000:2.0:1746129829.842072:0:21599:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 40 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746129829.842084:0:21599:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 40 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746129829.842091:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008fad0a80 00000100:00100000:3.0:1746129829.845025:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009328b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054132480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746129829.845077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129829.846610:0:4345:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054132480 00000100:00100000:1.0:1746129829.846619:0:4345:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054132480 00000100:00100000:1.0:1746129829.846666:0:4345:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1746129829.846673:0:4345:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949054132480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746129829.846693:0:4345:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 641794048 pending 34078720 free 3853516800 avail 3851419648 00000100:00100000:1.0:1746129829.846744:0:4345:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3299:x1830949054132480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.846749:0:4345:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1746129829.846800:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009328b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054132480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746129829.847934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.848183:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054639104 00000100:00100000:1.0:1746129829.848187:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054639104 00010000:00010000:1.0:1746129829.848207:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 40 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.848239:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8081 00000100:00100000:1.0:1746129829.848244:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054639104:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129829.848254:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746129829.848268:0:7107:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129829 -> 1746129830 00002000:00010000:1.0:1746129829.848271:0:7107:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129829 -> 1746129830 00010000:00010000:1.0:1746129829.848276:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 40 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.848286:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 40 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.848304:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3c2800/0x48868a4e43956abc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2527231) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea8 expref: 40 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.848328:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.848330:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.848336:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.848343:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.848367:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.848381:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054132608:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129829.848439:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.851458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.851542:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054132608:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129829.851559:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129829.851597:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054639104:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3351us (3666us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.851607:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8081 00000100:00100000:3.0:1746129829.851799:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054639360 00000100:00100000:3.0:1746129829.851805:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054639360 00002000:00100000:3.0:1746129829.851839:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3215360->3219455) req@ffff880093289f80 x1830949054639360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.851865:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949054639360 ext(3215360->3219455) 00002000:00010000:3.0:1746129829.851869:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:3.0:1746129829.851895:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7294 00000100:00100000:3.0:1746129829.851902:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054639360:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129829.852032:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054639360:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 130us (579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.852037:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7294 00002000:00100000:3.0:1746129829.852042:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3215360->3219455) req@ffff880093289f80 x1830949054639360/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.852048:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289f80 with x1830949054639360 ext(3215360->3219455) 00002000:00010000:3.0:1746129829.852051:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289f80 00000100:00100000:0.0:1746129829.864239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.864639:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054639488 00000100:00100000:2.0:1746129829.864646:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054639488 00000100:00100000:2.0:1746129829.864690:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16090 00000100:00100000:2.0:1746129829.864696:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054639488:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129829.864709:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.864722:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba85800/0x48868a4e43956aca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356eb6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129829.864762:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054132736:192.168.204.31@tcp:106: 00000100:00100000:2.0:1746129829.864828:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094b28b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129829.864897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.865480:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054639744 00000100:00100000:3.0:1746129829.865486:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054639744 00002000:00100000:3.0:1746129829.865516:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (4112384->4116479) req@ffff880093289880 x1830949054639744/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.865524:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289880 with x1830949054639744 ext(4112384->4116479) 00002000:00010000:3.0:1746129829.865529:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289880 00000100:00100000:3.0:1746129829.865554:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7295 00000100:00100000:3.0:1746129829.865567:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054639744:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129829.866373:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054639744:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 810us (1473us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129829.866381:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7295 00002000:00100000:3.0:1746129829.866387:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (4112384->4116479) req@ffff880093289880 x1830949054639744/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/4536 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.866394:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289880 with x1830949054639744 ext(4112384->4116479) 00002000:00010000:3.0:1746129829.866397:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289880 00000100:00100000:2.0:1746129829.866556:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054132736:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129829.866576:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba85800/0x48868a4e43956aca lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eb6 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.866585:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba85800/0x48868a4e43956aca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eb6 expref: 29 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.866601:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba85800, rc 0) 00000100:00100000:2.0:1746129829.866629:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054639488:12345-192.168.204.31@tcp:101:cat.0 Request processed in 1934us (2398us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129829.866634:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16090 00000100:00100000:0.0:1746129829.869381:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.869654:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640000 00000100:00100000:2.0:1746129829.869662:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640000 00000100:00100000:2.0:1746129829.869707:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4704 00000100:00100000:2.0:1746129829.869715:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31924:x1830949054640000:12345-192.168.204.31@tcp:35:multiop.0 00000100:00100000:2.0:1746129829.870049:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31924:x1830949054640000:12345-192.168.204.31@tcp:35:multiop.0 Request processed in 334us (674us total) trans 8589945212 rc 0/0 00000100:00100000:2.0:1746129829.870054:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4704 00000100:00100000:0.0:1746129829.874998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.875388:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640256 00000100:00100000:2.0:1746129829.875396:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640256 00002000:00100000:2.0:1746129829.875429:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009328b800 x1830949054640256/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.875439:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949054640256 ext(1048576->2097151) 00002000:00010000:2.0:1746129829.875448:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328b800 00000100:00100000:2.0:1746129829.875548:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7296 00000100:00100000:2.0:1746129829.875555:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054640256:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129829.882024:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1963:x1830949054640256:12345-192.168.204.31@tcp:3:cat.0 Request processed in 6462us (7026us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129829.882033:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7296 00002000:00100000:2.0:1746129829.882042:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3ef:0x0] (1048576->2097151) req@ffff88009328b800 x1830949054640256/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.882051:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b800 with x1830949054640256 ext(1048576->2097151) 00002000:00010000:2.0:1746129829.882056:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009328b800 00000100:00100000:0.0:1746129829.890789:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.890893:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640384 00000100:00100000:2.0:1746129829.890901:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640384 00000100:00100000:2.0:1746129829.891009:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16091 00000100:00100000:2.0:1746129829.891017:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:31929:x1830949054640384:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129829.891031:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.891045:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ebd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.891070:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 34 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.891076:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129829.891077:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129829.891081:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.891104:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 34 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.891115:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 34 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746129829.891125:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054132864:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129829.891683:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746129829.894054:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054132864:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129829.894077:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.894093:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ba85a00, rc 0) 00000100:00100000:2.0:1746129829.894139:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31929:x1830949054640384:12345-192.168.204.31@tcp:101:cat.0 Request processed in 3123us (3358us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129829.894139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.894147:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16091 00000100:00100000:3.0:1746129829.894483:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640512 00000100:00100000:3.0:1746129829.894489:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640512 00002000:00100000:3.0:1746129829.894522:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3112960->3145727) req@ffff880093289c00 x1830949054640512/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.894531:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949054640512 ext(3112960->3145727) 00010000:00010000:3.0:1746129829.894537:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 35 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.894548:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 35 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.894553:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093289c00 00000100:00100000:3.0:1746129829.894580:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1966 00000100:00100000:3.0:1746129829.894588:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+35:1962:x1830949054640512:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:0.0:1746129829.896105:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.896138:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.896178:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054640512:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 1590us (2038us total) trans 21474841438 rc 0/0 00000100:00100000:3.0:1746129829.896184:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1966 00002000:00100000:3.0:1746129829.896190:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (3112960->3145727) req@ffff880093289c00 x1830949054640512/t21474841438(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.896198:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289c00 with x1830949054640512 ext(3112960->3145727) 00010000:00010000:3.0:1746129829.896204:0:8440:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746129829.896215:0:8440:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 37 pid: 20441 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746129829.896220:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093289c00 00000100:00100000:1.0:1746129829.896233:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640640 00000100:00100000:1.0:1746129829.896237:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640640 00000100:00100000:1.0:1746129829.896263:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640768 00000100:00100000:1.0:1746129829.896265:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640768 00000100:00100000:1.0:1746129829.896279:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16092 00000100:00100000:1.0:1746129829.896285:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054640640:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:3.0:1746129829.896291:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16093 00010000:00010000:1.0:1746129829.896292:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129829.896298:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054640768:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.896302:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3e00/0x48868a4e43956ad8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ec4 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.896305:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129829.896314:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adbfc00/0x48868a4e43956adf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ecb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129829.896339:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054132992:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129829.896339:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054133120:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129829.896390:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.896589:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746129829.898291:0:8435:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime: 1746129829 -> 1746129830 00000100:00100000:3.0:1746129829.898310:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054132992:192.168.204.31@tcp:106: 00010000:00010000:3.0:1746129829.898331:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009adbfc00/0x48868a4e43956adf lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ecb expref: 40 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129829.898341:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adbfc00/0x48868a4e43956adf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ecb expref: 40 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129829.898353:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbfc00, rc 0) 00000100:00100000:3.0:1746129829.898378:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054640768:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2082us (2239us total) trans 0 rc 301/301 00000100:00100000:3.0:1746129829.898383:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16093 00000100:00100000:0.0:1746129829.898476:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:1.0:1746129829.898578:0:20441:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.204.31@tcp) returned -22 from glimpse AST (req@ffff88012ba1ad80 x1830949054133120) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 38 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.898600:0:20441:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 38 pid: 20441 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746129829.898620:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3000/0x48868a4e43956ab5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3112960->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ea1 expref: 38 pid: 20441 timeout: 875 lvb_type: 0 00000100:00100000:1.0:1746129829.898642:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054133120:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.898653:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.898654:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129829.898659:0:20441:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.898666:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.898687:0:20441:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129829.898696:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054133248:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129829.898745:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.898760:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054640896 00000100:00100000:1.0:1746129829.898764:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054640896 00000100:00100000:1.0:1746129829.898791:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 750 00000100:00100000:1.0:1746129829.898796:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054640896:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129829.898802:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129829.898804:0:7107:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 48868a4e43956ab5) 00010000:00010000:1.0:1746129829.898805:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129829.898819:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+38:1961:x1830949054640896:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 23us (344us total) trans 0 rc 116/116 00000100:00100000:1.0:1746129829.898824:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 750 00000100:00100000:1.0:1746129829.900707:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054133248:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129829.900727:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3e00/0x48868a4e43956ad8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ec4 expref: 37 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.900738:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3c3e00/0x48868a4e43956ad8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ec4 expref: 37 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.900747:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3c3e00, rc 0) 00000100:00100000:1.0:1746129829.900772:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054640640:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4487us (4671us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129829.900778:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16092 00000100:00100000:2.0:1746129829.906317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.906379:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054641280 00000100:00100000:3.0:1746129829.906386:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054641280 00002000:00100000:3.0:1746129829.906423:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800934d4000 x1830949054641280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.906432:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4000 with x1830949054641280 ext(2097152->3145727) 00002000:00010000:3.0:1746129829.906437:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4000 00000100:00100000:3.0:1746129829.906612:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7297 00000100:00100000:3.0:1746129829.906619:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054641280:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.908624:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.908688:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054641408 00000100:00100000:2.0:1746129829.908694:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054641408 00002000:00100000:2.0:1746129829.908720:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012ba1ad80 x1830949054641408/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.908728:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1ad80 with x1830949054641408 ext(3145728->4194303) 00002000:00010000:2.0:1746129829.908733:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1ad80 00000100:00100000:2.0:1746129829.908758:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7298 00000100:00100000:2.0:1746129829.908765:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054641408:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.909415:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.909429:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054641792 00000100:00100000:1.0:1746129829.909432:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054641792 00002000:00100000:1.0:1746129829.909450:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba19880 x1830949054641792/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 504/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.909457:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949054641792 ext(3145728->4194303) 00002000:00010000:1.0:1746129829.909460:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19880 00000100:00100000:1.0:1746129829.909471:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7299 00000100:00100000:1.0:1746129829.909476:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054641792:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.909689:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.911463:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054641664 00000100:00100000:0.0:1746129829.911472:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054641664 00002000:00100000:0.0:1746129829.911506:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba19f80 x1830949054641664/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129829.911515:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949054641664 ext(2097152->3145727) 00002000:00010000:0.0:1746129829.911519:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19f80 00000100:00100000:0.0:1746129829.911541:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7300 00000100:00100000:0.0:1746129829.911547:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054641664:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129829.916318:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.916485:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054642048 00000100:00100000:1.0:1746129829.916492:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054642048 00000100:00100000:2.0:1746129829.916502:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.916523:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054642176 00000100:00100000:1.0:1746129829.916525:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054642176 00000100:00100000:2.0:1746129829.916538:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16094 00000100:00100000:2.0:1746129829.916546:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1962:x1830949054642048:12345-192.168.204.31@tcp:101:cat.0 00000100:00100000:1.0:1746129829.916549:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16095 00000100:00100000:1.0:1746129829.916554:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054642176:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129829.916561:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.916561:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129829.916576:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ed2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.916576:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fac5c00/0x48868a4e43956ae6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ed9 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129829.916594:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.916596:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129829.916604:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129829.916619:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 37 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746129829.916621:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054133376:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129829.916631:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948c0400, rc 0) 00000100:00100000:2.0:1746129829.916670:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054642048:12345-192.168.204.31@tcp:101:cat.0 Request processed in 125us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129829.916675:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16094 00000100:00100000:1.0:1746129829.918430:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129829.921500:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054641280:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14873us (15183us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.921511:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7297 00002000:00100000:3.0:1746129829.921519:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff8800934d4000 x1830949054641280/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.921528:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800934d4000 with x1830949054641280 ext(2097152->3145727) 00002000:00010000:3.0:1746129829.921533:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800934d4000 00000100:00100000:1.0:1746129829.922460:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054641792:12345-192.168.204.31@tcp:3:cat.0 Request processed in 12980us (13042us total) trans 0 rc 147456/147456 00000100:00100000:1.0:1746129829.922467:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7299 00002000:00100000:1.0:1746129829.922473:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba19880 x1830949054641792/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 504/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 147456/147456 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129829.922480:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19880 with x1830949054641792 ext(3145728->4194303) 00002000:00010000:1.0:1746129829.922483:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19880 00000100:00100000:0.0:1746129829.925224:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1964:x1830949054641664:12345-192.168.204.31@tcp:3:cat.0 Request processed in 13669us (15527us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746129829.925234:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7300 00002000:00100000:0.0:1746129829.925244:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba19f80 x1830949054641664/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129829.925252:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba19f80 with x1830949054641664 ext(2097152->3145727) 00002000:00010000:0.0:1746129829.925258:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba19f80 00000100:00100000:1.0:1746129829.925576:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054133376:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129829.925601:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fac5c00/0x48868a4e43956ae6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed9 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.925613:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fac5c00/0x48868a4e43956ae6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed9 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129829.925633:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fac5c00, rc 0) 00000100:00100000:2.0:1746129829.925645:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054641408:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16880us (17025us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129829.925652:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7298 00000100:00100000:1.0:1746129829.925654:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1962:x1830949054642176:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9099us (9152us total) trans 0 rc 301/301 00002000:00100000:2.0:1746129829.925658:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012ba1ad80 x1830949054641408/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746129829.925660:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16095 00002000:00100000:2.0:1746129829.925664:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba1ad80 with x1830949054641408 ext(3145728->4194303) 00002000:00010000:2.0:1746129829.925668:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba1ad80 00000100:00100000:0.0:1746129829.935260:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.935375:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054642432 00000100:00100000:2.0:1746129829.935384:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054642432 00002000:00100000:2.0:1746129829.935422:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880093288e00 x1830949054642432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.935430:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949054642432 ext(2097152->3145727) 00002000:00010000:2.0:1746129829.935435:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:2.0:1746129829.935452:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7301 00000100:00100000:2.0:1746129829.935458:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054642432:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129829.936690:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.938496:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054642688 00000100:00100000:0.0:1746129829.938504:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054642688 00002000:00100000:0.0:1746129829.938539:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012ba18000 x1830949054642688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129829.938555:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949054642688 ext(4194304->4931583) 00002000:00010000:0.0:1746129829.938561:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:0.0:1746129829.938597:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7302 00000100:00100000:0.0:1746129829.938603:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054642688:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:3.0:1746129829.946337:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054642432:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10870us (11076us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129829.946347:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7301 00002000:00100000:3.0:1746129829.946357:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff880093288e00 x1830949054642432/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.946366:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288e00 with x1830949054642432 ext(2097152->3145727) 00002000:00010000:3.0:1746129829.946372:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288e00 00000100:00100000:0.0:1746129829.946470:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054642688:12345-192.168.204.31@tcp:3:cat.0 Request processed in 7865us (9782us total) trans 0 rc 737280/737280 00000100:00100000:0.0:1746129829.946475:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7302 00002000:00100000:0.0:1746129829.946480:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012ba18000 x1830949054642688/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746129829.946486:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba18000 with x1830949054642688 ext(4194304->4931583) 00002000:00010000:0.0:1746129829.946490:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba18000 00000100:00100000:0.0:1746129829.953930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129829.954027:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054642816 00000100:00100000:1.0:1746129829.954035:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054642816 00000100:00100000:1.0:1746129829.954084:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16096 00000100:00100000:1.0:1746129829.954091:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:31933:x1830949054642816:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129829.954107:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129829.954122:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ee0 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.954147:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.954154:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.954155:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129829.954158:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 40 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.954182:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.954192:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 27 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746129829.954202:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054133504:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129829.954532:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129829.960033:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054133504:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129829.960057:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 40 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129829.960072:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fac4400, rc 0) 00000100:00100000:1.0:1746129829.960106:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:31933:x1830949054642816:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6015us (6185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129829.960114:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16096 00000100:00100000:0.0:1746129829.961429:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129829.961508:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054642944 00000100:00100000:2.0:1746129829.961514:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054642944 00002000:00100000:2.0:1746129829.961549:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3215360->4116479) req@ffff880093289180 x1830949054642944/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.961557:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289180 with x1830949054642944 ext(3215360->4116479) 00010000:00010000:2.0:1746129829.961563:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 28 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129829.961574:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 28 pid: 8437 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746129829.961580:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093289180 00000100:00100000:2.0:1746129829.961610:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1967 00000100:00100000:2.0:1746129829.961617:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+28:1962:x1830949054642944:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129829.975560:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054642944:12345-192.168.204.31@tcp:4:cat.0 Request processed in 13934us (14124us total) trans 17179874238 rc 0/0 00000100:00100000:2.0:1746129829.975571:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1967 00002000:00100000:2.0:1746129829.975581:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (3215360->4116479) req@ffff880093289180 x1830949054642944/t17179874238(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:570/0 lens 488/448 e 0 to 0 dl 1746129840 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.975590:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289180 with x1830949054642944 ext(3215360->4116479) 00010000:00010000:2.0:1746129829.975598:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129829.975615:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746129829.975621:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093289180 00000100:00100000:0.0:1746129829.983228:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.983603:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054643072 00000100:00100000:3.0:1746129829.983612:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054643072 00010000:00010000:3.0:1746129829.983644:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746129829.983893:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8082 00000100:00100000:3.0:1746129829.983901:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054643072:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129829.983912:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129829.983931:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129829.983943:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129829.983972:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba85e00/0x48868a4e43956ac3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3215360->4116479) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eaf expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129829.983995:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.983996:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129829.984002:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.984013:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129829.984041:0:7109:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129829.984052:0:7109:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054133632:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129829.984124:0:7109:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746129829.987455:0:7109:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7109:1830949054133632:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129829.987476:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129829.987518:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054643072:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3618us (4297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129829.987527:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8082 00000100:00100000:0.0:1746129829.993307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.993345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129829.994223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129829.994246:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054643456 00000100:00100000:3.0:1746129829.994253:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054643456 00002000:00100000:3.0:1746129829.994296:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880093289500 x1830949054643456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746129829.994305:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289500 with x1830949054643456 ext(2097152->3145727) 00002000:00010000:3.0:1746129829.994310:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289500 00000100:00100000:2.0:1746129829.995433:0:21599:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054643584 00000100:00100000:2.0:1746129829.995438:0:21599:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054643584 00002000:00100000:2.0:1746129829.995457:0:21599:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880093288380 x1830949054643584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.995463:0:21599:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949054643584 ext(3145728->4194303) 00002000:00010000:2.0:1746129829.995466:0:21599:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288380 00000100:00100000:1.0:1746129829.995505:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7303 00000100:00100000:1.0:1746129829.995513:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1962:x1830949054643456:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129829.996928:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054643840 00000100:00100000:2.0:1746129829.996933:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054643840 00002000:00100000:2.0:1746129829.996965:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880093288000 x1830949054643840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/0 e 0 to 0 dl 1746129840 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129829.996973:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949054643840 ext(3145728->4194303) 00002000:00010000:2.0:1746129829.996976:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288000 00000100:00100000:2.0:1746129829.996990:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7304 00000100:00100000:2.0:1746129829.996996:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949054643584:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129829.997932:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7305 00000100:00100000:2.0:1746129829.997939:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054643840:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:0.0:1746129829.999250:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.003324:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054644096 00000100:00100000:2.0:1746129830.003334:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054644096 00000100:00100000:2.0:1746129830.003383:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11173 00000100:00100000:2.0:1746129830.003391:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31936:x1830949054644096:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:2.0:1746129830.003411:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129830.003426:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69400/0x48868a4e43956afb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ee7 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.003507:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129830.003520:0:16808:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.003526:0:16808:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129830.003556:0:16808:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 12 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.003566:0:16808:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 12 pid: 16808 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746129830.003576:0:16808:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054133760:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129830.003647:0:16808:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1746129830.010437:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093289500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949054643456:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14917us (17131us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129830.010449:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7303 00002000:00100000:1.0:1746129830.010458:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff880093289500 x1830949054643456/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129830.010467:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093289500 with x1830949054643456 ext(2097152->3145727) 00002000:00010000:1.0:1746129830.010472:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093289500 00000100:00100000:2.0:1746129830.016294:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054643584:12345-192.168.204.31@tcp:3:cat.0 Request processed in 19287us (22937us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129830.016305:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7304 00002000:00100000:2.0:1746129830.016314:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff880093288380 x1830949054643584/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.016323:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288380 with x1830949054643584 ext(3145728->4194303) 00002000:00010000:2.0:1746129830.016327:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093288380 00000100:00100000:3.0:1746129830.018725:0:16808:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:16808:1830949054133760:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129830.018747:0:16808:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129830.021036:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054643840:12345-192.168.204.31@tcp:3:cat.0 Request processed in 23086us (26802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129830.021049:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7305 00002000:00100000:2.0:1746129830.021060:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff880093288000 x1830949054643840/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:570/0 lens 488/440 e 0 to 0 dl 1746129840 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.021069:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288000 with x1830949054643840 ext(3145728->4194303) 00002000:00010000:2.0:1746129830.021075:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288000 00000100:00100000:0.0:1746129830.021497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129830.021602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129830.021669:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054644224 00000100:00100000:3.0:1746129830.021676:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054644224 00010000:00010000:3.0:1746129830.021715:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 13 pid: 16808 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746129830.021746:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8083 00000100:00100000:3.0:1746129830.021756:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+13:1961:x1830949054644224:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129830.021767:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129830.021772:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 13 pid: 16808 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.021782:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 13 pid: 16808 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.021800:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ba85600/0x48868a4e43956aa0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e93 expref: 13 pid: 16808 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.021814:0:7109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129830.021817:0:7109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129830.021825:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129830.021830:0:7109:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129830.021845:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129830.021888:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1961:x1830949054644224:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 136us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129830.021893:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8083 00010000:00010000:3.0:1746129830.021913:0:16808:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129830.021919:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129830.021933:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129830.022057:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69400/0x48868a4e43956afb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee7 expref: 34 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.022070:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee7 expref: 33 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.022076:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129830.022078:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129830.022080:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c69600, rc 0) 00000100:00100000:3.0:1746129830.022099:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:31936:x1830949054644096:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 18710us (22853us total) trans 8589945213 rc 0/0 00000100:00100000:3.0:1746129830.022104:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11173 00000100:00100000:2.0:1746129830.022249:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054644480 00000100:00100000:2.0:1746129830.022253:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054644480 00002000:00100000:2.0:1746129830.022272:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880093288700 x1830949054644480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.022279:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949054644480 ext(4194304->4931583) 00002000:00010000:2.0:1746129830.022282:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288700 00000100:00100000:2.0:1746129830.022291:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7306 00000100:00100000:2.0:1746129830.022295:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054644480:12345-192.168.204.31@tcp:3:cat.0 00000100:00080000:0.0:1746129830.022596:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746129830.022600:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746129830.032434:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.034105:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054644608 00000100:00100000:1.0:1746129830.034114:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054644608 00000100:00100000:1.0:1746129830.034164:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16097 00000100:00100000:1.0:1746129830.034171:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31936:x1830949054644608:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129830.034185:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.034202:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356eee expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.034227:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.034233:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129830.034235:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129830.034237:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2498560->2715647] (req 2498560->2715647) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.034260:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.034268:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 39 pid: 20441 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746129830.034278:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054133888:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129830.034349:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746129830.034390:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129830.040687:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054133888:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129830.040710:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2498560->2715647] (req 2498560->2715647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.040723:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b452e00, rc 0) 00000100:00100000:1.0:1746129830.040756:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31936:x1830949054644608:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 6586us (8329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129830.040763:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16097 00000100:00100000:2.0:1746129830.042354:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1962:x1830949054644480:12345-192.168.204.31@tcp:3:cat.0 Request processed in 20053us (20747us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129830.042362:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7306 00002000:00100000:2.0:1746129830.042371:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff880093288700 x1830949054644480/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/440 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.042380:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093288700 with x1830949054644480 ext(4194304->4931583) 00002000:00010000:2.0:1746129830.042385:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093288700 00000100:00100000:2.0:1746129830.047466:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129830.047466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.047526:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054644992 00000100:00100000:1.0:1746129830.047534:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054644992 00000100:00100000:3.0:1746129830.047553:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054644864 00000100:00100000:2.0:1746129830.047554:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129830.047558:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054644864 00010000:00010000:1.0:1746129830.047578:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 40 pid: 20441 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746129830.047587:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11174 00000100:00100000:3.0:1746129830.047595:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+297:31938:x1830949054644864:12345-192.168.204.31@tcp:101:multiop.0 00000100:00100000:1.0:1746129830.047605:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8084 00000100:00100000:1.0:1746129830.047610:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054644992:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129830.047618:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.047619:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129830.047631:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e43956b17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356ef5 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.047639:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 40 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746129830.047649:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 40 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746129830.047665:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fac4400/0x48868a4e43956af4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee0 expref: 40 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746129830.047681:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129830.047683:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129830.047690:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.047696:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.047704:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956b1e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129830.047722:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129830.047731:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054134016:192.168.204.31@tcp:105: 00000100:00080000:0.0:1746129830.047759:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746129830.047763:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746129830.047800:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a95840c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129830.047819:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054645120 00000100:00100000:1.0:1746129830.047822:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054645120 00010000:00010000:3.0:1746129830.047877:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956b1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00000100:00100000:1.0:1746129830.047880:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16098 00000100:00100000:1.0:1746129830.047886:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054645120:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:3.0:1746129830.047889:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956b1e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:1.0:1746129830.047892:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00200000:3.0:1746129830.047898:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:1.0:1746129830.047899:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b453600/0x48868a4e43956b25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356efc expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129830.047920:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134144:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129830.047984:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00010000:00010000:3.0:1746129830.047996:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e43956b17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ef5 expref: 300 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.048011:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956b1e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ef5 expref: 299 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.048017:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129830.048019:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746129830.048021:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbe400, rc 0) 00000100:00100000:3.0:1746129830.048045:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31938:x1830949054644864:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 451us (587us total) trans 8589945214 rc 0/0 00000100:00100000:3.0:1746129830.048050:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11174 00000100:00100000:2.0:1746129830.049638:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054134016:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129830.049651:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129830.049682:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949054644992:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2072us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129830.049689:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8084 00000100:00100000:1.0:1746129830.050023:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134144:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129830.050040:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b453600/0x48868a4e43956b25 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356efc expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.050050:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b453600/0x48868a4e43956b25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356efc expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.050057:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b453600, rc 0) 00000100:00100000:1.0:1746129830.050083:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054645120:12345-192.168.204.31@tcp:101:cat.0 Request processed in 2197us (2529us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129830.050089:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16098 00000100:00100000:0.0:1746129830.052091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129830.052771:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054645376 00000100:00100000:3.0:1746129830.052781:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054645376 00002000:00100000:3.0:1746129830.052825:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2498560->2502655) req@ffff88009328b100 x1830949054645376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129830.052834:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b100 with x1830949054645376 ext(2498560->2502655) 00002000:00010000:3.0:1746129830.052839:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b100 00000100:00100000:3.0:1746129830.052913:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7307 00000100:00100000:3.0:1746129830.052923:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009328b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054645376:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:3.0:1746129830.053107:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009328b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054645376:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 184us (1021us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746129830.053114:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7307 00002000:00100000:3.0:1746129830.053120:0:21601:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3f4:0x0] (2498560->2502655) req@ffff88009328b100 x1830949054645376/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746129830.053127:0:21601:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009328b100 with x1830949054645376 ext(2498560->2502655) 00002000:00010000:3.0:1746129830.053130:0:21601:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009328b100 00000100:00100000:0.0:1746129830.053437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.053528:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054645504 00000100:00100000:1.0:1746129830.053534:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054645504 00000100:00100000:1.0:1746129830.053565:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16099 00000100:00100000:1.0:1746129830.053571:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054645504:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129830.053583:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.053597:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b453800/0x48868a4e43956b33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f03 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129830.053645:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134272:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129830.054379:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129830.058226:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.058297:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054645760 00000100:00100000:2.0:1746129830.058304:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054645760 00002000:00100000:2.0:1746129830.058340:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2711552->2715647) req@ffff88012b7d8700 x1830949054645760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.058348:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8700 with x1830949054645760 ext(2711552->2715647) 00002000:00010000:2.0:1746129830.058352:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7d8700 00000100:00100000:2.0:1746129830.058368:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7308 00000100:00100000:2.0:1746129830.058374:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054645760:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:1.0:1746129830.060051:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134272:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129830.060083:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b453800/0x48868a4e43956b33 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f03 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.060095:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b453800/0x48868a4e43956b33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f03 expref: 40 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.060104:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b453800, rc 0) 00000100:00100000:1.0:1746129830.060129:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:1961:x1830949054645504:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6558us (6691us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129830.060136:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16099 00000100:00100000:2.0:1746129830.060296:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1964:x1830949054645760:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 1921us (2075us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129830.060303:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7308 00002000:00100000:2.0:1746129830.060309:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2711552->2715647) req@ffff88012b7d8700 x1830949054645760/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.060317:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d8700 with x1830949054645760 ext(2711552->2715647) 00002000:00010000:2.0:1746129830.060320:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b7d8700 00000100:00100000:0.0:1746129830.088239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.089301:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054645888 00000100:00100000:1.0:1746129830.089310:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054645888 00000100:00100000:1.0:1746129830.089795:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16100 00000100:00100000:1.0:1746129830.089803:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+39:31938:x1830949054645888:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129830.089819:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.089832:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f0a expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.089872:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.089880:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129830.089881:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746129830.089884:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3198976->3710975] (req 3198976->3710975) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 40 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.089909:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.089918:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 29 pid: 20441 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746129830.089928:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134400:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129830.091514:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129830.092528:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134400:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129830.092552:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3198976->3710975] (req 3198976->3710975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 40 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.092566:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b453c00, rc 0) 00000100:00100000:1.0:1746129830.092595:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:31938:x1830949054645888:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 2793us (4363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129830.092602:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16100 00000100:00100000:0.0:1746129830.093423:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.093498:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054646016 00000100:00100000:2.0:1746129830.093503:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054646016 00002000:00100000:2.0:1746129830.093532:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2498560->2715647) req@ffff880092ad9880 x1830949054646016/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.093539:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949054646016 ext(2498560->2715647) 00010000:00010000:2.0:1746129830.093544:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 30 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.093552:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 30 pid: 20441 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746129830.093556:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad9880 00000100:00100000:2.0:1746129830.093575:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1968 00000100:00100000:2.0:1746129830.093581:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1961:x1830949054646016:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129830.095928:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054646016:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 2338us (2497us total) trans 17179874239 rc 0/0 00000100:00100000:2.0:1746129830.095938:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1968 00002000:00100000:2.0:1746129830.095948:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (2498560->2715647) req@ffff880092ad9880 x1830949054646016/t17179874239(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/448 e 0 to 0 dl 1746129841 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.095968:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad9880 with x1830949054646016 ext(2498560->2715647) 00010000:00010000:2.0:1746129830.095976:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 32 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.095987:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 32 pid: 20441 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746129830.095993:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ad9880 00000100:00100000:0.0:1746129830.097740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.097823:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054646144 00000100:00100000:2.0:1746129830.097830:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054646144 00010000:00010000:2.0:1746129830.097961:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 32 pid: 20441 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746129830.098000:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8085 00000100:00100000:2.0:1746129830.098008:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1963:x1830949054646144:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129830.098019:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129830.098034:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 32 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.098044:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 32 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.098062:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b452e00/0x48868a4e43956b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2498560->2715647) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356eee expref: 32 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.098089:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129830.098090:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129830.098097:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.098104:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.098129:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129830.098138:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054134528:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129830.098189:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129830.099302:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054134528:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129830.099314:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129830.099337:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1963:x1830949054646144:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1330us (1601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129830.099343:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8085 00000100:00100000:0.0:1746129830.100174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.100268:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054646400 00000100:00100000:2.0:1746129830.100272:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054646400 00002000:00100000:2.0:1746129830.100299:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3198976->3203071) req@ffff880092adaa00 x1830949054646400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.100307:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949054646400 ext(3198976->3203071) 00002000:00010000:2.0:1746129830.100311:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adaa00 00000100:00100000:2.0:1746129830.100337:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7309 00000100:00100000:2.0:1746129830.100342:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054646400:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129830.100462:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054646400:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 120us (290us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129830.100468:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7309 00002000:00100000:2.0:1746129830.100473:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3198976->3203071) req@ffff880092adaa00 x1830949054646400/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.100480:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adaa00 with x1830949054646400 ext(3198976->3203071) 00002000:00010000:2.0:1746129830.100482:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092adaa00 00000100:00100000:0.0:1746129830.106303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.106465:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054646656 00000100:00100000:2.0:1746129830.106473:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054646656 00002000:00100000:2.0:1746129830.106507:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3706880->3710975) req@ffff880092ad8000 x1830949054646656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.106516:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949054646656 ext(3706880->3710975) 00002000:00010000:2.0:1746129830.106521:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad8000 00000100:00100000:2.0:1746129830.106551:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7310 00000100:00100000:2.0:1746129830.106558:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054646656:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129830.106725:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1961:x1830949054646656:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 166us (428us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129830.106731:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7310 00002000:00100000:2.0:1746129830.106737:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3706880->3710975) req@ffff880092ad8000 x1830949054646656/t0(0) o3->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.106743:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ad8000 with x1830949054646656 ext(3706880->3710975) 00002000:00010000:2.0:1746129830.106746:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092ad8000 00000100:00100000:0.0:1746129830.150093:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.150191:0:14312:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054646784 00000100:00100000:1.0:1746129830.150200:0:14312:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054646784 00000100:00100000:1.0:1746129830.150244:0:14312:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 222 00000100:00100000:1.0:1746129830.150251:0:14312:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1964:x1830949054646784:12345-192.168.204.31@tcp:400:kworker.0 00000100:00100000:1.0:1746129830.150311:0:14312:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1964:x1830949054646784:12345-192.168.204.31@tcp:400:kworker.0 Request processed in 60us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129830.150317:0:14312:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 222 00000100:00100000:0.0:1746129830.198322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.198452:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054646912 00000100:00100000:1.0:1746129830.198459:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054646912 00000100:00100000:1.0:1746129830.199299:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16101 00000100:00100000:1.0:1746129830.199309:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054646912:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129830.199326:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.199340:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b453a00/0x48868a4e43956b41 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f11 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129830.199382:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134656:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129830.199584:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129830.204027:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20441:1830949054134656:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129830.204054:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b453a00/0x48868a4e43956b41 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f11 expref: 32 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.204065:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b453a00/0x48868a4e43956b41 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f11 expref: 32 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.204077:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b453a00, rc 0) 00000100:00100000:1.0:1746129830.204134:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054646912:12345-192.168.204.31@tcp:101:cat.0 Request processed in 4825us (5819us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129830.204141:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16101 00000100:00100000:0.0:1746129830.207915:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.207992:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054647040 00000100:00100000:1.0:1746129830.208000:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054647040 00000100:00100000:1.0:1746129830.208054:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16102 00000100:00100000:1.0:1746129830.208061:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:31946:x1830949054647040:12345-192.168.204.31@tcp:101:multiop.0 00010000:00010000:1.0:1746129830.208075:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.208088:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f18 expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.208113:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.208122:0:20441:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.208127:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129830.208128:0:20441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129830.208131:0:20441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3534848->3751935] (req 3534848->3751935) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f18 expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.208157:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.208166:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 36 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746129830.208177:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054134784:192.168.204.31@tcp:104: 00000100:00080000:0.0:1746129830.208286:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746129830.209119:0:20441:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.209134:0:20441:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746129830.209142:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054134912:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129830.210261:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:1.0:1746129830.210287:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054134784:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129830.215076:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054134912:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129830.215102:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3534848->3751935] (req 3534848->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f18 expref: 30 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129830.215117:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b453e00, rc 0) 00000100:00100000:1.0:1746129830.215167:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:31946:x1830949054647040:12345-192.168.204.31@tcp:101:multiop.0 Request processed in 7106us (7259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129830.215174:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16102 00000100:00100000:0.0:1746129830.215441:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129830.215561:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054647168 00000100:00100000:3.0:1746129830.215568:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054647168 00010000:00010000:3.0:1746129830.215596:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 37 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746129830.215614:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8086 00000100:00100000:3.0:1746129830.215620:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+37:1961:x1830949054647168:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129830.215629:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129830.215646:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 37 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746129830.215654:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 37 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746129830.215960:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948c0400/0x48868a4e43956aed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ed2 expref: 37 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746129830.216297:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129830.217639:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+36:1961:x1830949054647168:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2014us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129830.217648:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8086 00000100:00100000:0.0:1746129830.219719:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129830.221237:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054647296 00000100:00100000:3.0:1746129830.221247:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054647296 00010000:00010000:3.0:1746129830.221280:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746129830.221305:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8087 00000100:00100000:3.0:1746129830.221311:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054647296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129830.221322:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129830.221341:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.221351:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.221370:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba85a00/0x48868a4e43956ad1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ebd expref: 30 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.221383:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129830.221385:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129830.221390:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->3751935) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f18 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.221401:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->3751935) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f18 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.221442:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3534848->3751935) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f18 expref: 29 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129830.221454:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054135040:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129830.221514:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746129830.225141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.225227:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054647424 00000100:00100000:1.0:1746129830.225235:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054647424 00000100:00100000:1.0:1746129830.225284:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16103 00000100:00100000:1.0:1746129830.225291:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+30:1962:x1830949054647424:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:1.0:1746129830.225311:0:20441:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129830.225324:0:20441:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b453600/0x48868a4e43956b4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f1f expref: -99 pid: 20441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129830.225368:0:20441:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054135168:192.168.204.31@tcp:106: 00000100:00100000:1.0:1746129830.225429:0:20441:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a9584000 going to sleep for 11 seconds 00000100:00100000:0.0:1746129830.227380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129830.228225:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.229006:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054647552 00000100:00100000:2.0:1746129830.229013:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054647552 00000100:00100000:2.0:1746129830.229043:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16104 00000100:00100000:2.0:1746129830.229049:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054647552:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129830.229061:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129830.229072:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c073a00/0x48868a4e43956b56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f26 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129830.229110:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054135296:192.168.204.31@tcp:106: 00000100:00100000:3.0:1746129830.230044:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7107:1830949054135040:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129830.230061:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129830.230178:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6f540 going to sleep for 11 seconds 00010000:00010000:2.0:1746129830.230189:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129830.230198:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054647808 00000100:00100000:3.0:1746129830.230632:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054647296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 9319us (10918us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129830.230640:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8087 00000100:00100000:2.0:1746129830.230832:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054647808 00002000:00100000:2.0:1746129830.230879:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3534848->3538943) req@ffff880092ada300 x1830949054647808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.230894:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949054647808 ext(3534848->3538943) 00002000:00010000:2.0:1746129830.230898:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:2.0:1746129830.230917:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7311 00000100:00100000:2.0:1746129830.230922:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054647808:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129830.231040:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1961:x1830949054647808:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 118us (2815us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129830.231046:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7311 00002000:00100000:2.0:1746129830.231051:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3534848->3538943) req@ffff880092ada300 x1830949054647808/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.231061:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada300 with x1830949054647808 ext(3534848->3538943) 00002000:00010000:2.0:1746129830.231064:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092ada300 00000100:00100000:1.0:1746129830.231840:0:20441:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20441:1830949054135168:192.168.204.31@tcp:106: 00010000:00010000:1.0:1746129830.231879:0:20441:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b453600/0x48868a4e43956b4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f1f expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.231890:0:20441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b453600/0x48868a4e43956b4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f1f expref: 30 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129830.231901:0:20441:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b453600, rc 0) 00000100:00100000:1.0:1746129830.231920:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054647424:12345-192.168.204.31@tcp:101:cat.0 Request processed in 6631us (6787us total) trans 0 rc 301/301 00000100:00100000:1.0:1746129830.231926:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16103 00000100:00100000:2.0:1746129830.238182:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054135296:192.168.204.31@tcp:106: 00010000:00010000:2.0:1746129830.238213:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c073a00/0x48868a4e43956b56 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f26 expref: 32 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129830.238226:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c073a00/0x48868a4e43956b56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f26 expref: 32 pid: 7976 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129830.238239:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c073a00, rc 0) 00000100:00100000:2.0:1746129830.238277:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1962:x1830949054647552:12345-192.168.204.31@tcp:101:cat.0 Request processed in 9226us (10899us total) trans 0 rc 301/301 00000100:00100000:2.0:1746129830.238284:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16104 00000100:00100000:0.0:1746129830.238742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.239046:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054648064 00000100:00100000:2.0:1746129830.239052:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054648064 00002000:00100000:2.0:1746129830.239076:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3747840->3751935) req@ffff880092adad80 x1830949054648064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.239086:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adad80 with x1830949054648064 ext(3747840->3751935) 00002000:00010000:2.0:1746129830.239090:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adad80 00000100:00100000:2.0:1746129830.239646:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7312 00000100:00100000:2.0:1746129830.239653:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054648064:12345-192.168.204.31@tcp:3:multiop.0 00000100:00100000:2.0:1746129830.240246:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092adad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054648064:12345-192.168.204.31@tcp:3:multiop.0 Request processed in 592us (1504us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746129830.240253:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7312 00002000:00100000:2.0:1746129830.240259:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3747840->3751935) req@ffff880092adad80 x1830949054648064/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/4536 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.240266:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092adad80 with x1830949054648064 ext(3747840->3751935) 00002000:00010000:2.0:1746129830.240269:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092adad80 00000100:00100000:3.0:1746129830.241819:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.241920:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054648320 00000100:00100000:2.0:1746129830.241925:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054648320 00002000:00100000:2.0:1746129830.241958:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b7d9180 x1830949054648320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.241966:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9180 with x1830949054648320 ext(2097152->3145727) 00002000:00010000:2.0:1746129830.241970:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d9180 00000100:00100000:2.0:1746129830.241991:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7313 00000100:00100000:2.0:1746129830.241996:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054648320:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129830.252842:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1963:x1830949054648320:12345-192.168.204.31@tcp:3:cat.0 Request processed in 10836us (11017us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129830.252866:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7313 00002000:00100000:2.0:1746129830.252876:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (2097152->3145727) req@ffff88012b7d9180 x1830949054648320/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/440 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.252884:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b7d9180 with x1830949054648320 ext(2097152->3145727) 00002000:00010000:2.0:1746129830.252889:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b7d9180 00000100:00100000:0.0:1746129830.259006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.259449:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054648448 00000100:00100000:2.0:1746129830.259458:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054648448 00000100:00100000:2.0:1746129830.259499:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16105 00000100:00100000:2.0:1746129830.259505:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:31947:x1830949054648448:12345-192.168.204.31@tcp:101:cat.0 00010000:00010000:2.0:1746129830.259519:0:7976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129830.259532:0:7976:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f2d expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.259839:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.259919:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129830.259921:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746129830.259925:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f2d expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.259957:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 39 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.259968:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 39 pid: 20441 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746129830.259984:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054135424:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129830.262861:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093c6fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746129830.265135:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054135424:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129830.265160:0:7976:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f2d expref: 32 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129830.265177:0:7976:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c073e00, rc 0) 00000100:00100000:2.0:1746129830.265223:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:31947:x1830949054648448:12345-192.168.204.31@tcp:101:cat.0 Request processed in 5717us (6223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129830.265230:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16105 00000100:00100000:0.0:1746129830.266751:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.266832:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054648576 00000100:00100000:2.0:1746129830.266839:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054648576 00002000:00100000:2.0:1746129830.266932:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3198976->3710975) req@ffff880092ada680 x1830949054648576/t0(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.266940:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada680 with x1830949054648576 ext(3198976->3710975) 00010000:00010000:2.0:1746129830.267230:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 40 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.267243:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 40 pid: 20441 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746129830.267249:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ada680 00000100:00100000:2.0:1746129830.267278:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 1969 00000100:00100000:2.0:1746129830.267285:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+40:1962:x1830949054648576:12345-192.168.204.31@tcp:4:multiop.0 00000100:00100000:2.0:1746129830.277003:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ada680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1962:x1830949054648576:12345-192.168.204.31@tcp:4:multiop.0 Request processed in 9711us (10248us total) trans 17179874240 rc 0/0 00000100:00100000:2.0:1746129830.277014:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 1969 00002000:00100000:2.0:1746129830.277022:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3198976->3710975) req@ffff880092ada680 x1830949054648576/t17179874240(0) o4->4f7f9bfc-9d94-44f8-af78-53c9731f908b@192.168.204.31@tcp:571/0 lens 488/448 e 0 to 0 dl 1746129841 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.277030:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092ada680 with x1830949054648576 ext(3198976->3710975) 00010000:00010000:2.0:1746129830.277038:0:21603:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 42 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746129830.277051:0:21603:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 42 pid: 20441 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746129830.277057:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092ada680 00000100:00100000:0.0:1746129830.283242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129830.283330:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054648704 00000100:00100000:3.0:1746129830.283336:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054648704 00010000:00010000:3.0:1746129830.283366:0:7107:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 42 pid: 20441 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746129830.283392:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8088 00000100:00100000:3.0:1746129830.283397:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+42:1961:x1830949054648704:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129830.283405:0:7107:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129830.283420:0:7107:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 42 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.283431:0:7107:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 42 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.283446:0:7107:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b453c00/0x48868a4e43956b3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3198976->3710975) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f0a expref: 42 pid: 20441 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746129830.283465:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129830.283467:0:7107:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129830.283472:0:7107:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f2d expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.283476:0:7107:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f2d expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129830.283496:0:7107:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f2d expref: 31 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129830.283504:0:7107:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054135552:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129830.283633:0:7107:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59480 going to sleep for 11 seconds 00000100:00100000:3.0:1746129830.285511:0:7107:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7107:1830949054135552:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129830.285529:0:7107:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129830.285556:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+41:1961:x1830949054648704:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2158us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129830.285564:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8088 00000100:00100000:0.0:1746129830.291058:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129830.291092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129830.291130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129830.291185:0:2677:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054648960 00000100:00100000:1.0:1746129830.291192:0:2677:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054648960 00000100:00100000:2.0:1746129830.291202:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054649216 00000100:00100000:2.0:1746129830.291206:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054649216 00002000:00100000:2.0:1746129830.291226:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba3b100 x1830949054649216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129830.291226:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba39f80 x1830949054648960/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.291235:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b100 with x1830949054649216 ext(3145728->4194303) 00002000:00100000:1.0:1746129830.291235:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39f80 with x1830949054648960 ext(2097152->3145727) 00002000:00010000:2.0:1746129830.291240:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b100 00002000:00010000:1.0:1746129830.291240:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39f80 00000100:00100000:1.0:1746129830.291272:0:2677:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7314 00000100:00100000:1.0:1746129830.291280:0:2677:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1962:x1830949054649216:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129830.291298:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054649472 00000100:00100000:2.0:1746129830.291301:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054649472 00000100:00100000:2.0:1746129830.291314:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7315 00000100:00100000:2.0:1746129830.291319:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:1961:x1830949054648960:12345-192.168.204.31@tcp:3:cat.0 00002000:00100000:1.0:1746129830.292396:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012ba38000 x1830949054649472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 504/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129830.292404:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949054649472 ext(3145728->4194303) 00002000:00010000:1.0:1746129830.292417:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38000 00000100:00100000:1.0:1746129830.292430:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7316 00000100:00100000:1.0:1746129830.292436:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054649472:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:1.0:1746129830.305413:0:2677:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:1962:x1830949054649216:12345-192.168.204.31@tcp:3:cat.0 Request processed in 14123us (14309us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129830.305441:0:2677:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7314 00002000:00100000:1.0:1746129830.305458:0:2677:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3f4:0x0] (3145728->4194303) req@ffff88012ba3b100 x1830949054649216/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/440 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746129830.305466:0:2677:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3b100 with x1830949054649216 ext(3145728->4194303) 00002000:00010000:1.0:1746129830.305483:0:2677:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba3b100 00000100:00100000:2.0:1746129830.306510:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+32:1961:x1830949054648960:12345-192.168.204.31@tcp:3:cat.0 Request processed in 15175us (15444us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129830.306520:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7315 00002000:00100000:2.0:1746129830.306535:0:8440:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3f4:0x0] (2097152->3145727) req@ffff88012ba39f80 x1830949054648960/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/440 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.306543:0:8440:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba39f80 with x1830949054648960 ext(2097152->3145727) 00002000:00010000:2.0:1746129830.306555:0:8440:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ba39f80 00000100:00100000:2.0:1746129830.309414:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1961:x1830949054649472:12345-192.168.204.31@tcp:3:cat.0 Request processed in 16971us (18275us total) trans 0 rc 831488/831488 00000100:00100000:2.0:1746129830.309428:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7316 00002000:00100000:2.0:1746129830.309437:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3145728->4194303) req@ffff88012ba38000 x1830949054649472/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 504/440 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.309826:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38000 with x1830949054649472 ext(3145728->4194303) 00002000:00010000:2.0:1746129830.309831:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38000 00000100:00100000:0.0:1746129830.313401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.313504:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054649728 00000100:00100000:2.0:1746129830.313513:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054649728 00002000:00100000:2.0:1746129830.313549:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012ba38700 x1830949054649728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.313558:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38700 with x1830949054649728 ext(4194304->4931583) 00002000:00010000:2.0:1746129830.313562:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38700 00000100:00100000:2.0:1746129830.313578:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7317 00000100:00100000:2.0:1746129830.313584:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054649728:12345-192.168.204.31@tcp:3:cat.0 00000100:00100000:2.0:1746129830.322133:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1962:x1830949054649728:12345-192.168.204.31@tcp:3:cat.0 Request processed in 8538us (8728us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746129830.322145:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7317 00002000:00100000:2.0:1746129830.322156:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (4194304->4931583) req@ffff88012ba38700 x1830949054649728/t0(0) o3->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/440 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.322164:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba38700 with x1830949054649728 ext(4194304->4931583) 00002000:00010000:2.0:1746129830.322169:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba38700 00000100:00100000:0.0:1746129830.421968:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129830.422034:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054649856 00000100:00100000:2.0:1746129830.422042:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054649856 00002000:00100000:2.0:1746129830.422083:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3534848->3751935) req@ffff88012ba3aa00 x1830949054649856/t0(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/0 e 0 to 0 dl 1746129841 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.422092:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949054649856 ext(3534848->3751935) 00002000:00010000:2.0:1746129830.422097:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3aa00 00000100:00100000:2.0:1746129830.422114:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7318 00000100:00100000:2.0:1746129830.422121:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+29:1964:x1830949054649856:12345-192.168.204.31@tcp:4:cat.0 00000100:00100000:2.0:1746129830.429329:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:bbfcdf81-6a35-44a7-a752-1f1fdff20131+31:1964:x1830949054649856:12345-192.168.204.31@tcp:4:cat.0 Request processed in 7200us (7385us total) trans 21474841439 rc 0/0 00000100:00100000:2.0:1746129830.429338:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7318 00002000:00100000:2.0:1746129830.429349:0:21603:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3f0:0x0] (3534848->3751935) req@ffff88012ba3aa00 x1830949054649856/t21474841439(0) o4->bbfcdf81-6a35-44a7-a752-1f1fdff20131@192.168.204.31@tcp:571/0 lens 488/448 e 0 to 0 dl 1746129841 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746129830.429358:0:21603:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ba3aa00 with x1830949054649856 ext(3534848->3751935) 00002000:00010000:2.0:1746129830.429363:0:21603:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ba3aa00 00000001:00080000:3.0:1746129830.593426:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841427 is committed 00000001:00080000:3.0:1746129830.593442:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841419 is committed 00000001:00080000:3.0:1746129830.593469:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841437 is committed 00000001:00080000:3.0:1746129830.593475:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841434 is committed 00000001:00080000:3.0:1746129830.593485:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841424 is committed 00000001:00080000:3.0:1746129830.593498:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841439 is committed 00000001:00080000:3.0:1746129830.593507:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841435 is committed 00000001:00080000:3.0:1746129830.593511:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841426 is committed 00000001:00080000:3.0:1746129830.593531:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841438 is committed 00000001:00080000:3.0:1746129830.593566:0:549:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841408 is committed 00000001:00080000:0.0:1746129830.719589:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874212 is committed 00000001:00080000:0.0:1746129830.719601:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874206 is committed 00000001:00080000:0.0:1746129830.719608:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874195 is committed 00000001:00080000:0.0:1746129830.719614:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874235 is committed 00000001:00080000:0.0:1746129830.719618:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874232 is committed 00000001:00080000:0.0:1746129830.719629:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874226 is committed 00000001:00080000:0.0:1746129830.719649:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874240 is committed 00000001:00080000:0.0:1746129830.719655:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874239 is committed 00000001:00080000:0.0:1746129830.719675:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874227 is committed 00000001:00080000:0.0:1746129830.719704:0:2233:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874228 is committed 00000100:00100000:0.0:1746129831.019629:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.019657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.019677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.019691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.019716:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054650112 00000100:00100000:0.0:1746129831.019716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.019724:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054650112 00000100:00100000:0.0:1746129831.019740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.019758:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054649984 00000100:00100000:0.0:1746129831.019759:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054650368 00000100:00100000:1.0:1746129831.019760:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054649984 00000100:00100000:0.0:1746129831.019762:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054650368 00000100:00100000:1.0:1746129831.019770:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054650240 00000100:00100000:1.0:1746129831.019772:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054650240 00000100:00100000:0.0:1746129831.019778:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054650624 00000100:00100000:0.0:1746129831.019780:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054650624 00000100:00100000:1.0:1746129831.019781:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054650496 00000100:00100000:1.0:1746129831.019783:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054650496 00000100:00100000:0.0:1746129831.019793:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16106 00000100:00100000:1.0:1746129831.019879:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16107 00000100:00100000:1.0:1746129831.019886:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054649984:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129831.019994:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+11:1962:x1830949054649984:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 108us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.020000:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16107 00000100:00100000:1.0:1746129831.020014:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16108 00000100:00100000:1.0:1746129831.020019:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054650368:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129831.020048:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054650368:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.020053:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16108 00000100:00100000:1.0:1746129831.020061:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16109 00000100:00100000:1.0:1746129831.020065:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054650240:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129831.020094:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1962:x1830949054650240:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 29us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.020099:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16109 00000100:00100000:1.0:1746129831.020107:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16110 00000100:00100000:1.0:1746129831.020110:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054650624:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129831.020131:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1961:x1830949054650624:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 20us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.020135:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16110 00000100:00100000:1.0:1746129831.020142:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16111 00000100:00100000:1.0:1746129831.020145:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054650496:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:1.0:1746129831.020168:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1962:x1830949054650496:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 22us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.020172:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16111 00000100:00100000:0.0:1746129831.020757:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+10:1961:x1830949054650112:12345-192.168.204.31@tcp:16:kworker.0 00000100:00100000:0.0:1746129831.020800:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1961:x1830949054650112:12345-192.168.204.31@tcp:16:kworker.0 Request processed in 1001us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129831.020806:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16106 00000100:00100000:0.0:1746129831.051792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.051890:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054650880 00000100:00100000:2.0:1746129831.051898:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054650880 00000100:00100000:2.0:1746129831.053703:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4705 00000100:00100000:2.0:1746129831.053716:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+33:31969:x1830949054650880:12345-192.168.204.31@tcp:35:umount.0 00000100:00080000:0.0:1746129831.054241:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746129831.054410:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:31969:x1830949054650880:12345-192.168.204.31@tcp:35:umount.0 Request processed in 697us (2623us total) trans 8589945215 rc 0/0 00000100:00100000:2.0:1746129831.054417:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4705 00000100:00100000:0.0:1746129831.059756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.063252:0:15740:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054651136 00000100:00100000:1.0:1746129831.063265:0:15740:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054651136 00000100:00100000:1.0:1746129831.063307:0:15740:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4706 00000100:00100000:1.0:1746129831.063313:0:15740:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+34:31969:x1830949054651136:12345-192.168.204.31@tcp:35:umount.0 00000100:00100000:1.0:1746129831.063530:0:15740:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:31969:x1830949054651136:12345-192.168.204.31@tcp:35:umount.0 Request processed in 216us (3779us total) trans 8589945216 rc 0/0 00000100:00100000:1.0:1746129831.063536:0:15740:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4706 00000100:00100000:0.0:1746129831.065379:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.065409:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.065436:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.065483:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054651264 00000100:00100000:1.0:1746129831.065487:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054651264 00000100:00100000:1.0:1746129831.065515:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054651520 00000100:00100000:1.0:1746129831.065517:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054651520 00000100:00100000:1.0:1746129831.065526:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054651392 00000100:00100000:1.0:1746129831.065528:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054651392 00000100:00100000:1.0:1746129831.065540:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 751 00000100:00100000:1.0:1746129831.065545:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+17:1962:x1830949054651264:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.065556:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.065573:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a511ac00/0x48868a4e4394b078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350490 expref: 17 pid: 14312 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.065586:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129831.065611:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+16:1962:x1830949054651264:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 65us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.065616:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 751 00000100:00100000:1.0:1746129831.065628:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 752 00000100:00100000:1.0:1746129831.065632:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+15:1962:x1830949054651520:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.065638:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.065644:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a511b800/0x48868a4e4394b086 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3504c1 expref: 15 pid: 14312 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.065650:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129831.065660:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+14:1962:x1830949054651520:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.065664:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 752 00000100:00100000:1.0:1746129831.065671:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 753 00000100:00100000:1.0:1746129831.065674:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+13:1962:x1830949054651392:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.065680:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.065685:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880130a39400/0x48868a4e4394b07f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3504ba expref: 13 pid: 14311 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.065690:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129831.065698:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5278c6ae-40e3-4880-9941-e4a223d3f965+12:1962:x1830949054651392:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 23us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.065702:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 753 00000100:00100000:0.0:1746129831.068677:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.068759:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054652032 00000100:00100000:2.0:1746129831.068766:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054652032 00000100:00100000:2.0:1746129831.068802:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16112 00000100:00100000:2.0:1746129831.068809:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+8:1960:x1830949054652032:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1746129831.068834:0:1877:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e4394b09b 00000020:00010000:2.0:1746129831.068840:0:1877:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a0428000: total 0 00000100:00080000:2.0:1746129831.068843:0:1877:0:(import.c:66:import_set_state_nolock()) ffff8800a042a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746129831.068904:0:1877:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874240 00000100:00100000:2.0:1746129831.069132:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:bbfcdf81-6a35-44a7-a752-1f1fdff20131+6:1960:x1830949054652032:12345-192.168.204.31@tcp:9:umount.0 Request processed in 324us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.069138:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16112 00000020:00010000:3.0:1746129831.069197:0:20054:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a0428000: total 0 00010000:00010000:3.0:1746129831.069200:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.069232:0:20054:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a0428000, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1746129831.069272:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c073e00/0x48868a4e43956b5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f2d expref: 5 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.069306:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db43600/0x48868a4e43956957 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dac expref: 4 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.069323:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5217e00/0x48868a4e439567c8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356cb7 expref: 3 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.069331:0:20054:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a0428000, canceled 3 locks, left on hash table 0. 00010000:00010000:3.0:1746129831.069341:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.069343:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.069344:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129831.085563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.085896:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054652672 00000100:00100000:2.0:1746129831.085904:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054652672 00000100:00100000:2.0:1746129831.085952:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16113 00000100:00100000:2.0:1746129831.085959:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+9:1960:x1830949054652672:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1746129831.085985:0:8435:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e4394b094 00000020:00010000:2.0:1746129831.085990:0:8435:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a042f800: total 0 00000100:00080000:2.0:1746129831.085994:0:8435:0:(import.c:66:import_set_state_nolock()) ffff8800a0429000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746129831.086033:0:8435:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841439 00000100:00100000:2.0:1746129831.086247:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbfcdf81-6a35-44a7-a752-1f1fdff20131+7:1960:x1830949054652672:12345-192.168.204.31@tcp:9:umount.0 Request processed in 287us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.086253:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16113 00000020:00010000:3.0:1746129831.086311:0:7111:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a042f800: total 0 00010000:00010000:3.0:1746129831.086342:0:7111:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a042f800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1746129831.086384:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880134ca7c00/0x48868a4e43956a06 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e3f expref: 6 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.086412:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a27f000/0x48868a4e439567b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ca2 expref: 5 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.086443:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b453e00/0x48868a4e43956b48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3534848->3751935) gid 0 flags: 0x44801000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f18 expref: 4 pid: 20441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.086460:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012eab5a00/0x48868a4e4394b1c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35059a expref: 3 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.086471:0:7111:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a042f800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1746129831.086482:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.086483:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.086485:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129831.094490:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.095612:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054653056 00000100:00100000:3.0:1746129831.095621:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054653056 00000100:00100000:3.0:1746129831.095663:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11175 00000100:00100000:3.0:1746129831.095670:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+35:1960:x1830949054653056:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1746129831.095696:0:16808:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e4394b08d 00000020:00010000:3.0:1746129831.095703:0:16808:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008ec8a000: total 0 00000100:00080000:3.0:1746129831.095707:0:16808:0:(import.c:66:import_set_state_nolock()) ffff88008ec8c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746129831.095821:0:16808:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945216 00000020:00010000:2.0:1746129831.096148:0:7110:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008ec8a000: total 0 00010000:00010000:2.0:1746129831.096183:0:7110:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008ec8a000, canceled 0 locks, left on hash table 6. 00010000:00010000:2.0:1746129831.096206:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.096209:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746129831.096216:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095231000/0x48868a4e4395658a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b52 expref: 34 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.096234:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.096236:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129831.096239:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa01c00/0x48868a4e439565a6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b6e expref: 33 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.096248:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.096250:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746129831.096253:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012baa5200/0x48868a4e439567a5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c9b expref: 32 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.096262:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.096264:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746129831.096266:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948c0e00/0x48868a4e4395693b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d97 expref: 31 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.096274:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.096276:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746129831.096279:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c69600/0x48868a4e43956b02 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ee7 expref: 30 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.096287:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129831.096289:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746129831.096292:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801310ece00/0x48868a4e4394b119 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35055b expref: 29 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.096299:0:7110:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008ec8a000, canceled 6 locks, left on hash table 0. 00010000:00010000:2.0:1746129831.096309:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129831.096311:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129831.096312:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129831.096639:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:bbfcdf81-6a35-44a7-a752-1f1fdff20131+27:1960:x1830949054653056:12345-192.168.204.31@tcp:39:umount.0 Request processed in 966us (2154us total) trans 8589945217 rc 0/0 00000100:00100000:3.0:1746129831.096647:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11175 00010000:00010000:2.0:1746129831.231299:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746129831.479130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.479171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.481015:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054653184 00000100:00100000:2.0:1746129831.481024:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054653184 00000100:00100000:2.0:1746129831.481077:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054653312 00000100:00100000:2.0:1746129831.481080:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054653312 00000100:00100000:2.0:1746129831.481106:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 754 00000100:00100000:2.0:1746129831.481112:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5278c6ae-40e3-4880-9941-e4a223d3f965+13:1961:x1830949054653184:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129831.481124:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129831.481140:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880094c1f800/0x48868a4e4394b0a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf3504eb expref: 13 pid: 14312 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.481158:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129831.481194:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5278c6ae-40e3-4880-9941-e4a223d3f965+12:1961:x1830949054653184:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 82us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.481200:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 754 00000100:00100000:2.0:1746129831.481213:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 755 00000100:00100000:2.0:1746129831.481217:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5278c6ae-40e3-4880-9941-e4a223d3f965+11:1962:x1830949054653312:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746129831.481222:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129831.481229:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012eab4600/0x48868a4e4394b0a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350515 expref: 11 pid: 14311 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.481236:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129831.481249:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:5278c6ae-40e3-4880-9941-e4a223d3f965+10:1962:x1830949054653312:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 33us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.481254:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 755 00000100:00100000:0.0:1746129831.481526:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.481615:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.481652:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054653440 00000100:00100000:0.0:1746129831.481655:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054653440 00000100:00100000:0.0:1746129831.481672:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 756 00000100:00100000:0.0:1746129831.481677:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5278c6ae-40e3-4880-9941-e4a223d3f965+10:1961:x1830949054653440:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746129831.481683:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746129831.481694:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880094c1ea00/0x48868a4e4394b0b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf35051c expref: 10 pid: 14312 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.481709:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746129831.481723:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5278c6ae-40e3-4880-9941-e4a223d3f965+9:1961:x1830949054653440:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 46us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129831.481727:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 756 00000100:00100000:0.0:1746129831.481782:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054653824 00000100:00100000:0.0:1746129831.481785:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054653824 00000100:00100000:0.0:1746129831.481803:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16114 00000100:00100000:0.0:1746129831.481807:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1960:x1830949054653824:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:0.0:1746129831.481823:0:1877:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e4394b0c5 00000020:00010000:0.0:1746129831.481828:0:1877:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b20fd000: total 0 00000100:00080000:0.0:1746129831.481831:0:1877:0:(import.c:66:import_set_state_nolock()) ffff8800b20fc000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1746129831.482467:0:20054:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b20fd000: total 0 00010000:00010000:3.0:1746129831.482503:0:20054:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b20fd000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746129831.482537:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fb11a00/0x48868a4e4395689a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d2e expref: 6 pid: 20441 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.482559:0:20054:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ba84e00/0x48868a4e43956a3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e62 expref: 5 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.482567:0:20054:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b20fd000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746129831.482577:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.482578:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.482580:0:20054:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1746129831.482609:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00000004:0.0:1746129831.482904:0:1877:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874240 00000100:00100000:0.0:1746129831.484333:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+2:1960:x1830949054653824:12345-192.168.204.31@tcp:9:umount.0 Request processed in 2518us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129831.484341:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16114 00000100:00100000:0.0:1746129831.487264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.487411:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054654208 00000100:00100000:2.0:1746129831.487418:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054654208 00000100:00100000:2.0:1746129831.487469:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16115 00000100:00100000:2.0:1746129831.487475:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+7:1960:x1830949054654208:12345-192.168.204.31@tcp:9:umount.0 00000020:00000080:2.0:1746129831.487498:0:8435:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e4394b0be 00000020:00010000:2.0:1746129831.487504:0:8435:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800b20f8000: total 0 00000100:00080000:2.0:1746129831.487507:0:8435:0:(import.c:66:import_set_state_nolock()) ffff8800b20f8800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1746129831.487621:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:3.0:1746129831.487857:0:7111:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800b20f8000: total 0 00010000:00010000:3.0:1746129831.487861:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.487893:0:7111:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800b20f8000, canceled 0 locks, left on hash table 2. 00000001:00000004:2.0:1746129831.487911:0:8435:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841439 00010000:00010000:3.0:1746129831.487947:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba84000/0x48868a4e43956a45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e69 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.487980:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f2db400/0x48868a4e43956893 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356d27 expref: 5 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.487989:0:7111:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800b20f8000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746129831.487997:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.487999:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746129831.488000:0:7111:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746129831.488049:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+2:1960:x1830949054654208:12345-192.168.204.31@tcp:9:umount.0 Request processed in 574us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.488055:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16115 00000100:00100000:2.0:1746129831.491198:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.491275:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054654464 00000100:00100000:3.0:1746129831.491281:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054654464 00000100:00100000:3.0:1746129831.491320:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11176 00000100:00100000:3.0:1746129831.491328:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+12:1960:x1830949054654464:12345-192.168.204.31@tcp:39:umount.0 00000020:00000080:3.0:1746129831.491355:0:16808:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x48868a4e4394b0b7 00000020:00010000:3.0:1746129831.491360:0:16808:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88008ec89000: total 0 00000100:00080000:3.0:1746129831.491363:0:16808:0:(import.c:66:import_set_state_nolock()) ffff88008ec88000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746129831.491384:0:16808:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945217 00000020:00010000:2.0:1746129831.491420:0:7110:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88008ec89000: total 0 00010000:00010000:2.0:1746129831.491453:0:7110:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88008ec89000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1746129831.491478:0:7110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008f581100) 00010000:00010000:2.0:1746129831.491481:0:7110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746129831.491486:0:7110:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1f600/0x48868a4e4394b0d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf350546 expref: 11 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.491511:0:7110:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88008ec89000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1746129831.491520:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129831.491522:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746129831.491524:0:7110:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746129831.491529:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7+9:1960:x1830949054654464:12345-192.168.204.31@tcp:39:umount.0 Request processed in 202us (339us total) trans 8589945218 rc 0/0 00000100:00100000:3.0:1746129831.491535:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11176 00000100:00100000:0.0:1746129831.517063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.517110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.517371:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054654592 00000100:00100000:1.0:1746129831.517379:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054654592 00000100:00100000:1.0:1746129831.517422:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054654720 00000100:00100000:1.0:1746129831.517424:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054654720 00000100:00100000:2.0:1746129831.517435:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16116 00000100:00100000:2.0:1746129831.517445:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1964:x1830949054654592:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.517461:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.517477:0:8435:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f34 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.517507:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16117 00000100:00100000:1.0:1746129831.517514:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1964:x1830949054654720:12345-192.168.204.31@tcp:101:lfs.0 00002000:00010000:2.0:1746129831.517518:0:8435:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d3a6, atime: 0x6813d3a6, ctime: 0x6813d3a6, blocks: 0x15e9 00010000:00010000:1.0:1746129831.517521:0:1877:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129831.517532:0:1877:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f3b expref: -99 pid: 1877 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.517533:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.517538:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.517546:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746129831.517547:0:1877:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d3a6, atime: 0x6813d3a6, ctime: 0x6813d3a6, blocks: 0x1029 00010000:00010000:1.0:1746129831.517555:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.517557:0:1877:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.517559:0:8435:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 13 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.517561:0:1877:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.517571:0:1877:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 20 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.517578:0:1877:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f984000, rc 0) 00000100:00100000:1.0:1746129831.517614:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1964:x1830949054654720:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 101us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.517620:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16117 00010000:00010000:2.0:1746129831.518259:0:8435:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c1600, rc 0) 00000100:00100000:2.0:1746129831.518292:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1964:x1830949054654592:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 849us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.518298:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16116 00000100:00100000:0.0:1746129831.529228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.529305:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054654976 00000100:00100000:2.0:1746129831.529314:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054654976 00000100:00100000:2.0:1746129831.529364:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4707 00000100:00100000:2.0:1746129831.529371:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+299:31991:x1830949054654976:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129831.529555:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31991:x1830949054654976:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 184us (334us total) trans 8589945219 rc 0/0 00000100:00100000:2.0:1746129831.529561:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4707 00000100:00100000:0.0:1746129831.534292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.534347:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054655232 00000100:00100000:3.0:1746129831.534356:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054655232 00000100:00100000:3.0:1746129831.534407:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11177 00000100:00100000:3.0:1746129831.534416:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31991:x1830949054655232:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:3.0:1746129831.534434:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746129831.534437:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1746129831.534459:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe400/0x48868a4e43956b1e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x36b:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ef5 expref: 300 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.534478:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fb10400/0x48868a4e4395674a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c6a expref: 299 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.534486:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129831.534490:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746129831.534499:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e43956b72 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f42 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.534571:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956b79 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.534580:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956b79 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.534587:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956b79 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:3.0:1746129831.534595:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00010000:00010000:3.0:1746129831.534676:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbf400/0x48868a4e43956b72 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f42 expref: 301 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.534686:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956b79 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f42 expref: 300 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.534692:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129831.534694:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746129831.534696:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009adbe000, rc 0) 00000100:00100000:3.0:1746129831.534733:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31991:x1830949054655232:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 319us (448us total) trans 8589945220 rc 0/0 00000100:00100000:3.0:1746129831.534739:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11177 00000100:00100000:1.0:1746129831.537710:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.537742:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.537780:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.537843:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054655360 00000100:00100000:3.0:1746129831.537867:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054655360 00000100:00100000:3.0:1746129831.537905:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054655488 00000100:00100000:3.0:1746129831.537907:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054655488 00000100:00100000:3.0:1746129831.537921:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054655616 00000100:00100000:3.0:1746129831.537923:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054655616 00000100:00100000:3.0:1746129831.537949:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16118 00000100:00100000:3.0:1746129831.537956:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054655360:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129831.537991:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538005:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538012:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.538013:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.538016:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538040:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538051:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 13 pid: 8436 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746129831.538063:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054135680:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129831.538124:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c596c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746129831.538141:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16119 00000100:00100000:3.0:1746129831.538147:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054655488:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129831.538165:0:7976:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538174:0:7976:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.538179:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.538180:0:7976:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.538182:0:7976:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538200:0:7976:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 21 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.538208:0:7976:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 21 pid: 8435 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.538216:0:7976:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054135808:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129831.538234:0:7976:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59000 going to sleep for 11 seconds 00000100:00100000:3.0:1746129831.538254:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16120 00000100:00100000:3.0:1746129831.538260:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054655616:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:3.0:1746129831.538276:0:7975:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538285:0:7975:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.538290:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.538291:0:7975:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.538293:0:7975:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.538305:0:7975:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 21 pid: 10930 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746129831.538312:0:7975:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 21 pid: 10930 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.538320:0:7975:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054135936:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129831.538337:0:7975:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746129831.540104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.540500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.540533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.540670:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054655744 00000100:00100000:1.0:1746129831.540676:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054655744 00000100:00100000:2.0:1746129831.540695:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054655872 00000100:00100000:2.0:1746129831.540699:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054655872 00000100:00100000:1.0:1746129831.540700:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656000 00000100:00100000:1.0:1746129831.540701:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656000 00000100:00100000:1.0:1746129831.540713:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16121 00000100:00100000:1.0:1746129831.540719:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054655744:12345-192.168.204.31@tcp:1:lfs.0 00000100:00100000:2.0:1746129831.540725:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16122 00000100:00100000:2.0:1746129831.540729:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054656000:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:2.0:1746129831.540745:0:8435:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.540745:0:1140:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.540758:0:8435:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 22 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.540758:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.540764:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.540764:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.540765:0:8435:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.540765:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.540767:0:8435:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.540767:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.540785:0:8435:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 22 pid: 1877 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.540785:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 15 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.540794:0:8435:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 22 pid: 1877 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.540794:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 15 pid: 10930 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746129831.540803:0:8435:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054136192:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129831.540806:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054136064:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129831.540863:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948900 going to sleep for 11 seconds 00000100:00100000:1.0:1746129831.540879:0:10930:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16123 00000100:00100000:1.0:1746129831.540883:0:10930:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054655872:12345-192.168.204.31@tcp:1:lfs.0 00010000:00010000:1.0:1746129831.540897:0:10930:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.540906:0:10930:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.540911:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.540913:0:10930:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.540914:0:10930:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.540936:0:10930:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 15 pid: 8435 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.540943:0:10930:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 15 pid: 8435 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746129831.540950:0:10930:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054136320:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129831.540977:0:10930:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129831.541429:0:8435:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324840 going to sleep for 11 seconds 00000100:00100000:2.0:1746129831.543214:0:7976:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:7976:1830949054135808:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.543237:0:7976:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.543319:0:7975:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:7975:1830949054135936:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129831.543331:0:7975:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.543356:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1830949054135680:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129831.543368:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.543396:0:10930:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10930:1830949054136320:192.168.204.31@tcp:104: 00010000:00010000:3.0:1746129831.543405:0:10930:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129831.543450:0:8435:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1830949054136192:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.543461:0:8435:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.543573:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054136064:192.168.204.31@tcp:104: 00010000:00010000:1.0:1746129831.543589:0:1140:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129831.545947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.545983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.546594:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656128 00000100:00100000:1.0:1746129831.546601:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656128 00010000:00010000:1.0:1746129831.546631:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 23 pid: 8435 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746129831.546911:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656384 00000100:00100000:1.0:1746129831.546915:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656384 00010000:00010000:1.0:1746129831.546938:0:7108:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 24 pid: 1877 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746129831.547152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.547457:0:16449:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656640 00000100:00100000:3.0:1746129831.547460:0:16449:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656640 00010000:00010000:3.0:1746129831.547478:0:16449:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 16 pid: 8435 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.547494:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8089 00000100:00100000:3.0:1746129831.547499:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054656128:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.547510:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.547526:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 24 pid: 8435 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547535:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 24 pid: 8435 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547551:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094555600/0x48868a4e43956823 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356ce8 expref: 24 pid: 8435 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547565:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.547566:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.547570:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547576:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547592:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.547621:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1962:x1830949054656128:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 122us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.547626:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8089 00000100:00100000:3.0:1746129831.547637:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8090 00000100:00100000:3.0:1746129831.547640:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054656384:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.547645:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.547651:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 22 pid: 1877 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547662:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 22 pid: 1877 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547671:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f984000/0x48868a4e43956b6b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f3b expref: 22 pid: 1877 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547677:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.547678:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.547680:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547685:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547694:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.547703:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054656384:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 62us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.547707:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8090 00000100:00100000:3.0:1746129831.547713:0:16449:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8091 00000100:00100000:3.0:1746129831.547717:0:16449:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1962:x1830949054656640:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.547723:0:16449:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.547733:0:16449:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 16 pid: 8435 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547739:0:16449:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 16 pid: 8435 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547750:0:16449:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c1600/0x48868a4e43956b64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f34 expref: 16 pid: 8435 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.547757:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.547758:0:16449:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.547760:0:16449:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547766:0:16449:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547776:0:16449:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.547789:0:16449:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054656640:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 71us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.547794:0:16449:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8091 00010000:00010000:3.0:1746129831.547814:0:10930:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547821:0:10930:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547836:0:10930:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547842:0:10930:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547870:0:10930:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547875:0:10930:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f984c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.547878:0:10930:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547884:0:10930:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547893:0:10930:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547898:0:10930:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f984c00/0x48868a4e43956baa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10930 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.547939:0:10930:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054655872:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 7055us (7440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.547946:0:10930:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16123 00010000:00010000:3.0:1746129831.547966:0:8435:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547972:0:8435:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547983:0:8435:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547989:0:8435:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.547995:0:8435:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548000:0:8435:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6c0e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.548002:0:8435:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548006:0:8435:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548016:0:8435:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548020:0:8435:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c0e00/0x48868a4e43956b9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.548049:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054656000:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 7320us (7515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.548054:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16122 00010000:00010000:3.0:1746129831.548078:0:7976:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548083:0:7976:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548094:0:7976:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548099:0:7976:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548104:0:7976:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548108:0:7976:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c442000 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.548110:0:7976:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548114:0:7976:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548121:0:7976:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548125:0:7976:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c442000/0x48868a4e43956b8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7976 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.548149:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1961:x1830949054655488:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 10004us (10407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.548153:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16119 00000100:00100000:3.0:1746129831.548182:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.548233:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.548311:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656256 00000100:00100000:3.0:1746129831.548315:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656256 00010000:00010000:3.0:1746129831.548328:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 14 pid: 8436 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746129831.548337:0:7109:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656512 00000100:00100000:3.0:1746129831.548339:0:7109:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656512 00010000:00010000:3.0:1746129831.548345:0:7109:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 19 pid: 10930 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.548354:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8092 00000100:00100000:3.0:1746129831.548358:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054656256:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.548363:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.548372:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 14 pid: 8436 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746129831.548378:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 14 pid: 8436 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746129831.548388:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fb10800/0x48868a4e43956766 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356c7f expref: 14 pid: 8436 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746129831.548395:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.548396:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.548399:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548404:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548415:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.548431:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054656256:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 73us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.548436:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8092 00000100:00100000:3.0:1746129831.548446:0:7109:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8093 00000100:00100000:3.0:1746129831.548451:0:7109:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054656512:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.548470:0:7109:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.548479:0:7109:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 19 pid: 10930 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.548486:0:7109:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 19 pid: 10930 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.548495:0:7109:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db42400/0x48868a4e43956996 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356dcf expref: 19 pid: 10930 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.548502:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.548503:0:7109:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.548506:0:7109:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548511:0:7109:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548522:0:7109:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.548535:0:7109:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+18:1962:x1830949054656512:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 84us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.548540:0:7109:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8093 00010000:00010000:3.0:1746129831.548554:0:7975:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548560:0:7975:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548572:0:7975:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548577:0:7975:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548581:0:7975:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548586:0:7975:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c442600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.548588:0:7975:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548592:0:7975:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548600:0:7975:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548604:0:7975:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956b95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.548627:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054655616:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 10368us (10847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.548632:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16120 00010000:00010000:3.0:1746129831.548648:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548654:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548664:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548669:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548674:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548679:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbf800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.548681:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548686:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548694:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.548700:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009adbf800/0x48868a4e43956b87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.548724:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ba18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054655360:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 10769us (11022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.548728:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16118 00000100:00100000:3.0:1746129831.551901:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.552642:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054656768 00000100:00100000:1.0:1746129831.552650:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054656768 00010000:00010000:1.0:1746129831.552676:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 12 pid: 10930 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746129831.552709:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8094 00000100:00100000:1.0:1746129831.552716:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054656768:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.552728:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.552745:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 12 pid: 10930 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746129831.552756:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 12 pid: 10930 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746129831.552773:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ba35200/0x48868a4e439569ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356e38 expref: 12 pid: 10930 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746129831.552795:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.552797:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.552801:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.552808:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.553506:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129831.553554:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+11:1961:x1830949054656768:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 837us (1660us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.553560:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8094 00010000:00010000:0.0:1746129831.553636:0:1140:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553643:0:1140:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553662:0:1140:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553667:0:1140:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553673:0:1140:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553678:0:1140:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f985e00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:0.0:1746129831.553682:0:1140:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553687:0:1140:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553697:0:1140:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.553702:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f985e00/0x48868a4e43956ba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129831.553745:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+10:1961:x1830949054655744:12345-192.168.204.31@tcp:1:lfs.0 Request processed in 13026us (13646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129831.553752:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16121 00000100:00100000:0.0:1746129831.558270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.558597:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657024 00000100:00100000:2.0:1746129831.558606:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657024 00000100:00100000:2.0:1746129831.558655:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11178 00000100:00100000:2.0:1746129831.558663:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31991:x1830949054657024:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129831.558708:0:14315:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746129831.558731:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e1ab200/0x48868a4e43956624 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356bd7 expref: 300 pid: 1851 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.558766:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5244000/0x48868a4e4395659f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356b67 expref: 299 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.558777:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.558781:0:14315:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129831.558805:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.558815:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.558821:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000040:00080000:2.0:1746129831.559444:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3597, 88 off303280 00000004:00080000:2.0:1746129831.559451:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777617602904ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.559505:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3593, 88 off302832 00000004:00080000:2.0:1746129831.559509:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777617661421ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.559522:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3594, 88 off302920 00000004:00080000:2.0:1746129831.559525:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777617676973ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.559532:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3598, 88 off303368 00000004:00080000:2.0:1746129831.559534:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777617686501ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.559542:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3599, 88 off303456 00000004:00080000:2.0:1746129831.559544:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777617696500ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.559551:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3595, 88 off303008 00000004:00080000:2.0:1746129831.559553:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777617705353ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.560342:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3597, 88 off303192 00000004:00080000:2.0:1746129831.560348:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777618499694ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.560364:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3598, 88 off303280 00000004:00080000:2.0:1746129831.560367:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777618518664ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.560376:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3600, 88 off303544 00000004:00080000:2.0:1746129831.560378:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777618530165ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.560394:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3599, 88 off303368 00000004:00080000:2.0:1746129831.560396:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777618548211ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.560407:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3601, 88 off303632 00000004:00080000:2.0:1746129831.560410:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777618561685ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.560428:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3600, 88 off303456 00000004:00080000:2.0:1746129831.560431:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777618582710ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.560440:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3602, 88 off303720 00000004:00080000:2.0:1746129831.560444:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777618596228ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.560451:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3603, 88 off303808 00000004:00080000:2.0:1746129831.560453:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777618605170ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.560459:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3604, 88 off303896 00000004:00080000:2.0:1746129831.560461:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777618613523ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.560467:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3605, 88 off303984 00000004:00080000:2.0:1746129831.560469:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777618621599ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.560475:0:14315:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3601, 88 off303544 00000004:00080000:2.0:1746129831.560478:0:14315:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777618630260ns, next at 716792379979ns, rc = 0 00000004:00010000:2.0:1746129831.615913:0:14315:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009207d180 reply state ffff880134ab3400 transno 8589945221 ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129831.615939:0:14315:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129831.616023:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+300:31991:x1830949054657024:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 57358us (57758us total) trans 8589945221 rc 0/0 00000100:00100000:2.0:1746129831.616031:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11178 00000001:00080000:1.0:1746129831.616105:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945180 is committed 00000001:00080000:1.0:1746129831.616124:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945216 is committed 00000001:00080000:1.0:1746129831.616129:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945210 is committed 00000001:00080000:1.0:1746129831.616132:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945206 is committed 00000001:00080000:1.0:1746129831.616379:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945221 is committed 00000004:00080000:1.0:1746129831.616384:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2767 committed 00000004:00080000:1.0:1746129831.616389:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2776 committed 00000004:00080000:1.0:1746129831.616395:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2775 committed 00000004:00080000:1.0:1746129831.616397:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2774 committed 00000004:00080000:1.0:1746129831.616398:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2773 committed 00000004:00080000:1.0:1746129831.616400:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2766 committed 00000004:00080000:1.0:1746129831.616402:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2772 committed 00000004:00080000:1.0:1746129831.616403:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2765 committed 00000004:00080000:1.0:1746129831.616405:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2771 committed 00000004:00080000:1.0:1746129831.616406:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2764 committed 00000004:00080000:1.0:1746129831.616407:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2763 committed 00000004:00080000:1.0:1746129831.616409:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2762 committed 00000004:00080000:1.0:1746129831.616411:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2770 committed 00000004:00080000:1.0:1746129831.616412:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2769 committed 00000004:00080000:1.0:1746129831.616413:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2761 committed 00000004:00080000:1.0:1746129831.616415:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2760 committed 00000004:00080000:1.0:1746129831.616416:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2768 committed 00000001:00100000:1.0:1746129831.616453:0:14399:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7 00000001:00080000:1.0:1746129831.616457:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945218 is committed 00000020:00000080:1.0:1746129831.616459:0:14399:0:(genops.c:904:class_export_put()) final put ffff88008ec89000/e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7 00000001:00100000:1.0:1746129831.616468:0:14399:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbfcdf81-6a35-44a7-a752-1f1fdff20131 00000001:00080000:1.0:1746129831.616471:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945217 is committed 00000020:00000080:1.0:1746129831.616495:0:14399:0:(genops.c:904:class_export_put()) final put ffff88008ec8a000/bbfcdf81-6a35-44a7-a752-1f1fdff20131 00000100:00100000:1.0:1746129831.616618:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054136448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616655:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616687:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054136960:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616700:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616712:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746129831.616716:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054136576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616728:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616737:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054137088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616748:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616764:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054136704:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616776:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616786:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054137216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616798:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616808:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746129831.616811:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054136832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616824:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616833:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054137344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.616845:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.616891:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054136448 00000100:00100000:1.0:1746129831.616896:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054136448 00000100:00100000:1.0:1746129831.616940:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054136960 00000100:00100000:1.0:1746129831.616943:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054136960 00000100:00100000:1.0:1746129831.616953:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054136576 00000100:00100000:1.0:1746129831.616954:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054136576 00000100:00100000:1.0:1746129831.616962:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137088 00000100:00100000:1.0:1746129831.616963:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137088 00000100:00100000:1.0:1746129831.616970:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054136704 00000100:00100000:1.0:1746129831.616971:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054136704 00000100:00100000:1.0:1746129831.616976:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137216 00000100:00100000:1.0:1746129831.616978:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137216 00000100:00100000:1.0:1746129831.616983:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054136832 00000100:00100000:1.0:1746129831.616984:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054136832 00000100:00100000:1.0:1746129831.616989:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137344 00000100:00100000:1.0:1746129831.616990:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137344 00000100:00100000:1.0:1746129831.616997:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16124 00000100:00100000:1.0:1746129831.617003:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054136448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.617203:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054136448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 199us (546us total) trans 21474841440 rc 0/0 00000100:00100000:1.0:1746129831.617209:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16124 00000100:00100000:1.0:1746129831.617221:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16125 00000100:00100000:1.0:1746129831.617225:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054136960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.617306:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054136960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (604us total) trans 21474841441 rc 0/0 00000100:00100000:1.0:1746129831.617311:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16125 00000100:00100000:1.0:1746129831.617320:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16126 00000100:00100000:1.0:1746129831.617324:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054136576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.617421:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054136576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (691us total) trans 21474841442 rc 0/0 00000100:00100000:1.0:1746129831.617426:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16126 00000100:00100000:1.0:1746129831.617434:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16127 00000100:00100000:1.0:1746129831.617438:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3296:x1830949054137088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.617526:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3296:x1830949054137088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (777us total) trans 21474841443 rc 0/0 00000100:00100000:1.0:1746129831.617531:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16127 00000100:00100000:1.0:1746129831.617539:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16128 00000100:00100000:1.0:1746129831.617542:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054136704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.617643:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054136704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (864us total) trans 21474841444 rc 0/0 00000100:00100000:1.0:1746129831.617649:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16128 00000100:00100000:1.0:1746129831.617658:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16129 00000100:00100000:1.0:1746129831.617662:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054137216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.617737:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054137216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (937us total) trans 21474841445 rc 0/0 00000100:00100000:1.0:1746129831.617742:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16129 00000100:00100000:1.0:1746129831.617751:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16130 00000100:00100000:1.0:1746129831.617755:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054136832:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129831.617798:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.617806:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.617812:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.617817:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c1ea00 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129831.617820:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129831.617824:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054136832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (999us total) trans 21474841446 rc 0/0 00010000:00010000:2.0:1746129831.617826:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00000100:00100000:1.0:1746129831.617831:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16130 00000100:00100000:1.0:1746129831.617840:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16131 00000100:00100000:1.0:1746129831.617844:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3298:x1830949054137344:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746129831.617866:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.617869:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129831.617872:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.617877:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094c1ea00/0x48868a4e43956bb1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000020:00000080:3.0:1746129831.618196:0:294:0:(genops.c:863:class_export_destroy()) destroying export ffff88008ec89000/e3ac8b3a-475d-4c4d-aaf6-350c7a8ce4d7 for lustre-MDT0000 00000020:00000080:3.0:1746129831.618248:0:294:0:(genops.c:863:class_export_destroy()) destroying export ffff88008ec8a000/bbfcdf81-6a35-44a7-a752-1f1fdff20131 for lustre-MDT0000 00000020:00000080:3.0:1746129831.618268:0:294:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88008ec88000 for lustre-MDT0000 00000020:00000080:3.0:1746129831.618271:0:294:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88008ec8c000 for lustre-MDT0000 00000100:00100000:0.0:1746129831.618997:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054137600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.619019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.619024:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129831.619044:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054138112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.619057:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.619064:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657152 00000100:00100000:2.0:1746129831.619069:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657152 00000100:00100000:0.0:1746129831.619070:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129831.619073:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054137472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.619085:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.619092:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11179 00000100:00100000:0.0:1746129831.619093:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054137984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.619098:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31991:x1830949054657152:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:0.0:1746129831.619104:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746129831.619108:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746129831.619117:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137600 00010000:00010000:2.0:1746129831.619120:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f49 expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129831.619120:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137600 00000100:00100000:0.0:1746129831.619133:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054138112 00000100:00100000:0.0:1746129831.619134:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054138112 00000100:00100000:0.0:1746129831.619139:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137472 00000100:00100000:0.0:1746129831.619140:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137472 00000100:00100000:0.0:1746129831.619145:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137984 00000100:00100000:0.0:1746129831.619147:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137984 00000100:00100000:0.0:1746129831.619153:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16132 00010000:00010000:2.0:1746129831.619156:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129831.619156:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949054137600:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746129831.619166:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.619178:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.619180:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746129831.619182:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da73a00, rc 0) 00000100:00100000:2.0:1746129831.619206:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31991:x1830949054657152:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 108us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.619211:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11179 00000100:00100000:0.0:1746129831.619292:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949054137600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (267us total) trans 17179874241 rc 0/0 00000100:00100000:0.0:1746129831.619298:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16132 00000100:00100000:0.0:1746129831.619308:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16133 00000100:00100000:0.0:1746129831.619312:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949054138112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.619391:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949054138112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (332us total) trans 17179874242 rc 0/0 00000100:00100000:0.0:1746129831.619396:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16133 00000100:00100000:0.0:1746129831.619404:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16134 00000100:00100000:0.0:1746129831.619408:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949054137472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.619492:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949054137472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (406us total) trans 17179874243 rc 0/0 00000100:00100000:0.0:1746129831.619498:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16134 00000100:00100000:0.0:1746129831.619507:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16135 00000100:00100000:0.0:1746129831.619511:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+8:3297:x1830949054137984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.619582:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3297:x1830949054137984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (476us total) trans 17179874244 rc 0/0 00000100:00100000:0.0:1746129831.619587:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16135 00000100:00100000:3.0:1746129831.619600:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054137856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.619608:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874228 gen 2 00000004:00080000:0.0:1746129831.619612:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93bb80, transno 17179874202 00000004:00080000:0.0:1746129831.619617:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f939c00, transno 17179874203 00000004:00080000:0.0:1746129831.619619:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93b480, transno 17179874204 00000100:00100000:3.0:1746129831.619620:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129831.619621:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93a300, transno 17179874205 00000004:00080000:0.0:1746129831.619623:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93b100, transno 17179874206 00000004:00080000:0.0:1746129831.619625:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93ad80, transno 17179874207 00000004:00080000:0.0:1746129831.619627:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93aa00, transno 17179874208 00000004:00080000:0.0:1746129831.619629:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f93b800, transno 17179874209 00000004:00080000:0.0:1746129831.619631:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb0a80, transno 17179874213 00000004:00080000:0.0:1746129831.619633:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb2680, transno 17179874214 00000004:00080000:0.0:1746129831.619634:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb3480, transno 17179874215 00000004:00080000:0.0:1746129831.619636:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb2300, transno 17179874216 00000004:00080000:0.0:1746129831.619638:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb1c00, transno 17179874217 00000004:00080000:0.0:1746129831.619640:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb0380, transno 17179874218 00000004:00080000:0.0:1746129831.619642:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb1180, transno 17179874219 00000004:00080000:0.0:1746129831.619644:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ffb1f80, transno 17179874220 00000004:00080000:0.0:1746129831.619645:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38380, transno 17179874221 00000004:00080000:0.0:1746129831.619647:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39c00, transno 17179874222 00000004:00080000:0.0:1746129831.619649:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba3bb80, transno 17179874223 00000004:00080000:0.0:1746129831.619651:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c5500, transno 17179874224 00000004:00080000:0.0:1746129831.619653:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba39180, transno 17179874225 00000004:00080000:0.0:1746129831.619655:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4a80, transno 17179874226 00000004:00080000:0.0:1746129831.619656:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012ba38e00, transno 17179874227 00000100:00100000:2.0:1746129831.620098:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137856 00000100:00100000:2.0:1746129831.620102:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137856 00000100:00100000:2.0:1746129831.620117:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16136 00000100:00100000:2.0:1746129831.620121:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3299:x1830949054137856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.620205:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a342050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+10:3299:x1830949054137856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (583us total) trans 17179874245 rc 0/0 00000100:00100000:2.0:1746129831.620210:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16136 00000100:00100000:1.0:1746129831.621303:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054137344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3456us (4454us total) trans 21474841447 rc 0/0 00000100:00100000:1.0:1746129831.621310:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16131 00000100:00080000:1.0:1746129831.621438:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746129831.621442:0:7118:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746129831.621705:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c1c4700, transno 17179874228 00000100:00100000:0.0:1746129831.621714:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009207f480 x1830949054137472/t17179874243(17179874243) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129847 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746129831.621725:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009207f480/2, rc 0, transno 17179874243 00000100:00100000:0.0:1746129831.621729:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054137472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129831.621743:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054138368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129831.621746:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054137728:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129831.621758:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bd880/2, rc 0, transno 17179874244 00000100:00100000:0.0:1746129831.621761:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054137984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129831.621768:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba38a80/2, rc 0, transno 17179874241 00000100:00100000:3.0:1746129831.621770:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129831.621770:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054137600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129831.621776:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bed80/2, rc 0, transno 17179874242 00000100:00100000:0.0:1746129831.621779:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054138112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129831.621784:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841426 gen 2 00000004:00080000:1.0:1746129831.621787:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad8700, transno 21474841378 00000004:00080000:1.0:1746129831.621793:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092ad8a80, transno 21474841379 00000004:00080000:1.0:1746129831.621796:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6efb80, transno 21474841380 00000004:00080000:1.0:1746129831.621797:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6300, transno 21474841381 00000004:00080000:1.0:1746129831.621799:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d6a00, transno 21474841382 00000004:00080000:3.0:1746129831.621800:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bce00/2, rc 0, transno 17179874245 00000004:00080000:1.0:1746129831.621801:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f6ec380, transno 21474841383 00000100:00100000:3.0:1746129831.621803:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054137856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129831.621803:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092adb100, transno 21474841384 00000004:00080000:1.0:1746129831.621805:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800934d5500, transno 21474841385 00000004:00080000:1.0:1746129831.621807:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adad880, transno 21474841386 00000004:00080000:1.0:1746129831.621810:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb7b80, transno 21474841397 00000004:00080000:1.0:1746129831.621812:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4e00, transno 21474841398 00000100:00100000:3.0:1746129831.621814:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054138368 00000004:00080000:1.0:1746129831.621814:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4a80, transno 21474841399 00000004:00080000:1.0:1746129831.621816:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6a00, transno 21474841400 00000100:00100000:3.0:1746129831.621817:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054138368 00000004:00080000:1.0:1746129831.621818:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb4700, transno 21474841401 00000004:00080000:1.0:1746129831.621820:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6680, transno 21474841402 00000004:00080000:1.0:1746129831.621822:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094eb6300, transno 21474841403 00000004:00080000:1.0:1746129831.621824:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c678000, transno 21474841404 00000004:00080000:1.0:1746129831.621827:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a022b100, transno 21474841405 00000004:00080000:1.0:1746129831.621829:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaf800, transno 21474841409 00000004:00080000:1.0:1746129831.621831:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac380, transno 21474841410 00000004:00080000:1.0:1746129831.621833:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7100, transno 21474841411 00000004:00080000:1.0:1746129831.621835:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b8e7b80, transno 21474841412 00000004:00080000:1.0:1746129831.621837:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adac700, transno 21474841413 00000100:00100000:3.0:1746129831.621838:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16137 00000004:00080000:1.0:1746129831.621839:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaf480, transno 21474841414 00000004:00080000:1.0:1746129831.621840:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801305bd180, transno 21474841415 00000100:00100000:3.0:1746129831.621842:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3299:x1830949054138368:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129831.621843:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adaea00, transno 21474841416 00000004:00080000:1.0:1746129831.621845:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008fad3480, transno 21474841417 00000004:00080000:1.0:1746129831.621864:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c4380, transno 21474841418 00000004:00080000:1.0:1746129831.621867:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5500, transno 21474841419 00000004:00080000:1.0:1746129831.621869:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5180, transno 21474841420 00000004:00080000:1.0:1746129831.621871:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c5880, transno 21474841421 00000004:00080000:1.0:1746129831.621873:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a04f100, transno 21474841422 00000004:00080000:1.0:1746129831.621875:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c6680, transno 21474841423 00000004:00080000:1.0:1746129831.621876:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7b80, transno 21474841424 00000004:00080000:1.0:1746129831.621879:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c7100, transno 21474841425 00000004:00080000:1.0:1746129831.621880:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a00c4700, transno 21474841426 00000100:00100000:1.0:1746129831.621885:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012ba18a80 x1830949054136576/t21474841442(21474841442) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746129847 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746129831.621892:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18a80/2, rc 0, transno 21474841442 00000100:00100000:1.0:1746129831.621895:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054136576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129831.621905:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1bb80/2, rc 0, transno 21474841443 00000100:00100000:1.0:1746129831.621907:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054137088:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129831.621914:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba19c00/2, rc 0, transno 21474841440 00000100:00100000:1.0:1746129831.621917:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054136448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129831.621934:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1a680/2, rc 0, transno 21474841441 00000100:00100000:1.0:1746129831.621937:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054136960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129831.621987:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3299:x1830949054138368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (216us total) trans 17179874246 rc 0/0 00000100:00100000:3.0:1746129831.621992:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16137 00000004:00080000:0.0:1746129831.622000:0:14359:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 8 in progress, 3 in flight, 24 done 00000004:00080000:3.0:1746129831.622013:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bc380/2, rc 0, transno 17179874246 00000100:00100000:3.0:1746129831.622016:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054138368:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746129831.622158:0:14357:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 8 in progress, 4 in flight, 36 done 00000100:00100000:1.0:1746129831.622191:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.622202:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054137728 00000100:00100000:2.0:1746129831.622206:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054137728 00000100:00100000:1.0:1746129831.622212:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801305be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054138240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.622221:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16138 00000100:00100000:2.0:1746129831.622225:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3298:x1830949054137728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129831.622228:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746129831.622245:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b100/2, rc 0, transno 21474841446 00000100:00100000:1.0:1746129831.622247:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054136832:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129831.622253:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008fad3100/2, rc 0, transno 21474841447 00000100:00100000:1.0:1746129831.622255:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008fad3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054137344:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129831.622261:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba18700/2, rc 0, transno 21474841444 00000100:00100000:1.0:1746129831.622263:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054136704:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746129831.622269:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012ba1b800/2, rc 0, transno 21474841445 00000100:00100000:1.0:1746129831.622271:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012ba1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054137216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.622284:0:20441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054138240 00000100:00100000:1.0:1746129831.622287:0:20441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054138240 00000100:00100000:1.0:1746129831.622302:0:20441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16139 00000100:00100000:1.0:1746129831.622306:0:20441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054138240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.622331:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054137728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (139us total) trans 17179874247 rc 0/0 00000100:00100000:2.0:1746129831.622336:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16138 00000004:00080000:2.0:1746129831.622356:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305bd500/2, rc 0, transno 17179874247 00000100:00100000:2.0:1746129831.622360:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054137728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746129831.622392:0:20441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054138240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (162us total) trans 17179874248 rc 0/0 00000100:00100000:1.0:1746129831.622397:0:20441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16139 00000100:00100000:0.0:1746129831.622635:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746129831.622643:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054138496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129831.622665:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129831.622754:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054138496 00000100:00100000:3.0:1746129831.622757:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054138496 00000100:00100000:3.0:1746129831.622786:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16140 00000100:00100000:3.0:1746129831.622792:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3297:x1830949054138496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129831.622935:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949054138496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (255us total) trans 21474841448 rc 0/0 00000100:00100000:3.0:1746129831.622941:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16140 00000004:00080000:0.0:1746129831.623580:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f938000/2, rc 0, transno 21474841448 00000100:00100000:0.0:1746129831.623585:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f938000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054138496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129831.623613:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801305be680/2, rc 0, transno 17179874248 00000100:00100000:2.0:1746129831.623617:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801305be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054138240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129831.627143:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.628372:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657280 00000100:00100000:0.0:1746129831.628382:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657280 00000100:00100000:0.0:1746129831.628420:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11180 00000100:00100000:0.0:1746129831.628428:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31991:x1830949054657280:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129831.628446:0:16808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129831.628462:0:16808:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d95a00/0x48868a4e43956bbf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f50 expref: -99 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.628525:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d94400/0x48868a4e43956bc6 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129831.628536:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092d94400/0x48868a4e43956bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129831.628544:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092d94400/0x48868a4e43956bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00200000:0.0:1746129831.628566:0:16808:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x36b:0x0]: returning size 9122368 00000004:00200000:0.0:1746129831.628569:0:16808:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746129831.628580:0:16808:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092d94400/0x48868a4e43956bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00010000:00010000:0.0:1746129831.628599:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d95a00/0x48868a4e43956bbf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f50 expref: 285 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.628612:0:16808:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092d94400/0x48868a4e43956bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f50 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.628620:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:0.0:1746129831.628622:0:16808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746129831.628625:0:16808:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d94400, rc 0) 00000100:00100000:0.0:1746129831.629557:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31991:x1830949054657280:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1126us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129831.629565:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11180 00000100:00100000:0.0:1746129831.632971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.633014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.633041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.633042:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657408 00000100:00100000:0.0:1746129831.633056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.633067:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.633078:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657536 00000100:00100000:2.0:1746129831.633085:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657536 00000100:00100000:0.0:1746129831.633088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.633104:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657664 00000100:00100000:0.0:1746129831.633108:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657664 00000100:00100000:2.0:1746129831.633116:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657792 00000100:00100000:2.0:1746129831.633117:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657792 00000100:00100000:0.0:1746129831.633124:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054657920 00000100:00100000:0.0:1746129831.633126:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657920 00000100:00100000:2.0:1746129831.633129:0:3624:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054658048 00000100:00100000:2.0:1746129831.633130:0:3624:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054658048 00000100:00100000:0.0:1746129831.633139:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16141 00000100:00100000:0.0:1746129831.633146:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054657536:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129831.633159:0:4589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129831.633173:0:4589:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f5e expref: -99 pid: 4589 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746129831.633193:0:4589:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f2:0x0] initial LVB size: 2097152, mtime: 0x6813d3a5, atime: 0x6813d3a5, ctime: 0x6813d3a4, blocks: 0x821 00000100:00100000:1.0:1746129831.633196:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054657408 00010000:00010000:0.0:1746129831.633207:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.633209:0:4589:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.633217:0:4589:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129831.633228:0:4589:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 20 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129831.633238:0:4589:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092d94e00, rc 0) 00000100:00100000:0.0:1746129831.633271:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054657536:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 126us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.633421:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16142 00000100:00100000:2.0:1746129831.633427:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054657664:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.633434:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.633442:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f65 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129831.633453:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f3:0x0] initial LVB size: 2097152, mtime: 0x6813d3a5, atime: 0x6813d3a4, ctime: 0x6813d3a5, blocks: 0x81f 00010000:00010000:2.0:1746129831.633460:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633461:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633466:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633475:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633481:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da72c00, rc 0) 00000100:00100000:2.0:1746129831.633498:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054657664:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 72us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.633503:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16142 00000100:00100000:2.0:1746129831.633515:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16143 00000100:00100000:2.0:1746129831.633519:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054657792:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.633524:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.633532:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f6c expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129831.633542:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ef:0x0] initial LVB size: 2097152, mtime: 0x6813d3a6, atime: 0x6813d3a6, ctime: 0x6813d3a6, blocks: 0x821 00010000:00010000:2.0:1746129831.633549:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633550:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633553:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633561:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633566:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da73e00, rc 0) 00000100:00100000:2.0:1746129831.633577:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054657792:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 58us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.633581:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16143 00000100:00100000:2.0:1746129831.633588:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16144 00000100:00100000:2.0:1746129831.633592:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1962:x1830949054657920:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.633596:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.633601:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f73 expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129831.633608:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3f0:0x0] initial LVB size: 4928064, mtime: 0x6813d3a6, atime: 0x6813d3a6, ctime: 0x6813d3a6, blocks: 0x15e9 00010000:00010000:2.0:1746129831.633612:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633613:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633616:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633622:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 13 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633627:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da73000, rc 0) 00000100:00100000:2.0:1746129831.633636:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054657920:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 44us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.633639:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16144 00000100:00100000:2.0:1746129831.633646:0:3624:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16145 00000100:00100000:2.0:1746129831.633650:0:3624:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054658048:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.633653:0:3624:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.633658:0:3624:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f7a expref: -99 pid: 3624 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746129831.633665:0:3624:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3f4:0x0] initial LVB size: 4194304, mtime: 0x6813d3a6, atime: 0x6813d3a6, ctime: 0x6813d3a6, blocks: 0x1029 00010000:00010000:2.0:1746129831.633670:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633670:0:3624:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.633674:0:3624:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633680:0:3624:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.633685:0:3624:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da72e00, rc 0) 00000100:00100000:2.0:1746129831.633693:0:3624:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054658048:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 43us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.633696:0:3624:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16145 00000100:00100000:1.0:1746129831.634367:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16146 00000100:00100000:1.0:1746129831.634374:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+12:1961:x1830949054657408:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:1.0:1746129831.634384:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746129831.634393:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f57 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746129831.634404:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3ed:0x0] initial LVB size: 1048576, mtime: 0x6813d3a4, atime: 0x6813d3a4, ctime: 0x6813d3a4, blocks: 0x7e9 00010000:00010000:1.0:1746129831.634413:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.634414:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.634418:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.634427:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 13 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746129831.634434:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a540f800, rc 0) 00000100:00100000:1.0:1746129831.634454:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054657408:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 81us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.634458:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16146 00000100:00100000:0.0:1746129831.634989:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16141 00000100:00100000:0.0:1746129831.645146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.646165:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054658304 00000100:00100000:2.0:1746129831.646174:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054658304 00000100:00100000:0.0:1746129831.646230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.646318:0:21603:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054658560 00000100:00100000:2.0:1746129831.646321:0:21603:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054658560 00000100:00100000:1.0:1746129831.646338:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7319 00000100:00100000:1.0:1746129831.646348:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1962:x1830949054658304:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:2.0:1746129831.646355:0:21603:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7320 00000100:00100000:2.0:1746129831.646360:0:21603:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054658560:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129831.646378:0:21603:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.646378:0:8440:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.646390:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.646390:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.646391:0:21603:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.646391:0:8440:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746129831.646394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:2.0:1746129831.646396:0:21603:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.646396:0:8440:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.646406:0:21603:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.646406:0:8440:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.646408:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054658944 00000100:00100000:3.0:1746129831.646412:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054658944 00000100:00100000:0.0:1746129831.646419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.646432:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.646438:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054659072 00000100:00100000:3.0:1746129831.646440:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054659072 00000100:00100000:3.0:1746129831.646451:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054659456 00000100:00100000:3.0:1746129831.646452:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054659456 00000100:00100000:0.0:1746129831.646461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.646470:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054659328 00000100:00100000:3.0:1746129831.646472:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054659328 00000100:00100000:0.0:1746129831.646479:0:21602:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7321 00000100:00100000:0.0:1746129831.646485:0:21602:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054658944:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:3.0:1746129831.646489:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7322 00000100:00100000:3.0:1746129831.646494:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054659072:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:0.0:1746129831.646501:0:21602:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.646507:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.646507:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.646508:0:21602:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.646511:0:21602:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.646513:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.646515:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.646517:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.646517:0:21602:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.646523:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129831.646547:0:21599:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7323 00000100:00100000:2.0:1746129831.646552:0:21599:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054659456:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129831.646565:0:21599:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.646571:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.646572:0:21599:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.646574:0:21599:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129831.646576:0:21604:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7324 00000100:00100000:0.0:1746129831.646580:0:21604:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054659328:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:2.0:1746129831.646581:0:21599:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.646590:0:21604:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.646596:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.646597:0:21604:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.646599:0:21604:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.646606:0:21604:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.650766:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.650789:0:21600:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054659968 00000100:00100000:3.0:1746129831.650797:0:21600:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054659968 00000100:00100000:2.0:1746129831.650803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.650822:0:21601:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660096 00000100:00100000:2.0:1746129831.650826:0:21601:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660096 00000100:00100000:3.0:1746129831.650838:0:21600:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7325 00000100:00100000:3.0:1746129831.650861:0:21600:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1961:x1830949054659968:12345-192.168.204.31@tcp:3:lfs.0 00000100:00100000:2.0:1746129831.650864:0:21601:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 7326 00000100:00100000:2.0:1746129831.650870:0:21601:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1961:x1830949054660096:12345-192.168.204.31@tcp:3:lfs.0 00010000:00010000:3.0:1746129831.650893:0:21600:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.650894:0:21601:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.650906:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.650906:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.650908:0:21600:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.650908:0:21601:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.650912:0:21600:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.650912:0:21601:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.650934:0:21600:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.650934:0:21601:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661888:0:21603:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661911:0:21603:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661919:0:21603:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661938:0:21603:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da72400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129831.661942:0:21603:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661948:0:21603:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661966:0:21603:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.661972:0:21603:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da72400/0x48868a4e43956bf7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21603 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129831.662951:0:21603:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:4f7f9bfc-9d94-44f8-af78-53c9731f908b+26:1962:x1830949054658560:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 16583us (16714us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129831.662963:0:21603:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7320 00010000:00010000:3.0:1746129831.664623:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.664638:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.664645:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.664651:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c442600 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.664655:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.664663:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.664678:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.664684:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c442600/0x48868a4e43956c0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.664760:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4f7f9bfc-9d94-44f8-af78-53c9731f908b+24:1962:x1830949054659072:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 18262us (18336us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129831.664768:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7322 00010000:00010000:1.0:1746129831.668898:0:21602:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.668913:0:21602:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.668929:0:21602:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.668935:0:21602:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d95a00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129831.668938:0:21602:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.668944:0:21602:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.668960:0:21602:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.668965:0:21602:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d95a00/0x48868a4e43956c05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21602 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.669035:0:21602:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1962:x1830949054658944:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 22546us (22636us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129831.669043:0:21602:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7321 00010000:00010000:2.0:1746129831.673113:0:21599:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.673128:0:21599:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.673140:0:21599:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.673145:0:21599:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da73400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129831.673149:0:21599:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.673156:0:21599:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.673173:0:21599:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.673179:0:21599:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da73400/0x48868a4e43956c13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21599 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129831.673933:0:21599:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+19:1962:x1830949054659456:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 27364us (27483us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129831.673943:0:21599:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7323 00010000:00010000:3.0:1746129831.676580:0:21600:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.676594:0:21600:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.676600:0:21600:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.676605:0:21600:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009adbf400 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:3.0:1746129831.676608:0:21600:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.676614:0:21600:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.676628:0:21600:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.676633:0:21600:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009adbf400/0x48868a4e43956c28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21600 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.676692:0:21600:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054659968:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 25844us (25930us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746129831.676701:0:21600:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7325 00010000:00010000:1.0:1746129831.677810:0:8440:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.677822:0:8440:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.677828:0:8440:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.677833:0:8440:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a540fc00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129831.677836:0:8440:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.677841:0:8440:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.677875:0:8440:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.677879:0:8440:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a540fc00/0x48868a4e43956bfe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.677945:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801305bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+17:1962:x1830949054658304:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 31597us (32803us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129831.677951:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7319 00010000:00010000:1.0:1746129831.681283:0:21604:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.681445:0:21604:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.681458:0:21604:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.681464:0:21604:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092d95c00 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:1.0:1746129831.681467:0:21604:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.681473:0:21604:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.681487:0:21604:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.681492:0:21604:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092d95c00/0x48868a4e43956c1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21604 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.681555:0:21604:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054659328:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 34970us (35089us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746129831.681564:0:21604:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7324 00010000:00010000:2.0:1746129831.687786:0:21601:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.687802:0:21601:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.687810:0:21601:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.687816:0:21601:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da72800 already unused, calling callback (ffffffffa08a1d70) 00010000:00010000:2.0:1746129831.687820:0:21601:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.687827:0:21601:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.687867:0:21601:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.687873:0:21601:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da72800/0x48868a4e43956c21 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21601 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746129831.687965:0:21601:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054660096:12345-192.168.204.31@tcp:3:lfs.0 Request processed in 37090us (37158us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746129831.687975:0:21601:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 7326 00000100:00100000:0.0:1746129831.696208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.696329:0:16808:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660352 00000100:00100000:2.0:1746129831.696337:0:16808:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660352 00000100:00100000:2.0:1746129831.696375:0:16808:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11181 00000100:00100000:2.0:1746129831.696381:0:16808:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31991:x1830949054660352:12345-192.168.204.31@tcp:36:lfs.0 00010000:00010000:2.0:1746129831.696415:0:16808:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746129831.696441:0:16808:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092d94400/0x48868a4e43956bc6 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x36b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f50 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.696464:0:16808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.696468:0:16808:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129831.696497:0:16808:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129831.696507:0:16808:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00010000:00010000:2.0:1746129831.696514:0:16808:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000004:00010000:2.0:1746129831.696636:0:16808:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b00d500 reply state ffff88009c011000 transno 8589945222 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129831.696642:0:16808:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746129831.696693:0:16808:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:31991:x1830949054660352:12345-192.168.204.31@tcp:36:lfs.0 Request processed in 312us (492us total) trans 8589945222 rc 0/0 00000100:00100000:2.0:1746129831.696698:0:16808:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11181 00010000:00010000:3.0:1746129831.699349:0:3283:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16808 initiator: MDT0 00000100:00100000:2.0:1746129831.699353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00010000:00010000:3.0:1746129831.699358:0:3283:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.699364:0:3283:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.699370:0:3283:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012da72800 already unused, calling callback (ffffffffa1371690) 00010000:00010000:3.0:1746129831.699373:0:3283:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.699380:0:3283:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.699393:0:3283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129831.699396:0:3283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746129831.699399:0:3283:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00010000:00010000:3.0:1746129831.699407:0:3283:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c2f lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16808 initiator: MDT0 00000100:00100000:0.0:1746129831.699476:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660480 00000100:00100000:0.0:1746129831.699482:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660480 00000100:00100000:0.0:1746129831.699523:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16147 00000100:00100000:0.0:1746129831.699531:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31991:x1830949054660480:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129831.699543:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129831.699555:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009519ee00/0x48868a4e43956c36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f81 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.699577:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129831.699583:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.699585:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746129831.699588:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009519ee00/0x48868a4e43956c36 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f81 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.699612:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746129831.699622:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746129831.699632:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054138624:192.168.204.31@tcp:104: 00000100:00100000:0.0:1746129831.700372:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.701400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.701569:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054138624:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.701589:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009519ee00/0x48868a4e43956c36 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f81 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.701602:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009519ee00, rc 0) 00000100:00100000:2.0:1746129831.701648:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31991:x1830949054660480:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2114us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.701655:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16147 00000100:00100000:1.0:1746129831.702099:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660608 00000100:00100000:1.0:1746129831.702104:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660608 00010000:00010000:1.0:1746129831.702124:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746129831.702188:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8095 00000100:00100000:1.0:1746129831.702194:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054660608:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.702207:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.702224:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.702234:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.702251:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a540f800/0x48868a4e43956bf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f57 expref: 14 pid: 8436 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.702274:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.702276:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.702281:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009519ee00/0x48868a4e43956c36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f81 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.702288:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009519ee00/0x48868a4e43956c36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f81 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.702309:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009519ee00/0x48868a4e43956c36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f81 expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.702318:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054138752:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129831.702767:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948600 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.705154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.705205:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660736 00000100:00100000:2.0:1746129831.705212:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660736 00000100:00100000:1.0:1746129831.705232:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054138752:192.168.204.31@tcp:105: 00000100:00100000:2.0:1746129831.705254:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16148 00000100:00100000:2.0:1746129831.705260:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31991:x1830949054660736:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.705273:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.705287:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012da73600/0x48868a4e43956c3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f88 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.705305:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129831.705309:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.705315:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.705316:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.705320:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da73600/0x48868a4e43956c3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f88 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.705340:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.705350:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.705360:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054138880:192.168.204.31@tcp:104: 00000100:00100000:1.0:1746129831.705430:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ebe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054660608:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3236us (4032us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.705443:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8095 00000100:00100000:2.0:1746129831.705446:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.708669:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.708895:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054138880:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.708932:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da73600/0x48868a4e43956c3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f88 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.708948:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da73600, rc 0) 00000100:00100000:2.0:1746129831.708987:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31991:x1830949054660736:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 3727us (3838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.708995:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16148 00000100:00100000:1.0:1746129831.709145:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660864 00000100:00100000:1.0:1746129831.709151:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660864 00010000:00010000:1.0:1746129831.709171:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746129831.709203:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8096 00000100:00100000:1.0:1746129831.709209:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054660864:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.709219:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.709235:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.709245:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.709263:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092d94e00/0x48868a4e43956bcd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f5e expref: 21 pid: 4589 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.709287:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.709289:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.709298:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da73600/0x48868a4e43956c3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f88 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.709304:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012da73600/0x48868a4e43956c3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f88 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.709325:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012da73600/0x48868a4e43956c3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f88 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746129831.709335:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054139008:192.168.204.31@tcp:105: 00000100:00100000:1.0:1746129831.709389:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4948540 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.713535:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:1.0:1746129831.713538:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054139008:192.168.204.31@tcp:105: 00010000:00010000:1.0:1746129831.713553:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746129831.713587:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054660864:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 4378us (4925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746129831.713595:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8096 00000100:00100000:2.0:1746129831.713671:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054660992 00000100:00100000:2.0:1746129831.713676:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054660992 00000100:00100000:2.0:1746129831.713715:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16149 00000100:00100000:2.0:1746129831.713722:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31991:x1830949054660992:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.713736:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.713749:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6c1600/0x48868a4e43956c44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f8f expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.713771:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.713778:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.713780:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.713783:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c1600/0x48868a4e43956c44 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f8f expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.713803:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.713813:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.713821:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054139136:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129831.713887:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.715704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.715705:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054139136:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.715723:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6c1600/0x48868a4e43956c44 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f8f expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.715740:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c1600, rc 0) 00000100:00100000:1.0:1746129831.715751:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661120 00000100:00100000:1.0:1746129831.715755:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661120 00010000:00010000:1.0:1746129831.715773:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 22 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.715777:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:31991:x1830949054660992:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2056us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.715783:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16149 00000100:00100000:1.0:1746129831.715804:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8097 00000100:00100000:1.0:1746129831.715810:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1962:x1830949054661120:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746129831.715818:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746129831.715947:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.715960:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.715975:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da72c00/0x48868a4e43956bd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f65 expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746129831.715999:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.716001:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746129831.716005:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6c1600/0x48868a4e43956c44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f8f expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746129831.716012:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6c1600/0x48868a4e43956c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f8f expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.716077:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6c1600/0x48868a4e43956c44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f8f expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746129831.716093:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054139264:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129831.716149:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800aa48cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746129831.717506:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b00f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054139264:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129831.717517:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129831.717550:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1962:x1830949054661120:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 1739us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.717558:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8097 00000100:00100000:0.0:1746129831.717906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.717954:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661248 00000100:00100000:2.0:1746129831.717958:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661248 00000100:00100000:2.0:1746129831.717993:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16150 00000100:00100000:2.0:1746129831.717999:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:31991:x1830949054661248:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.718010:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.718022:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6c0e00/0x48868a4e43956c4b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f96 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.718040:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.718048:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.718049:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.718052:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c0e00/0x48868a4e43956c4b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f96 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.718076:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.718086:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 14 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.718095:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054139392:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129831.718156:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.722512:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.722613:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661376 00000100:00100000:3.0:1746129831.722621:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661376 00010000:00010000:3.0:1746129831.722658:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 15 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.722684:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8098 00000100:00100000:3.0:1746129831.722691:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1962:x1830949054661376:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.722704:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.722727:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 15 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.722737:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 15 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.722761:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.722762:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.722769:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6c0e00/0x48868a4e43956c4b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f96 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.722776:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6c0e00/0x48868a4e43956c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f96 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.722804:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6c0e00/0x48868a4e43956c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f96 expref: 15 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.722821:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054139520:192.168.204.31@tcp:105: 00010000:00010000:2.0:1746129831.722900:0:1140:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da73e00/0x48868a4e43956bdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f6c expref: 15 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.722916:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054139392:192.168.204.31@tcp:104: 00000100:00100000:3.0:1746129831.722934:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1746129831.722949:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f6c0e00/0x48868a4e43956c4b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f96 expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.722959:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6c0e00, rc 0) 00000100:00100000:2.0:1746129831.722984:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b00f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31991:x1830949054661248:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 4985us (5079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.722992:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16150 00000100:00100000:3.0:1746129831.726220:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054139520:192.168.204.31@tcp:105: 00000100:00100000:0.0:1746129831.726461:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.726507:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661504 00010000:00010000:3.0:1746129831.726512:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746129831.726513:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661504 00000100:00100000:2.0:1746129831.726550:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16151 00000100:00100000:2.0:1746129831.726557:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31991:x1830949054661504:12345-192.168.204.31@tcp:101:lfs.0 00000100:00100000:3.0:1746129831.726563:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1962:x1830949054661376:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 3871us (4056us total) trans 0 rc 0/0 00010000:00010000:2.0:1746129831.726570:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746129831.726571:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8098 00010000:00010000:2.0:1746129831.726585:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8800/0x48868a4e43956c52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356f9d expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.726620:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.726627:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.726628:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.726631:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8800/0x48868a4e43956c52 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f9d expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.726655:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.726665:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.726675:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054139648:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129831.726719:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.728435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.728528:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:1140:1830949054139648:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.728544:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8800/0x48868a4e43956c52 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f9d expref: 14 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.728556:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb8800, rc 0) 00000100:00100000:3.0:1746129831.728594:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661632 00000100:00100000:2.0:1746129831.728598:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:31991:x1830949054661504:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 2041us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.728599:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661632 00000100:00100000:2.0:1746129831.728604:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16151 00010000:00010000:3.0:1746129831.728623:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.728682:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8099 00000100:00100000:3.0:1746129831.728689:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054661632:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.728697:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.728712:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.728799:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.728817:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da73000/0x48868a4e43956be2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f73 expref: 14 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.728833:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.728835:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.728839:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8800/0x48868a4e43956c52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f9d expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.728865:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8800/0x48868a4e43956c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f9d expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.728888:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffb8800/0x48868a4e43956c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f9d expref: 13 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.728897:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054139776:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129831.729114:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746129831.731042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.731121:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10979:1830949054139776:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129831.731138:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.731177:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054661632:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2488us (2745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.731185:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8099 00000100:00100000:2.0:1746129831.731319:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661760 00000100:00100000:2.0:1746129831.731324:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661760 00000100:00100000:2.0:1746129831.731348:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16152 00000100:00100000:2.0:1746129831.731353:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:31991:x1830949054661760:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:2.0:1746129831.731365:0:1140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746129831.731376:0:1140:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43956c59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356fa4 expref: -99 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.731396:0:1140:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.731403:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.731404:0:1140:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746129831.731408:0:1140:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43956c59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fa4 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.731428:0:1140:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746129831.731438:0:1140:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746129831.731447:0:1140:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054139904:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129831.731490:0:1140:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324780 going to sleep for 11 seconds 00000100:00100000:2.0:1746129831.733069:0:1140:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:1140:1830949054139904:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.733089:0:1140:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43956c59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fa4 expref: 21 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.733106:0:1140:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ffb8200, rc 0) 00000100:00100000:2.0:1746129831.733192:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:31991:x1830949054661760:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 1837us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746129831.733199:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16152 00000100:00100000:0.0:1746129831.733526:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.733603:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054661888 00000100:00100000:3.0:1746129831.733608:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054661888 00010000:00010000:3.0:1746129831.733630:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746129831.733712:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8100 00000100:00100000:3.0:1746129831.733719:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054661888:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.733731:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.733749:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.733758:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.733777:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da72e00/0x48868a4e43956be9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f7a expref: 21 pid: 3624 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746129831.733790:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.733792:0:10979:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746129831.733797:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43956c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fa4 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.733803:0:10979:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43956c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fa4 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746129831.733825:0:10979:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffb8200/0x48868a4e43956c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fa4 expref: 20 pid: 1140 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746129831.733835:0:10979:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054140032:192.168.204.31@tcp:105: 00000100:00100000:3.0:1746129831.733915:0:10979:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c59cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.735839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.735992:0:10979:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b7d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:10979:1830949054140032:192.168.204.31@tcp:105: 00010000:00010000:3.0:1746129831.736007:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746129831.736072:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054661888:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 2353us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.736081:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8100 00000100:00100000:2.0:1746129831.736147:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662016 00000100:00100000:2.0:1746129831.736152:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662016 00000100:00100000:0.0:1746129831.736273:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.737374:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662144 00000100:00100000:2.0:1746129831.737378:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662144 00000100:00100000:1.0:1746129831.737417:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16153 00000100:00100000:1.0:1746129831.737426:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+13:1961:x1830949054662016:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129831.737498:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16154 00000100:00100000:2.0:1746129831.737505:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+20:1961:x1830949054662144:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:1.0:1746129831.737580:0:1877:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746129831.737583:0:1877:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129828 -> 1746129830 00002000:00010000:1.0:1746129831.737585:0:1877:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129828 -> 1746129830 00002000:00010000:1.0:1746129831.737586:0:1877:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129828 -> 1746129832 00002000:00010000:1.0:1746129831.737588:0:1877:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2025 -> 2025 00002000:00010000:2.0:1746129831.737602:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129831.737605:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129829 -> 1746129830 00002000:00010000:2.0:1746129831.737608:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129829 -> 1746129830 00000100:00100000:1.0:1746129831.737608:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:4f7f9bfc-9d94-44f8-af78-53c9731f908b+14:1961:x1830949054662016:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 184us (1774us total) trans 21474841449 rc 0/0 00002000:00010000:2.0:1746129831.737609:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129828 -> 1746129832 00002000:00010000:2.0:1746129831.737611:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746129831.737613:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16153 00000100:00100000:2.0:1746129831.737632:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+21:1961:x1830949054662144:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 128us (1359us total) trans 17179874249 rc 0/0 00000100:00100000:2.0:1746129831.737637:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16154 00000100:00100000:0.0:1746129831.737703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.737721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.737732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.737745:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662400 00000100:00100000:3.0:1746129831.737749:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662400 00000100:00100000:0.0:1746129831.737763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.737768:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662656 00000100:00100000:3.0:1746129831.737770:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662656 00000100:00100000:3.0:1746129831.737779:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662272 00000100:00100000:3.0:1746129831.737781:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662272 00000100:00100000:3.0:1746129831.737793:0:4589:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662528 00000100:00100000:3.0:1746129831.737795:0:4589:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662528 00000100:00100000:3.0:1746129831.737807:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16155 00000100:00100000:3.0:1746129831.737812:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054662400:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129831.737863:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16156 00000100:00100000:2.0:1746129831.737869:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+22:1961:x1830949054662656:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129831.737904:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129831.737907:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:3.0:1746129831.737908:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:3.0:1746129831.737910:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129830 -> 1746129832 00002000:00010000:3.0:1746129831.737911:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746129831.737935:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746129831.737937:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:2.0:1746129831.737939:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:2.0:1746129831.737941:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129830 -> 1746129832 00002000:00010000:2.0:1746129831.737943:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746129831.737946:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949054662400:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 134us (242us total) trans 21474841450 rc 0/0 00000100:00100000:3.0:1746129831.737950:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16155 00000100:00100000:2.0:1746129831.737959:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054662656:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 90us (237us total) trans 17179874250 rc 0/0 00000100:00100000:3.0:1746129831.737962:0:4589:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16157 00000100:00100000:2.0:1746129831.737965:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16156 00000100:00100000:3.0:1746129831.737967:0:4589:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054662272:12345-192.168.204.31@tcp:2:lfs.0 00000100:00100000:2.0:1746129831.737975:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 16158 00000100:00100000:2.0:1746129831.737980:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+15:1961:x1830949054662528:12345-192.168.204.31@tcp:2:lfs.0 00002000:00010000:3.0:1746129831.738023:0:4589:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746129831.738026:0:4589:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129829 -> 1746129830 00002000:00010000:3.0:1746129831.738027:0:4589:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129828 -> 1746129830 00002000:00010000:3.0:1746129831.738029:0:4589:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129829 -> 1746129832 00002000:00010000:3.0:1746129831.738030:0:4589:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00002000:00010000:2.0:1746129831.738038:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:2.0:1746129831.738041:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:2.0:1746129831.738042:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:2.0:1746129831.738044:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129830 -> 1746129832 00000100:00100000:3.0:1746129831.738046:0:4589:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:4f7f9bfc-9d94-44f8-af78-53c9731f908b+23:1961:x1830949054662272:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 79us (313us total) trans 17179874251 rc 0/0 00002000:00010000:2.0:1746129831.738046:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:3.0:1746129831.738051:0:4589:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16157 00000100:00100000:2.0:1746129831.738061:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fbed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:4f7f9bfc-9d94-44f8-af78-53c9731f908b+16:1961:x1830949054662528:12345-192.168.204.31@tcp:2:lfs.0 Request processed in 81us (297us total) trans 21474841451 rc 0/0 00000100:00100000:2.0:1746129831.738067:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 16158 00000100:00100000:0.0:1746129831.740586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.740668:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054662912 00000100:00100000:2.0:1746129831.740675:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054662912 00000100:00100000:2.0:1746129831.740713:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11182 00000100:00100000:2.0:1746129831.740718:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31991:x1830949054662912:12345-192.168.204.31@tcp:55:lfs.0 00010000:00010000:2.0:1746129831.740770:0:14315:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740783:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740792:0:14315:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740809:0:14315:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740815:0:14315:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740820:0:14315:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740825:0:14315:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8000 already unused, calling callback (ffffffffa1371690) 00010000:00010000:2.0:1746129831.740829:0:14315:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740834:0:14315:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740843:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.740845:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1746129831.740869:0:14315:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00010000:00010000:2.0:1746129831.740874:0:14315:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8000/0x48868a4e43956c60 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14315 initiator: MDT0 00000100:00100000:2.0:1746129831.741462:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31991:x1830949054662912:12345-192.168.204.31@tcp:55:lfs.0 Request processed in 742us (881us total) trans 0 rc -22/-22 00000100:00100000:2.0:1746129831.741469:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11182 00000100:00100000:0.0:1746129831.743501:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.743579:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054663168 00000100:00100000:2.0:1746129831.743585:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054663168 00000100:00100000:2.0:1746129831.743632:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4708 00000100:00100000:2.0:1746129831.743638:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:31991:x1830949054663168:12345-192.168.204.31@tcp:35:lfs.0 00000004:00010000:2.0:1746129831.743677:0:14316:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x36b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956b79 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f42 expref: 284 pid: 16808 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.743715:0:14316:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129831.743725:0:14316:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.743730:0:14316:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129831.743754:0:14316:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 284 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746129831.743764:0:14316:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 284 pid: 14315 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746129831.743774:0:14316:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949054140160:192.168.204.31@tcp:104: 00000100:00100000:2.0:1746129831.743840:0:14316:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a324840 going to sleep for 11 seconds 00000100:00100000:0.0:1746129831.745396:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:3.0:1746129831.745446:0:10979:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054663296 00000100:00100000:3.0:1746129831.745451:0:10979:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054663296 00010000:00010000:3.0:1746129831.745475:0:10979:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 285 pid: 14315 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746129831.745483:0:14316:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800934d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14316:1830949054140160:192.168.204.31@tcp:104: 00010000:00010000:2.0:1746129831.745496:0:14316:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:3.0:1746129831.745508:0:10979:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 8101 00000100:00100000:3.0:1746129831.745515:0:10979:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+285:1961:x1830949054663296:12345-192.168.204.31@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746129831.745530:0:10979:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746129831.745535:0:10979:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 285 pid: 14315 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746129831.745544:0:10979:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 285 pid: 14315 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746129831.745557:0:10979:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da73a00/0x48868a4e43956bb8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f49 expref: 285 pid: 14315 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746129831.745571:0:10979:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:3.0:1746129831.745575:0:10979:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129831.745581:0:10979:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129831.745586:0:10979:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14316 initiator: MDT0 00010000:00010000:3.0:1746129831.745607:0:10979:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746129831.745618:0:14316:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00010000:00010000:2.0:1746129831.745624:0:14316:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:3.0:1746129831.745634:0:10979:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f7f9bfc-9d94-44f8-af78-53c9731f908b+284:1961:x1830949054663296:12345-192.168.204.31@tcp:103:ldlm_bl.0 Request processed in 120us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746129831.745640:0:10979:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 8101 00000040:00080000:2.0:1746129831.746221:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3606, 88 off304072 00000004:00080000:2.0:1746129831.746226:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777804378000ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.747556:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3602, 88 off303632 00000004:00080000:2.0:1746129831.747563:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777805715083ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748158:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3603, 88 off303720 00000004:00080000:2.0:1746129831.748162:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806313623ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748174:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3607, 88 off304160 00000004:00080000:2.0:1746129831.748176:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806327935ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748315:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3608, 88 off304248 00000004:00080000:2.0:1746129831.748319:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806471160ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748326:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3604, 88 off303808 00000004:00080000:2.0:1746129831.748328:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806480619ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748335:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3605, 88 off303896 00000004:00080000:2.0:1746129831.748337:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806488988ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748343:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3606, 88 off303984 00000004:00080000:2.0:1746129831.748345:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806497380ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748351:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3609, 88 off304336 00000004:00080000:2.0:1746129831.748353:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806504949ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748359:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3607, 88 off304072 00000004:00080000:2.0:1746129831.748361:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806513713ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748367:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3610, 88 off304424 00000004:00080000:2.0:1746129831.748369:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806520775ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748374:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3608, 88 off304160 00000004:00080000:2.0:1746129831.748377:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806528710ns, next at 716792379979ns, rc = 0 00000040:00080000:2.0:1746129831.748382:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3611, 88 off304512 00000004:00080000:2.0:1746129831.748385:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806536855ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748391:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3612, 88 off304600 00000004:00080000:2.0:1746129831.748393:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806545598ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748399:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3613, 88 off304688 00000004:00080000:2.0:1746129831.748402:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806554201ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748408:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3614, 88 off304776 00000004:00080000:2.0:1746129831.748410:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 777806562003ns, next at 731767308185ns, rc = 0 00000040:00080000:2.0:1746129831.748416:0:14316:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3609, 88 off304248 00000004:00080000:2.0:1746129831.748418:0:14316:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 777806570500ns, next at 716792379979ns, rc = 0 00000004:00010000:2.0:1746129831.768968:0:14316:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c678380 reply state ffff88009295fc00 transno 8589945223 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129831.768979:0:14316:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746129831.768988:0:14316:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:2.0:1746129831.768991:0:14316:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00000001:00080000:1.0:1746129831.768993:0:14399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945223 is committed 00010000:00010000:2.0:1746129831.768998:0:14316:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009adbe000/0x48868a4e43956b79 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x36b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356f42 expref: 283 pid: 16808 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746129831.768999:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2775 committed 00000004:00080000:1.0:1746129831.769101:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2785 committed 00000004:00080000:1.0:1746129831.769107:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2784 committed 00000004:00080000:1.0:1746129831.769109:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2783 committed 00000004:00080000:1.0:1746129831.769110:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2782 committed 00000004:00080000:1.0:1746129831.769112:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2774 committed 00000004:00080000:1.0:1746129831.769113:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2781 committed 00000004:00080000:1.0:1746129831.769115:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2773 committed 00000004:00080000:1.0:1746129831.769116:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2780 committed 00000004:00080000:1.0:1746129831.769117:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2772 committed 00000004:00080000:1.0:1746129831.769118:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2771 committed 00000004:00080000:1.0:1746129831.769120:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2770 committed 00000004:00080000:1.0:1746129831.769121:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2779 committed 00000004:00080000:1.0:1746129831.769122:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2778 committed 00000004:00080000:1.0:1746129831.769123:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2769 committed 00000004:00080000:1.0:1746129831.769124:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2768 committed 00000004:00080000:1.0:1746129831.769125:0:14399:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2777 committed 00010000:00080000:2.0:1746129831.769167:0:14316:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746129831.769179:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31991:x1830949054663168:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 25540us (25683us total) trans 8589945223 rc 0/0 00000100:00100000:2.0:1746129831.769188:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4708 00000100:00100000:2.0:1746129831.769214:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054140416:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.769254:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.769283:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054140928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.769299:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746129831.769301:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129831.769307:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129831.769313:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141440:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746129831.769313:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129831.769318:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ffb8400 already unused, calling callback (ffffffffa1371690) 00010000:00010000:1.0:1746129831.769321:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129831.769325:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746129831.769325:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129831.769336:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1746129831.769336:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88008f244b00) 00010000:00010000:1.0:1746129831.769338:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746129831.769340:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141056:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746129831.769341:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00010000:00010000:1.0:1746129831.769345:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffb8400/0x48868a4e43956c67 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14316 initiator: MDT0 00000100:00100000:2.0:1746129831.769353:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.769368:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140416 00000100:00100000:2.0:1746129831.769371:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140928 00000100:00100000:1.0:1746129831.769373:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140416 00000100:00100000:2.0:1746129831.769375:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140928 00000100:00100000:2.0:1746129831.769393:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141440 00000100:00100000:2.0:1746129831.769394:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141440 00000100:00100000:1.0:1746129831.769399:0:7975:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141056 00000100:00100000:1.0:1746129831.769401:0:7975:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141056 00000100:00100000:2.0:1746129831.769406:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16159 00000100:00100000:2.0:1746129831.769411:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949054140928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.769415:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16160 00000100:00100000:1.0:1746129831.769419:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3298:x1830949054140416:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129831.769542:0:7975:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746129831.769545:0:7975:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:1.0:1746129831.769547:0:7975:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:1.0:1746129831.769549:0:7975:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb ctime from disk: 1746129832 -> 1746129832 00002000:00010000:1.0:1746129831.769550:0:7975:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f3:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746129831.769582:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3298:x1830949054140416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (327us total) trans 17179874252 rc 0/0 00000100:00100000:1.0:1746129831.769586:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16160 00000100:00100000:1.0:1746129831.769597:0:7975:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16161 00000100:00100000:1.0:1746129831.769600:0:7975:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949054141440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.769625:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16162 00000100:00100000:1.0:1746129831.769629:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3298:x1830949054141056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.769791:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3298:x1830949054140928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 379us (490us total) trans 21474841452 rc 0/0 00000100:00100000:2.0:1746129831.769797:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16159 00000004:00080000:2.0:1746129831.769828:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f939c00/2, rc 0, transno 21474841452 00000100:00100000:2.0:1746129831.769836:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054140928:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129831.769843:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c679f80/2, rc 0, transno 17179874252 00000100:00100000:2.0:1746129831.769865:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054140416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.769938:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054140288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.769963:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129831.769978:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054140800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129831.769992:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129831.770002:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054141312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.770006:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140288 00000100:00100000:2.0:1746129831.770009:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140288 00000100:00100000:0.0:1746129831.770014:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.770023:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140800 00000100:00100000:2.0:1746129831.770025:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140800 00000100:00100000:0.0:1746129831.770026:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746129831.770030:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054140672:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.770033:0:3623:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141312 00000100:00100000:2.0:1746129831.770035:0:3623:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141312 00000100:00100000:2.0:1746129831.770046:0:3623:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16163 00000100:00100000:0.0:1746129831.770047:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.770050:0:3623:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3297:x1830949054140288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.770058:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054141184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129831.770070:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746129831.770123:0:3623:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746129831.770125:0:3623:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:2.0:1746129831.770127:0:3623:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:2.0:1746129831.770129:0:3623:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb ctime from disk: 1746129832 -> 1746129832 00002000:00010000:2.0:1746129831.770131:0:3623:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f2:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746129831.770153:0:3623:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3297:x1830949054140288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (189us total) trans 17179874253 rc 0/0 00000100:00100000:0.0:1746129831.770168:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140672 00000100:00100000:2.0:1746129831.770169:0:3623:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16163 00000100:00100000:0.0:1746129831.770171:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140672 00000100:00100000:0.0:1746129831.770184:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141184 00000100:00100000:0.0:1746129831.770185:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141184 00000100:00100000:0.0:1746129831.770193:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16164 00000100:00100000:0.0:1746129831.770197:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949054140800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129831.770274:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb size from disk: 4928064 -> 4928064 00002000:00010000:0.0:1746129831.770276:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:0.0:1746129831.770279:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:0.0:1746129831.770280:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb ctime from disk: 1746129832 -> 1746129832 00002000:00010000:0.0:1746129831.770282:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3f0:0x0] updating lvb blocks from disk: 5609 -> 5609 00000100:00100000:0.0:1746129831.770301:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054140800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (308us total) trans 21474841453 rc 0/0 00000100:00100000:0.0:1746129831.770306:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16164 00000100:00100000:0.0:1746129831.770315:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16165 00000100:00100000:0.0:1746129831.770319:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949054141312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129831.770389:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054141312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (373us total) trans 21474841454 rc 0/0 00000100:00100000:0.0:1746129831.770394:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16165 00000100:00100000:0.0:1746129831.770404:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16166 00000100:00100000:0.0:1746129831.770407:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949054140672:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746129831.770465:0:1140:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746129831.770468:0:1140:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:0.0:1746129831.770470:0:1140:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:0.0:1746129831.770472:0:1140:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb ctime from disk: 1746129832 -> 1746129832 00002000:00010000:0.0:1746129831.770473:0:1140:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ef:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746129831.770489:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054140672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (442us total) trans 21474841455 rc 0/0 00000100:00100000:0.0:1746129831.770493:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16166 00000100:00100000:0.0:1746129831.770514:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16167 00000100:00100000:0.0:1746129831.770518:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830949054141184:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129831.770731:0:3299:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054140544:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746129831.770754:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746129831.770788:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054140544 00000100:00100000:3.0:1746129831.770791:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054140544 00000100:00100000:3.0:1746129831.770809:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16168 00000100:00100000:3.0:1746129831.770813:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3299:x1830949054140544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746129831.770901:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746129831.770904:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:3.0:1746129831.770905:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:3.0:1746129831.770907:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb ctime from disk: 1746129832 -> 1746129832 00002000:00010000:3.0:1746129831.770908:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3ed:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746129831.770940:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3299:x1830949054140544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (185us total) trans 21474841456 rc 0/0 00000100:00100000:3.0:1746129831.770945:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16168 00000004:00080000:3.0:1746129831.770983:0:3299:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f939500/2, rc 0, transno 21474841456 00000100:00100000:3.0:1746129831.770987:0:3299:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3299:1830949054140544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.771647:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746129831.771655:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129831.771728:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c67b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3297:x1830949054141184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1208us (1655us total) trans 21474841457 rc 0/0 00000100:00100000:2.0:1746129831.771732:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129831.771735:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16167 00000100:00100000:0.0:1746129831.771753:0:1140:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141568 00000100:00100000:0.0:1746129831.771755:0:1140:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141568 00000100:00100000:0.0:1746129831.771773:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16169 00000100:00100000:0.0:1746129831.771777:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949054141568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746129831.771881:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3298:x1830949054141568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (148us total) trans 21474841459 rc 0/0 00000100:00100000:0.0:1746129831.771886:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16169 00000004:00080000:0.0:1746129831.771913:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f939880/2, rc 0, transno 21474841455 00000100:00100000:0.0:1746129831.771917:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054140672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129831.771937:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93a300/2, rc 0, transno 21474841457 00000100:00100000:0.0:1746129831.771939:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054141184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746129831.771940:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93aa00/2, rc 0, transno 21474841459 00000100:00100000:2.0:1746129831.771944:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129831.771947:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c678700/2, rc 0, transno 17179874253 00000100:00100000:0.0:1746129831.771950:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c678700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054140288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129831.771958:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93bb80/2, rc 0, transno 21474841453 00000100:00100000:0.0:1746129831.771961:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054140800:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746129831.771967:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93b100/2, rc 0, transno 21474841454 00000100:00100000:0.0:1746129831.771969:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054141312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746129831.771971:0:7975:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949054141440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2370us (2644us total) trans 21474841458 rc 0/0 00000100:00100000:1.0:1746129831.771977:0:7975:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16161 00000004:00080000:2.0:1746129831.771978:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93ad80/2, rc 0, transno 21474841458 00000100:00100000:2.0:1746129831.771982:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.772001:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054141696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.772020:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.772035:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054142208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.772039:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054141824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.772052:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.772055:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800934d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3298:x1830949054141056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2425us (2701us total) trans 21474841460 rc 0/0 00000100:00100000:1.0:1746129831.772060:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16162 00000100:00100000:1.0:1746129831.772068:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141696 00000100:00100000:1.0:1746129831.772071:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141696 00000100:00100000:0.0:1746129831.772073:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746129831.772081:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054142208 00000100:00100000:1.0:1746129831.772083:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054142208 00000100:00100000:0.0:1746129831.772085:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054142336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.772086:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141824 00000100:00100000:2.0:1746129831.772089:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141824 00000100:00100000:1.0:1746129831.772093:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16170 00000100:00100000:1.0:1746129831.772097:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3296:x1830949054141696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.772098:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746129831.772102:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054142336 00000100:00100000:2.0:1746129831.772104:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054142336 00000100:00100000:2.0:1746129831.772115:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16171 00000100:00100000:2.0:1746129831.772120:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+18:3296:x1830949054142208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.772120:0:1140:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16172 00000100:00100000:0.0:1746129831.772125:0:1140:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3297:x1830949054141824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746129831.772182:0:8435:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746129831.772184:0:8435:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb mtime from disk: 1746129830 -> 1746129830 00002000:00010000:1.0:1746129831.772186:0:8435:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb atime from disk: 1746129830 -> 1746129830 00002000:00010000:1.0:1746129831.772188:0:8435:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb ctime from disk: 1746129832 -> 1746129832 00002000:00010000:1.0:1746129831.772190:0:8435:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3f4:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746129831.772212:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054142208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (158us total) trans 17179874255 rc 0/0 00000100:00100000:2.0:1746129831.772217:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16171 00000100:00100000:1.0:1746129831.772221:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3296:x1830949054141696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 124us (200us total) trans 17179874254 rc 0/0 00000100:00100000:0.0:1746129831.772222:0:1140:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095240700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830949054141824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (148us total) trans 17179874256 rc 0/0 00000100:00100000:1.0:1746129831.772227:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16170 00000100:00100000:2.0:1746129831.772229:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16173 00000100:00100000:0.0:1746129831.772232:0:1140:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16172 00000100:00100000:2.0:1746129831.772234:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3297:x1830949054142336:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746129831.772248:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c678e00/2, rc 0, transno 17179874256 00000100:00100000:0.0:1746129831.772251:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054141824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129831.772284:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129831.772309:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746129831.772319:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095242d80/2, rc 0, transno 17179874257 00000100:00100000:2.0:1746129831.772321:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095243800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3297:x1830949054142336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (221us total) trans 17179874257 rc 0/0 00000100:00100000:0.0:1746129831.772323:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095242d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3297:1830949054142336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746129831.772326:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f93b480/2, rc 0, transno 21474841460 00000100:00100000:2.0:1746129831.772327:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16173 00000100:00100000:3.0:1746129831.772328:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746129831.772335:0:1877:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054141952 00000100:00100000:2.0:1746129831.772338:0:1877:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054141952 00000100:00100000:3.0:1746129831.772341:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746129831.772344:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054142080:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.772350:0:1877:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16174 00000100:00100000:2.0:1746129831.772354:0:1877:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+19:3298:x1830949054141952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746129831.772359:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746129831.772369:0:7976:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054142080 00000100:00100000:0.0:1746129831.772372:0:7976:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054142080 00000100:00100000:0.0:1746129831.772385:0:7976:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16175 00000100:00100000:0.0:1746129831.772389:0:7976:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3298:x1830949054142080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.772424:0:1877:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a341c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054141952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (114us total) trans 17179874258 rc 0/0 00000100:00100000:2.0:1746129831.772429:0:1877:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16174 00000004:00080000:3.0:1746129831.772452:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c67a680/2, rc 0, transno 17179874258 00000100:00100000:3.0:1746129831.772456:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054141952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.772461:0:7976:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3298:x1830949054142080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (102us total) trans 17179874259 rc 0/0 00000004:00080000:3.0:1746129831.772462:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c679500/2, rc 0, transno 17179874259 00000100:00100000:3.0:1746129831.772464:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3298:1830949054142080:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746129831.772466:0:7976:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16175 00000004:00080000:2.0:1746129831.774242:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095243480/2, rc 0, transno 17179874255 00000100:00100000:2.0:1746129831.774250:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095243480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054142208:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746129831.774259:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c67ad80/2, rc 0, transno 17179874254 00000100:00100000:2.0:1746129831.774262:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3296:1830949054141696:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746129831.774820:0:3291:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:0.0:1746129831.775402:0:14315:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054663424 00000100:00100000:0.0:1746129831.775409:0:14315:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054663424 00000100:00100000:0.0:1746129831.776115:0:14315:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 11183 00000100:00100000:0.0:1746129831.776123:0:14315:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+281:31991:x1830949054663424:12345-192.168.204.31@tcp:101:lfs.0 00010000:00010000:0.0:1746129831.776139:0:14315:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746129831.776156:0:14315:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c6e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2f4ff069bf356fab expref: -99 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.776205:0:14315:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fab expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.776217:0:14315:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da72800/0x48868a4e43956c6e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x36b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.31@tcp remote: 0x2f4ff069bf356fab expref: 282 pid: 14315 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746129831.776230:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x36b:0x0].0x0 (ffff88009f888300) 00010000:00010000:0.0:1746129831.776233:0:14315:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746129831.776235:0:14315:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da72800, rc 0) 00000100:00100000:0.0:1746129831.776269:0:14315:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a00c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31991:x1830949054663424:12345-192.168.204.31@tcp:101:lfs.0 Request processed in 148us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1746129831.776274:0:14315:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 11183 00000100:00100000:0.0:1746129831.779277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.204.31@tcp (source: 12345-192.168.204.31@tcp) 00000100:00100000:2.0:1746129831.779347:0:14316:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830949054663680 00000100:00100000:2.0:1746129831.779355:0:14316:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830949054663680 00000100:00100000:2.0:1746129831.779399:0:14316:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.31@tcp, seq: 4709 00000100:00100000:2.0:1746129831.779405:0:14316:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baa0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+282:31991:x1830949054663680:12345-192.168.204.31@tcp:35:lfs.0 00000100:00100000:2.0:1746129831.779616:0:14316:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baa0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4f7f9bfc-9d94-44f8-af78-53c9731f908b+283:31991:x1830949054663680:12345-192.168.204.31@tcp:35:lfs.0 Request processed in 209us (344us total) trans 8589945224 rc 0/0 00000100:00100000:2.0:1746129831.779622:0:14316:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.31@tcp, seq: 4709 00010000:00010000:2.0:1746129832.236993:0:12137:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1746129832.534311:0:6267:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed Debug log: 70050 lines, 70050 kept, 0 dropped, 0 bad.